I think perfect games, unlike an odd no-hitter, do change your legacy or at least make you more memorable. I couldn’t name all 23 perfect game pitchers but I’d recognize all their names and probably if prompted tell you when they pitched it, within a year or two.