Yeah, they do get that high...for the 5 star ones anyway.
You don't really see scars anyway if you never look up close at your character, which I, and apparently you, don't usually do.
And you find all of them them there anyway, so it's not really much to fret about.