Hmm, if you hide your reputation why would you care anyways? Unless you turn it back on just to see it, in which case you sorta do care.
But I guess it'd make sense to make it all, rep related things, invisible to people that "opt out" and want to have it hidden.