I grew up with anime - I probably been watching for like 20 some years - from old school to some of the newer series. I think the only thing that has changed for me is time. I am still single, but I do have a full time career. Time and energy to devote to hobby have also declined as a consequence.
I do not feel I have outgrow anime, but I do feel my taste has changed. I think it is part of my history. Nowadays I prefer more artsy and intellectual stories or outright gag comedies. I am much less attracted to monster/villain-of-the-week or soap opera style series.
Anyway nothing wrong with watching anime as you age. To me, it is just a form of entertainment.