As a side note regarding Seiren and Amagami sharing the same setting, the MC's closest friend (the one who excels in studying) is also apparently Ai's younger brother ... Ai being the younger girl who was on the swim team in Amagami and who's arc was the fourth one.
I'll just recommend to you briefly that Cavalry is probably not at all like the other school boy meets redhead girl anime that other people are selling it out to be. As someone whose read the LN, since you liked baby steps, I think you'll end up liking this one a lot (as long as it isn't adapted badly). This actually has a pretty good story IMO, and only starts cliched at the very beginning (like literally just episode 1). After that, the plot becomes really interesting, so I hope you give it a good try.