Why is it commonly "Sweet Old Lady" and "Grumpy Old Man", and not vice versa?

I know some mean old ladies and some sweet old men. My maternal great grandmother was the sweetest person to ever walk the face of the earth,imo. And my paternal grandfather was one of the most onery. Your sex has nothing to do with your disposition, imo.