I think women are really who controls society, simply because they control the home and are mainly who socialize the children. The emergence of the state as a moderating force in human social relations has modified that reality slightly by introducing the nuclear family unit but not by much.
The biological role of men is more that of an interchangeable heavy lifter and provisioner who can come and go without changing the social dynamic very much.
That's part of the reason why that before the state subjugated all individuals human society had a matriarchal basis. No one really knew who their father was and if there were irreconcilable domestic differences a man left the home and went back to his parents or to the home of another woman.