There is an amazing book called The Chalice and The Blade by Riane Eisler that fleshes out the details of this story. It’s a substantial tome, but well worth the read if you’re interested in such things.
While I agree with you that men are responsible for a lot of todays societal ills, it’s really this schism between spirit and mattter, sacred and holy that fucked everything all up. Men just have the unenviable role of enforcing this hierarchy, and violence is the sanctioned tool for them to use.