Show products in category "Shoes" if they also have category "Men"

I want to show products in a category if they are also in another category.

I never build a clothing webshop and now the time has came. I was adding base categories when I came to the conclusion: "in order to show shoes that are only for women, I have to split the "Shoes" category into two separate categories "Shoes Men" and "Shoes Women".

This sounds like a stupid thing to do in my mind. Shouldn’t you be able to show all the products in the "Shoes" category if they also met the "Men" categorie?

I have several categories that are for both men and women and also some unisex products, this means I have to create three categories for every category I have ("Shoes Men", "Shoes Women", "Shoes Unisex")

Any tips how te make the categories simpler?