Even in neural networks, boys remain boys