The sperm would have to swim up the fallopian tubes into the ovaries and do that to all the eggs. But back to the first part, if the egg doesn't get fertilized because the sperm dies it won't attatch to the uterus wall and will just shed when there is menstruation.

So no, I don't see how this will make women infertile.