Infertility can be caused by one or both of the partners. Learn why infertility happens, and what the most common causes are in women and men.