My Virtual Villagers 3 tribe is not getting any children?

There is only one male adult in the tribe. I keep dragging him to each of the ladies but they are not getting any babies? They did before, but now they don't get? The ladies are not holding a baby.