Doves in a basket

We have a pair of mourning doves nesting in a hanging flower basket on our back deck. We have watched them build the nest, and now have seen one egg. My concern is that the female will leave the nest and the egg for hours at a time. She always returns as does the male, but can the egg survive without mama keeping it warm?