When your baby or infant has a fever - National Library of Medicine The first fever in a baby or an infant is often a scary moment for parents. ... unless the fever comes down readily with treatment and the child is comfortable.