Fever in a new born should not be taken lightly. There are many reasons for fever, it could be viral infections or bacterial infections affecting any part of the body. In new born babies this can become very serious. So if the fever is continuing please see a pediatrician immediately. He may have to take cultures of the urine and blood and treat accordingly.