Sponge baths! This means rather than placing your baby in the water, you’ll place them on a warm towel or blanket without any submersion in water. Using a clean washcloth with mild soap and water, you can gently “spot clean” your little one’s body from head to toe, taking care to wash the diaper region last.