Mixing in water right before feeding is okay, soaking overnight is not. As soon as dry food comes in contact with water, nutrients start breaking down much faster and bacteria begin to grow.
If you think you absolutely have to feed a mush instead of whole pieces, grind the dry kibble to a coarse powder in a blender, mix with water and serve.