How old are they? If they're still nursing, it's normal. If you're unsure, look at their overall condition -- babies show signs of dehydration and starvation very quickly if they don't have what they need. If they look healthy, chances are they're still getting everything they need from mom. Alternatively, young guinea pigs tend to be shy and may just not eat when you're around.