Bacterial conjunctivitis (pink eye caused by bacteria) is also a common infection in babies. It can cause redness around the eyes and a thick yellow or greenish discharge that may crust over, ...