For 2 main reasons: to cool the servers and to generate the electricity they consume. According to the International Energy Agency, two thirds of the water used by data centres goes to electricity generation, a quarter to direct cooling and the rest to manufacturing chips. Mistral AI counts 45 mL of water for an answer of about 320 words.
Read the source article: AI life cycle assessment: Mistral AI's results by stage