Not for a single query, since a short query uses about as much energy as a Google search; the problem is volume. Inference now dominates training, the number of tokens processed is projected to rise 24-fold by 2030, and data centre electricity use is set to double in six years to reach ~3% of global electricity, putting strain on the grid.
Read the source article: Which AI uses the least energy? ChatGPT vs Claude vs Gemini