Uses14 November 2026Where does AI perform best today?
Mathematics, code, writing, office work, information retrieval, advice, long projects: measurements published from 2023 to 2026
Desks set up for the written exams of a competitive entrance exam, in France, in June 2020. Photo Jérémy Barande, École polytechnique, CC BY-SA 2.0, via Wikimedia Commons.
AI performs best on well-defined tasks whose answer can be checked: in competition mathematics, a Google model won the gold medal at the 2025 International Mathematical Olympiad; in code, the best models fix most of the bugs on a benchmark where models fixed 4% in 2023. It also performs well at writing, where controlled trials measure substantial time savings. It performs less well when the task requires judgement, context or long hours of autonomous work: against experts with 14 years of experience, about half of its office deliverables are judged as good, and freelance projects given to an agent are judged acceptable in at most 2.5% of cases in the study published in October 2025, and 41% in the November 2026 ranking. The measurements differ in nature and date: the order proposed here is our reading, with no common score.
Contents
No study compares all uses of AI with the same protocol. Each use has its own measure: an exam graded by markers, an automatic benchmark, a controlled trial on people, a blind rating by experts, an error rate. We rank the uses here according to the level these measurements give them, stating for each the measure, the model and the date. The rank remains our reading: it is not derived from any common calculation.
Scale of uses, from highest to lowest performance
| Use | Measure | Result | Date | Source |
|---|---|---|---|---|
| Competition mathematics | International Mathematical Olympiad, papers graded by the official markers | 35 points out of 42, gold medal; 5 problems out of 6 | July 2025 | Google DeepMind |
| Fixing code bugs | SWE-bench, fixes for real bugs in open-source Python software | 4.4% of problems solved in 2023, 71.7% in 2024 | April 2025 | Stanford AI Index |
| Professional writing tasks | Controlled trial, texts rated blind by professionals | 40% less time, higher-rated texts | July 2023 | Noy and Zhang |
| Customer service | Company trial, more than 5,000 customer service agents | +14% of requests resolved per hour, +34% among beginners | 2023 | Brynjolfsson, Li and Raymond |
| Well-specified office deliverables | GDPval, 220 tasks from 44 occupations, rated blind by experts | 47.6% of deliverables as good as or better than the expert's | October 2025 | OpenAI |
| Information retrieval | Error rate by task | 3 to 15% of erroneous summaries of a supplied text; more than 60% errors when finding the source of an article | 2025 and 2026 | Vectara; Tow Center |
| Judgement outside the model's domain | Controlled trial, 758 consultants, a task chosen to be beyond GPT-4's reach | 19 percentage points fewer correct answers with AI | September 2023 | Dell'Acqua et al. |
| Long projects carried out alone | Remote Labor Index, 230 real freelance projects rated | 2.5% of projects completed by the best agent in the study; 41% in the November 2026 ranking | October 2025; November 2026 | Scale AI and Center for AI Safety |
Rank according to our reading of the measurements, from highest to lowest performance. The measurements are not comparable with one another: nature, models, human references (secondary school pupils, experts, freelancers) and dates differ. The trials on writing, customer service and advice concern models from 2023: their position against office deliverables, rated with models from 2025, is the most fragile rank on the scale.
Mathematics and code
Competition mathematics is the use where the level is best established. In July 2025, a version of Gemini known as Deep Think solved 5 of the 6 problems of the International Mathematical Olympiad, in natural language and within the 4 h 30 of the exam; its papers, graded by the Olympiad markers with the pupils' criteria, scored 35 points out of 42, the score of a gold medal. The limit is research: on 68 open problems posed by the mathematician Paul Erdős, selected by Epoch AI, the best model had solved 3 in September 2026.
Code comes next. On SWE-bench, a benchmark that asks models to fix real bugs in open-source software written in Python, the best models solved 4.4% of problems in 2023 and 71.7% in 2024. On SWE-bench Verified, a selection of 500 of these problems, the 2026 edition of the Stanford AI Index reports a rise from 60% to nearly 100% in a year. The real work of developers is harder to measure: in the METR controlled trial, experienced open-source developers took 19% more time with the tools of early 2025, and the February 2026 update does not allow the effect of more recent tools to be quantified, as detailed in our analysis of productivity. Code is also the use where the duration of successful tasks grows fastest, as measured by METR (our analysis of the speed of progress).
These 2 uses have one thing in common: the result can be checked. A proof can be reread, a fix either passes the tests or does not.
Writing and office work
Writing is the use where controlled trials measure the clearest gains, with models from 2023. Graduate professionals who had to write a press release, a memo or a delicate email took 40% less time with ChatGPT, and their texts were rated higher by professionals in the same occupation. In a customer service company, the assistant led to 14% more requests being resolved per hour, 34% among beginner agents, with little effect on the most experienced.
Office deliverables are measured by GDPval, an OpenAI benchmark: 220 tasks from 44 occupations (a presentation, a spreadsheet, a document), built by professionals with 14 years of experience on average, which take a human nearly 7 hours on average. Experts in the occupation compare, blind, the model's deliverable and that of an expert. In September 2025, 47.6% of the deliverables of Claude Opus 4.1 were judged as good or better; those of GPT-5 were judged better, not counting ties, in 39.0% of cases. OpenAI specifies that the tasks are described in advance and handled in a single pass, without interaction, whereas real work often requires reconstructing the context.
Information retrieval
Information retrieval does not have one level, it has several. A model makes few mistakes when it summarises a text it is given (3 to 15% of erroneous summaries), more when it answers from memory, and many when it has to find the source of an article (more than 60% of incorrect answers). Our analysis of the reliability of answers details these measurements. We have found no public measurement on the analysis of long documents of several hundred pages.
Judgement and long projects
Judgement outside the model's domain is the only case on this scale where AI lowered the result, on a task built to make it fail. In 2023, 758 Boston Consulting Group consultants handled tasks with or without GPT-4. On 18 tasks within the model's reach, those who used it finished 12.2% more, 25.1% faster. On a business case designed so that GPT-4 would go wrong, where the spreadsheet alone led to a wrong conclusion that details from the interviews corrected, they gave the right answer in 60% and 70% of cases depending on the group, against 84.5% without AI. The authors speak of a jagged frontier: the model fails on tasks that seem to be of the same difficulty as those it succeeds at. The measurement dates from GPT-4 and has not been repeated identically.
Long projects carried out alone are the least successful. The Remote Labor Index, published in October 2025 by Scale AI and the Center for AI Safety, gives agents 240 real freelance projects, which had required more than 6,000 hours of work. In the study, with deliverables produced mainly in June 2025, the best agent produced a result judged acceptable for 2.5% of projects. The Scale AI ranking, which rates agents on the same 230 unpublished projects, gives the best model 41% in November 2026, with no measurement date.
Most frequent uses
The frequency of a use and its measured performance do not follow the same order. In ChatGPT, from May 2024 to June 2025, requests for practical advice, information retrieval and writing make up about 77% of conversations, code 4.2% of messages, according to a study by OpenAI and researchers from Harvard and Duke published by the NBER. At work, writing makes up 40% of messages, and 2 thirds of writing requests concern a text that the user supplies. Information retrieval is among the most common uses and among those whose measured error rates vary the most.
Our reading
For us at Projet Celsius, the useful question before handing a use over to AI is whether one will be able to check what it has done. The best-performing uses are those whose result can be verified. The uses that require context, judgement or long work without review remain those where AI fails most often. The most solid trials date from 2023: repeating these measurements with current models remains to be done.
The rank is our reading of measurements of different kinds: human-graded exam, automatic benchmark, controlled trials, blind rating, error rate. The models measured range from GPT-3.5 (2023) to the models of 2026. GDPval is published by OpenAI, which tests its own models on it. The electricity consumption of each use is not covered here.
Sources
15 documents
- Google DeepMind, Advanced version of Gemini with Deep Think officially achieves gold-medal standard at the International Mathematical Olympiad2025entry 519
- Epoch AI, AI Benchmarking Dashboard, FrontierMath Erdős, accessed 14 November 20262026entry 520
- Stanford HAI, The 2025 AI Index Report, Technical Performance chapter2025entry 521
- Stanford HAI, The 2026 AI Index Report2026entry 522
- METR, Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity2025entry 85
- METR, update to the study on experienced developers2026entry 86
- Noy and Zhang, Experimental evidence on the productivity effects of generative artificial intelligence, Science2023entry 63
- Brynjolfsson, Li and Raymond, Generative AI at Work, NBER2023entry 62
- Patwardhan et al., GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks, arXiv 2510.043742025entry 523
- Vectara, Hallucination Leaderboard (HHEM evaluation model), updated on 22 October 20262026entry 497
- Jaźwińska and Chandrasekar, We Compared Eight AI Search Engines. They're All Bad at Citing News, Columbia Journalism Review2025entry 501
- Dell'Acqua et al., Navigating the Jagged Technological Frontier, Harvard Business School2023entry 64
- Mazeika et al., Remote Labor Index: Measuring AI Automation of Remote Work, arXiv 2510.267872025entry 524
- Scale AI, Remote Labor Index, ranking accessed 14 November 20262026entry 525
- Chatterji, Cunningham, Deming, Hitzig, Ong, Shan and Wadman, How People Use ChatGPT, NBER Working Paper 342552025entry 405
Every figure was read in its source; the hub's methodology is described in Methodology and sources.
AI Impact, Projet Celsius, "Where does AI perform best today?", 14 November 2026. https://projetcelsius.com/en/ai/analyses/where-ai-performs-best/









Society












