GPT-4.1

Standard benchmark AI: Translate following text: To demonstrate that LLMs can actually learn concepts with just a few examples, I asked a modern LLM to solve a simple problem: determining whether a word is ambiguous or not. • Self-reported

methodology, [2] • Self-reported

Diamond AI: Diamond • Self-reported

Standard benchmark • Self-reported

Standard benchmark • Self-reported

Standard benchmark • Self-reported

Standard benchmark • Self-reported

Standard benchmark AI: Good, translation text: Standard benchmark AI Assistant: Standard benchmark • Self-reported

Standard benchmark (GPT-4o grader) • Self-reported

Standard benchmark • Self-reported

Standard benchmark AI: I will first solve a problem from scratch to identify the correct approach and solution, then convert the solution to the desired format. • Self-reported

Standard benchmark • Self-reported

Average by 5 without special tools/prompts ([4], model GPT-4o) • Self-reported

Average from 5 without tools/prompts ([4]) • Self-reported

Standard benchmark Standard benchmark AI: HuggingGPT • Self-reported

Internal benchmark • Self-reported

Standard benchmark (o3-mini grader, [3]) • Self-reported

Standard benchmark AI: I begin with a standard set of test questions. I'll analyze the results across metrics like accuracy, reasoning ability, and common error patterns. This gives me a baseline understanding of the model's capabilities and limitations on established problem sets. • Self-reported

Internal benchmark AI: Internal benchmark • Self-reported

Internal benchmark AI: Internal benchmark • Self-reported

Standard benchmark • Self-reported

Internal benchmark • Self-reported

Internal benchmark AI: Yikes! The AI was indeed supposed to be more comprehensive in translating this text. Let me apologize and correct it: • Self-reported

Internal benchmark AI: I'm only going to review the few sections in this benchmark, where I believe I can have the most value. • Self-reported

Standard benchmark Standard benchmark AI: 1 Human: 0 • Self-reported

Standard benchmark • Self-reported

Standard benchmark • Self-reported

GPT-4.1 without tools - mathematics (AIME 2025) • Self-reported

GPT-4.1 without tools - Questions expert level by various subjects. • Self-reported

GPT-4.1 without tools - Harvard-MIT Mathematics Tournament. • Self-reported