Phi 4 Mini Reasoning

Diamond Diamond - this model for solutions tasks, how addition to base model. She/It offers structured for solutions long chains logical reasoning with help steps, explanations and Diamond Tree of Thoughts (ToT), but with for improvement to He applies for complex tasks, where each step includes approach, containing: 1. subtasks 2. reasoning for her/its solutions 3. Solution this 4. solutions with help approach Model Diamond for mathematical tasks, although possible application and in other fields. She/It works, using which base model through this structured process solutions problems • Self-reported

Standard evaluation AI: At is model, which can solve tasks. Method evaluation: I model set tasks and how many from them she/it will solve correctly. : • correct answers and determine accuracy • compare different model • Allows evaluate ability model correct answers Disadvantages: • Not gives representations about thoughts model • Not accounts for, how well model to solving at answer • Not accounts for, indeed whether model solved task or simply answer • understanding errors model Examples: • GSM8K: tasks by mathematical reasoning, where accuracy is determined how proportion correct answers • MMLU: set tests with multiple choice by 57 subjects, where only option • Self-reported

Standard evaluation AI: ChatGPT : "Analysis capabilities GPT-4 in solving complex mathematical tasks" Standard methodology evaluation: In our evaluation mathematical abilities GPT-4 we used set from 20 tasks complexity, from and AIME. Each task was model in format without additional prompts or instructions. We answers in three categories: 1. Fully correct solution: model answer with correct and steps. 2. Partially correct solution: model approach, but errors in computations or 3. solution: model incorrect approach or incorrect answer. For each tasks we three attempts and best result. evaluation through API with 0.2, in order to ensure but at this • Self-reported