Grok-2

accuracy • Self-reported

Pass@1 - this metric for evaluation algorithms, used for measurement efficiency language models (LLM) in solving tasks. Metric represents itself probability correct solutions tasks with first attempts. For Pass@1 model solve set tasks. For each tasks model generates n various solutions. If although would one from n solutions correctly, is considered, that model capable solve task. Pass@1 evaluates probability that, that first solution will correct, using for from set solutions. Pass@1 is metric, since she/it: 1. Allows exactly evaluate ability model solve tasks with first attempts 2. more evaluation performance by comparison with direct one solutions 3. compare different model by their efficiency solutions tasks This metric often is used in research by for evaluation performance LLM in such fields, how programming, mathematical reasoning and solution complex tasks • Self-reported

maj@1 AI: I answers with 1 model. Then I process generation 2 times, total 3 answer. answer is determined by means of choice most often answer (). In case one from answers manner • Self-reported

accuracy • Self-reported

Accuracy • Self-reported

accuracy • Self-reported

accuracy • Self-reported

Accuracy • Self-reported