Question 1

What is AGIThrone?

Accepted Answer

AGIThrone is a multimodal intelligence benchmark from Cognitive Technologies that evaluates large language models and reasoning models across text, audio, and video, with parameterized questions, tool use, and agentic workflows.

Question 2

How is AGIThrone different from static QA benchmarks?

Accepted Answer

Questions are parameterized so names, numbers, places, and entities swap across instances. Models must reason from structure rather than memorize leaked answers, improving generalization and contamination resistance.

Question 3

Which languages and regions does AGIThrone cover?

Accepted Answer

AGIThrone is bilingual (English and Arabic) with a shared general core plus regional flavor suites for the UAE and Saudi Arabia.

Question 4

How do I evaluate a model on AGIThrone?

Accepted Answer

Purchase a paid MCP evaluation run or request access. Question banks remain private and are served through MCP; Cognitive Technologies publishes evaluation results and research artifacts.