| Model (API Provider) | Model (Combined Table) | URL (lmzh.top) | Arena Score | 95% CI | Votes | Organization | License | Knowledge Cutoff | Average | Multi-choice Qs | Reasoning | Python Coding | Future Capabilities | Grade School Math | Math Problems | Context Window | Input Cost / 1M tokens | Output Cost / 1M tokens | Quality | Median Price / 1M Tokens | Output Tokens Per Second | Latency to First Chunk |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| chatgpt-4o-latest | ChatGPT-4o-latest (2024-08-08) | https://lmzh.top/ | 1317 | +5/-4 | 20599 | OpenAI | Proprietary | 2023/10 | - | 88.7% | - | 90.2% | - | - | 76.60% | 128,000 | $5.00 | $15.00 | 77 | $7.50 | 96.9 | 0.43 |
| gpt-4o-2024-08-06 | GPT-4o-2024-08-06 | https://lmzh.top/ | 1262 | +5/-5 | 13603 | OpenAI | Proprietary | 2023/10 | - | - | - | - | - | - | - | - | - | - | 77 | $4.38 | 103.8 | 0.43 |
| gemini-1.5-pro-exp-0801 | Gemini-1.5-Pro-Exp-0801 | https://lmzh.top/ | 1298 | +5/-4 | 23124 | Proprietary | 2023/11 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| llama-3.1-405b | Meta-Llama-3.1-405b-Instruct | https://lmzh.top/ | 1265 | +4/-5 | 22215 | Meta | Llama 3.1 Community | 2023/12 | - | - | - | - | - | - | - | - | - | - | 72 | $4.50 | 29.5 | 0.68 |
| gpt-4o-mini | GPT-4o-mini-2024-07-18 | https://lmzh.top/ | 1275 | +4/-4 | 21547 | OpenAI | Proprietary | 2023/10 | - | 82% | - | 87.00% | - | - | 70.20% | 128,000 | $0.15 | $0.60 | 71 | $0.26 | 114.1 | 0.42 |
| command-r-plus | Command-R+ | https://lmzh.top/ | - | - | - | Cohere | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 46 | $6.00 | 65.3 | 0.46 |
| claude-3-5-sonnet-20240620 | Claude 3.5 Sonnet (Alt) | https://lmzh.top/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | 200,000 | - | - | 57 | $6.00 | 58.5 | 0.88 |
| gemini-1.5-pro | Gemini 1.5 Pro | https://lmzh.top/ | - | - | - | Proprietary | - | 80.08% | 81.90% | 92.50% | 71.90% | 84% | 91.70% | 58.50% | 128,000 | $7.00 | $21.00 | 72 | $5.25 | 64.5 | 0.95 | |
| gemini-1.5-flash | Gemini 1.5 Flash | https://lmzh.top/ | - | - | - | Proprietary | - | - | 78.90% | - | - | 89.20% | - | 67.70% | 1,000,000 | $0.35 | $0.70 | 60 | $0.13 | 208.4 | 0.79 | |
| gpt-4o-2024-05-13 | GPT-4o-2024-05-13 | https://lmzh.top/ | 1286 | +3/-3 | 80639 | OpenAI | Proprietary | 2023/10 | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4o | - | https://lmzh.top/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-turbo-2024-04-09 | GPT-4-Turbo-2024-04-09 | https://lmzh.top/ | 1257 | +3/-2 | 86593 | OpenAI | Proprietary | 2023/12 | - | 86.5% | - | - | 87.60% | - | 72.2% | - | - | - | 74 | $15.00 | 35.7 | 0.60 |
| claude-2.0 | Claude 2.0 | https://lmzh.top/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | 100,000 | - | - | - | $12.00 | 40.2 | 1.10 |
| claude-2.1 | Claude 2.1 | https://lmzh.top/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | 200,000 | - | - | - | $12.00 | 37.3 | 1.41 |
| claude-3-opus-20240229 | Claude 3 Opus | https://lmzh.top/ | 1248 | +2/-2 | 158026 | Anthropic | Proprietary | 2023/8 | 84.83% | 86.80% | 95.40% | 84.90% | 86.80% | 95.00% | 60.10% | 200,000 | $15.00 | $75.00 | 70 | $30.00 | 28.0 | 1.77 |
| claude-3-sonnet-20240229 | Claude 3.5 Sonnet | https://lmzh.top/ | 1271 | +3/-3 | 51008 | Anthropic | Proprietary | 2024/4 | 88.38% | 88.70% | 89.00% | 92.00% | 93.10% | 96.40% | 71.10% | 200,000 | $3.00 | $15.00 | 77 | $6.00 | 75.6 | 1.36 |
| gpt-3.5-turbo | GPT-3.5 Turbo | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 16,000 | $0.50 | $1.50 | 53 | $0.75 | 90.7 | 0.38 |
| gpt-3.5-turbo-instruct | GPT-3.5 Turbo Instruct | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 4,000 | $1.50 | $2.00 | - | $1.63 | 113.5 | 0.55 |
| gpt-4 | GPT-4 | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | 79.45% | 86.40% | 95.30% | 67% | 83.10% | 92% | 52.90% | 8,000 | $30.00 | $60.00 | - | $37.50 | 29.1 | 0.59 |
| gpt-4-32k | GPT-4-32k | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 32,000 | $60.00 | $120.00 | - | - | - | - |
| llama3-70b | Llama 3.1 70B | https://lmzh.top/ | - | - | - | Meta | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 65 | $0.89 | 55.1 | 0.42 |
| llama3-8b | Llama 3.1 8B | https://lmzh.top/ | - | - | - | Meta | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 53 | $0.19 | 167.8 | 0.28 |
| mixtral-8x7b | Mixtral 8x7B | https://lmzh.top/ | - | - | - | - | - | - | 59.79% | 70.60% | 84.40% | 40.20% | 60.76% | 74.40% | 28.40% | - | - | - | - | - | - | - |
| mixtral-8x22b | Mixtral 8x22B | https://lmzh.top/ | - | - | - | Mistral | Open | - | - | - | - | - | - | - | - | 65,000 | - | - | 61 | $1.20 | 59.1 | 0.35 |
| gemini-pro | Gemini Pro | https://lmzh.top/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | 32,000 | $0.125 | $0.375 | - | - | - | - | |
| google-palm | - | https://lmzh.top/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| gpt-3.5-turbo-0613 | - | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-16k | GPT-3.5 Turbo 16k | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-16k-0613 | - | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-0125-preview | GPT-4-0125-preview | https://lmzh.top/ | 1245 | +3/-3 | 86878 | OpenAI | Proprietary | 2023/12 | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-0613 | - | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-1106-preview | GPT-4-1106-preview | https://lmzh.top/ | 1251 | +3/-2 | 93502 | OpenAI | Proprietary | 2023/4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-32k-0613 | - | https://lmzh.top/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-turbo-preview | - | https://lmzh.top/ | - | - | - | OpenAI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| deepseek-chat | DeepSeek-V2 | https://lmzh.top/ | - | - | - | DeepSeek | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 66 | $0.17 | 18.5 | 1.16 |