Models provider 2
| Model (API Provider) | Model (Original Table) | URL | Arena Score | 95% CI | Votes | Organization | License | Knowledge Cutoff | Average | Multi-choice Qs | Reasoning | Python Coding | Future Capabilities | Grade School Math | Math Problems | Context Window | Input Cost / 1M Tokens | Output Cost / 1M Tokens | Quality | Median Price / 1M Tokens | Output Tokens Per Second | Latency to First Chunk |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-3.5-turbo | GPT-3.5 Turbo | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 16,000 | $0.50 | $1.50 | 53 | $0.75 | 90.7 | 0.38 |
| gpt-3.5-turbo-instruct | GPT-3.5 Turbo Instruct | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 4,000 | $1.50 | $2.00 | - | $1.63 | 113.5 | 0.55 |
| gpt-4 | GPT-4 | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | 79.45% | 86.40% | 95.30% | 67% | 83.10% | 92% | 52.90% | 8,000 | $30.00 | $60.00 | - | $37.50 | 29.1 | 0.59 |
| gpt-4-turbo | GPT-4 Turbo | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 128,000 | $10.00 | $30.00 | 74 | $15.00 | 35.7 | 0.60 |
| gpt-4-32k | GPT-4-32k | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | 32,000 | $60.00 | $120.00 | - | - | - | - |
| gpt-4o | GPT-4o | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | 88.7% | - | 90.2% | - | - | 76.60% | 128,000 | $5.00 | $15.00 | 77 | $7.50 | 96.9 | 0.43 |
| gpt-4o-mini | GPT-4o mini | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | 82% | - | 87.00% | - | - | 70.20% | 128,000 | $0.15 | $0.60 | 71 | $0.26 | 114.1 | 0.42 |
| claude-3-opus | Claude 3 Opus | https://api.ohmygpt.com/ | 1248 | +2/-2 | 158026 | Anthropic | Proprietary | 2023/8 | 84.83% | 86.80% | 95.40% | 84.90% | 86.80% | 95.00% | 60.10% | 200,000 | $15.00 | $75.00 | 70 | $30.00 | 28.0 | 1.77 |
| claude-3-sonnet | Claude 3.5 Sonnet | https://api.ohmygpt.com/ | 1271 | +3/-3 | 51008 | Anthropic | Proprietary | 2024/4 | 88.38% | 88.70% | 89.00% | 92.00% | 93.10% | 96.40% | 71.10% | 200,000 | $3.00 | $15.00 | 77 | $6.00 | 75.6 | 1.36 |
| claude-3-haiku | Claude 3 Haiku | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | 73.08% | 75.20% | 85.90% | 75.90% | 73.70% | 88.90% | 38.90% | 200,000 | $0.25 | $1.25 | 54 | $0.50 | 128.4 | 0.51 |
| TA/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo | Llama 3 Instruct - 8B | https://api.ohmygpt.com/ | - | - | - | Meta | Llama 3.1 Community | - | - | 68.40% | - | 62% | 61% | 79.60% | 30% | 8,000 | - | - | 53 | $0.19 | 167.8 | 0.28 |
| TA/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo | Llama 3 Instruct - 70B | https://api.ohmygpt.com/ | - | - | - | Meta | Llama 3.1 Community | - | 79.23% | 82% | 87% | 81.7% | 81.3% | 93% | 50.40% | 8,000 | - | - | 65 | $0.89 | 55.1 | 0.42 |
| TA/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo | Meta-Llama-3.1-405b-Instruct | https://api.ohmygpt.com/ | 1265 | +4/-5 | 22215 | Meta | Llama 3.1 Community | 2023/12 | - | - | - | - | - | - | - | - | - | - | 72 | $4.50 | 29.5 | 0.68 |
| TA/mistralai/Mistral-7B-Instruct-v0.1 | Mistral 7B | https://api.ohmygpt.com/ | - | - | - | Mistral | Open | - | - | - | - | - | - | - | - | 33,000 | - | - | 24 | $0.18 | 94.8 | 0.29 |
| TA/mistralai/Mixtral-8x7B-Instruct-v0.1 | Mixtral 8x7B | https://api.ohmygpt.com/ | - | - | - | Mistral | Open | - | 59.79% | 70.60% | 84.40% | 40.20% | 60.76% | 74.40% | 28.40% | - | - | - | 42 | $0.50 | 88.4 | 0.32 |
| TA/mistralai/Mixtral-8x22B-Instruct-v0.1 | Mixtral 8x22B | https://api.ohmygpt.com/ | - | - | - | Mistral | Open | - | - | - | - | - | - | - | - | 65,000 | - | - | 61 | $1.20 | 59.1 | 0.35 |
| command-r | Command-R | https://api.ohmygpt.com/ | - | - | - | Cohere | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 36 | $0.75 | 114.3 | 0.42 |
| command-r-plus | Command-R+ | https://api.ohmygpt.com/ | - | - | - | Cohere | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 46 | $6.00 | 65.3 | 0.46 |
| gemini-pro | Gemini Pro | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | 32,000 | $0.125 | $0.375 | - | - | - | - | |
| mistral-large-latest | Mistral Large 2 | https://api.ohmygpt.com/ | - | - | - | Mistral | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 73 | $4.50 | 41.4 | 0.48 |
| open-mistral-nemo | Mistral NeMo | https://api.ohmygpt.com/ | - | - | - | Mistral | Open | - | - | - | - | - | - | - | - | 128,000 | - | - | 52 | $0.30 | 139.7 | 0.35 |
| gpt-3.5-turbo-0301 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-0613 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-16k | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-16k-0613 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-1106 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-0125 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4o-2024-05-13 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4o-2024-08-06 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| chatgpt-4o-latest | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4o-mini-2024-07-18 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-1106-preview | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-0125-preview | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-turbo-preview | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-vision-preview | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-turbo-2024-04-09 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-0314 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-0613 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-32k-0314 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-32k-0613 | - | https://api.ohmygpt.com/ | - | - | - | OpenAI | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-opus-20240229 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-sonnet-20240229 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-5-sonnet | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-5-sonnet-20240620 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-haiku-20240307 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-2 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-2.0 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-2.1 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-instant-1 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-instant-1.2 | - | https://api.ohmygpt.com/ | - | - | - | Anthropic | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen1.5-0.5B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen1.5-1.8B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen1.5-4B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen1.5-7B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/codellama/CodeLlama-7b-Instruct-hf | - | https://api.ohmygpt.com/ | - | - | - | CodeLlama | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/meta-llama/Llama-2-7b-chat-hf | - | https://api.ohmygpt.com/ | - | - | - | Llama 2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/meta-llama/Llama-3-8b-chat-hf | - | https://api.ohmygpt.com/ | - | - | - | Llama 3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/mistralai/Mistral-7B-Instruct-v0.2 | - | https://api.ohmygpt.com/ | - | - | - | Mistral | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/google/gemma-7b-it | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| TA/Qwen/Qwen1.5-14B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/WizardLM/WizardLM-13B-V1.2 | - | https://api.ohmygpt.com/ | - | - | - | WizardLM | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/meta-llama/Llama-2-13b-chat-hf | - | https://api.ohmygpt.com/ | - | - | - | Llama 2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/google/gemma-2-9b-it | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| TA/Qwen/Qwen1.5-32B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/zero-one-ai/Yi-34B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Zero-One AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/deepseek-ai/deepseek-coder-33b-instruct | - | https://api.ohmygpt.com/ | - | - | - | DeepSeek AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/codellama/CodeLlama-34b-Instruct-hf | - | https://api.ohmygpt.com/ | - | - | - | CodeLlama | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/google/gemma-2-27b-it | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| TA/Qwen/Qwen1.5-72B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen2-72B-Instruct | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/deepseek-ai/deepseek-llm-67b-chat | - | https://api.ohmygpt.com/ | - | - | - | DeepSeek AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/codellama/CodeLlama-70b-Instruct-hf | - | https://api.ohmygpt.com/ | - | - | - | CodeLlama | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/meta-llama/Llama-2-70b-chat-hf | - | https://api.ohmygpt.com/ | - | - | - | Llama 2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/meta-llama/Llama-3-70b-chat-hf | - | https://api.ohmygpt.com/ | - | - | - | Llama 3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| TA/Qwen/Qwen1.5-110B-Chat | - | https://api.ohmygpt.com/ | - | - | - | Qwen | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| command-r-online | - | https://api.ohmygpt.com/ | - | - | - | Cohere | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| command-r-plus-online | - | https://api.ohmygpt.com/ | - | - | - | Cohere | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| glm-3-turbo | - | https://api.ohmygpt.com/ | - | - | - | Zhipu AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| glm-4 | - | https://api.ohmygpt.com/ | - | - | - | Zhipu AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| glm-4v | - | https://api.ohmygpt.com/ | - | - | - | Zhipu AI | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| deepseek-chat | - | https://api.ohmygpt.com/ | - | - | - | DeepSeek | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| deepseek-coder | - | https://api.ohmygpt.com/ | - | - | - | DeepSeek | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gemini-1.5-pro-001 | - | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| gemini-1.5-pro-exp-0801 | - | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| gemini-1.5-flash-001 | - | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| palm-2-chat-bison | - | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| palm-2-chat-bison-32k | - | https://api.ohmygpt.com/ | - | - | - | Proprietary | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| google-search-v1 | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| serper-search-v1 | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| chat-completions-with-gs | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-online-with-gs | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-online-with-gs | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-1106-preview-online-with-gs | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| azure-tts-1 | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| nd-imagine-v3 | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| text-moderation-latest | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| text-moderation-stable | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| groq-mixtral-8x7b-32768 | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-3.5-turbo-web-rev | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4-turbo-web-rev | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| gpt-4o-web-rev | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-opus-patch | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-sonnet-patch | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| claude-3-haiku-patch | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |
| midjourney | - | https://api.ohmygpt.com/ | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - |