Microsoft enhances support for OpenAI GPT-4-5 and GPT-5 models
Microsoft reportedly plans to host OpenAI's latest model as early as next week.
JinseFinanceLog in/ Sign up
Google's new Gemini AI model beats GPT-4o in benchmark test
Follow
Author: Tristan Greene, CoinTelegraph; Compiler: Tao Zhu, Golden Finance
There’s a new king in the field of generative AI benchmarks, and its name is Gemini 1.5 Pro.
The previous champion, OpenAI’s ChatGPT-4o, was finally surpassed on August 1, when Google quietly released an experimental version of its latest model.
Gemini’s latest update was released without fanfare and is currently marked as experimental. But it quickly caught the attention of the AI community on social media, as reports emerged that it surpassed its competitors in benchmark scores.
AI Benchmarks
OpenAI’s ChatGPT has been the benchmark for generative AI since the release of GPT-3. Over the past year or so, its latest model, GPT-4o, and its closest competitor, Anthropic’s Claude-3, have been so far ahead of most other models on most common benchmarks that they have barely met any competition.
Source: Large Model Systems Organization.
One of the most popular benchmarks is LMSYS Chatbot Arena. It tests models on a variety of tasks and assigns an overall capability score. GPT-4o scored 1,286, while Claude-3 scored a respectable 1,271.
The previous version of Gemini 1.5 Pro scored 1,261. But the experimental version (Gemini 1.5 Pro 0801), released on August 1, scored a whopping 1,300.
This suggests it’s stronger than the competition overall, but benchmarks aren’t necessarily an accurate reflection of what an AI model can and can’t do.
Community Excitement
In the absence of deeper comparisons, we’re entering an era where the AI chatbot market has matured enough to offer a wide range of options. It’s ultimately up to the user to decide which AI model is best for them.
The latest version of Gemini is rumored to have caused a wave of excitement, with users on social media calling it “excellent.” One Redditor even wrote that it “totally outperforms 4o.”
It is unclear whether the experimental version of Gemini 1.5 Pro will become the default in the future. While it is still generally available as of the time of this posting, the fact that it is in an early release or testing phase suggests that the model could be rescinded or changed for security or coordination reasons.
Gain a broader understanding of the crypto industry through informative reports, and engage in in-depth discussions with other like-minded authors and readers. You are welcome to join us in our growing Coinlive community:https://t.me/CoinliveSG
Add Comment
LoginLeave your comments
0 Comments
Earliest
Load more comments
More news about gpt-4o benchmarks
- OpenAI Reveals New Small AI Model GPT-4o MiniBullishBearish
- Intro to GPT-4oBullishBearish
- OpenAI、生成AIの革新的ニューモデル「GPT-4o」公開BullishBearish
- شركة OpenAI تطلق نموذج الذكاء الاصطناعي الجديد GPT-4oBullishBearish
More news about gpt-4o benchmarks
- JinseFinance
Google's Gemini 1.5 Pro Tops AI Benchmarks, Surpasses ChatGPT-4o
Google's Gemini 1.5 Pro has emerged as a new leader in AI benchmarks, surpassing established models like ChatGPT-4o. The model's performance has sparked excitement within the AI community, though its future availability remains uncertain.
DanteOpenAI launches GPT-4o Mini, outperforming GPT-3.5 Turbo
OpenAI stated that the launch of GPT-4o mini marks significant progress in reducing costs and enhancing model capabilities, and is committed to making AI more popular and reliable.
WenJunOpenAI’s Newly Launched GPT-4o mini is More Accessible and Affordable: Is It Trying to Mimic iPhone’s Numerous Versions?
OpenAI launched "GPT-4o mini" on 18 July, claiming it’s cheaper and more efficient than GPT-3.5 Turbo. Is OpenAI mimicking Apple's frequent releases, and will this impact the quality of their generative AI models?
KikyoWhy Two OpenAI Leaders Resign After GPT-4o’s Glorious Launch?
Recent resignations at OpenAI, including Chief Scientist Ilya Sutskever and Jan Leike from the "superalignment team," follow disagreements over prioritising safety amid the launch of GPT-4o. Concerns linger over OpenAI's shift towards profit and potential security risks in collaborations like Apple's iOS 18 update integrating OpenAI technology.
WeatherlyGoogle strikes back: Project Astra vs. GPT-4o, Veo vs. Sora
Artificial Intelligence, Google, Gemini, Google strikes back: Project Astra confronts GPT-4o Veo versus Sora Golden Finance, this is Google's response to OpenAI.
JinseFinanceOpenAI subverts the world: GPT-4o is free, real-time voice and video shocked the audience
Only 17 months after ChatGPT came out, OpenAI has come up with a super AI like that in science fiction movies, and it is completely free and available to everyone.
JinseFinanceOpenAI launches the latest artificial intelligence model GPT-4o: free for all users
OpenAI announced its latest artificial intelligence large language model on Monday, which it says will make ChatGPT smarter and easier to use.
JinseFinanceOpenAI Introduces GPT-4 Turbo and Pioneering GPT Store
The latest release transforms AI interactions by expanding the knowledge base to April 2023 and introducing support for 300-page documents.
JixuOpenAI 首届开发者大会：GPT-4 Turbo、GPT 商店
JinseFinance