Need smarter insights in your inbox? Join our weekly newsletters to get solely what issues to enterprise AI, knowledge, and safety leaders. Subscribe Now
The launch of OpenAI’s lengthy anticipated new mannequin, GPT-5, is off to a rocky begin to say the least.
Even forgiving errors in charts and voice demos throughout yesterday’s livestreamed presentation of the brand new mannequin (really 4 separate fashions, and a ‘Considering’ mode that may be engaged for 3 of them), a variety of consumer studies have emerged since GPT-5’s launch displaying it erring badly when fixing comparatively easy issues that previous OpenAI fashions — and rivals from competing AI labs — reply accurately.
For instance, knowledge scientist Colin Fraser posted screenshots displaying GPT-5 getting a math proof incorrect (whether or not 8.888 repeating is the same as 9 — it’s in fact, not).
It additionally failed on a easy algebra arithmetic drawback that elementary schoolers may most likely nail, 5.9 = x + 5.11.
AI Scaling Hits Its Limits
Energy caps, rising token prices, and inference delays are reshaping enterprise AI. Be a part of our unique salon to find how prime groups are:
- Turning vitality right into a strategic benefit
- Architecting environment friendly inference for actual throughput positive aspects
- Unlocking aggressive ROI with sustainable AI methods
Safe your spot to remain forward: https://bit.ly/4mwGngO
Utilizing GPT-5 to guage OpenAI’s personal inaccurate presentation charts additionally didn’t yield useful or appropriate responses.
It additionally failed on this trickier math phrase drawback beneath (which, to be honest, stumped this human at first…although Elon Musk’s Grok 4 AI answered it accurately. For a touch, consider the truth that flagstones on this case can’t be divided into smaller parts. They need to stay in tact as 80 separate items, so no halves or quarters).
The older 4o mannequin carried out higher for me on at the least one in every of these math issues. Sadly, OpenAI is slowly deprecating these older fashions — together with the previous default GPT-4o and the highly effective reasoning mannequin o3 — for customers of ChatGPT, although they’ll proceed to be out there within the utility programming interface (API) for builders for the foreseeable future.
Not pretty much as good at coding as benchmarks point out
Although OpenAI’s inner benchmarks and a few third-party exterior ones have proven GPT-5 to outperform all different fashions at coding, it seems that in actual world utilization, Anthropic’s just lately up to date Claude Opus 4.1 appears to do a greater job at “one-shotting” sure duties, that’s, finishing the consumer’s desired utility or software program construct to their specs. See an instance beneath from developer Justin Solar posted to X :
As well as, a report from safety agency SPLX discovered that OpenAI’s inner security layer left main gaps in areas like enterprise alignment and vulnerability to immediate injection and obfuscated logic assaults.
Whereas anecdotal, the checking the temperature on how the mannequin is faring with early AI adopters appears to point a cold reception.
AI influencer and former Googler Bilawal Sidhu posted a ballot on X asking for a “vibe examine” from his followers and the broader userbase, and thus far, with 172 votes in, the overwhelming response is “Kinda mid.”
And because the pseudonymous AI Leaks and Information account wrote, “The overwhelming consensus on GPT-5 from each X and the Reddit AMA are overwhelmingly unfavorable.”
Tibor Blaho, lead engineer at AIPRM and a well-liked AI leaks and information poster on X, summarized the various issues with the ChatGPT-5 rollout in a wonderful put up, highlighting that one of many new marquee options — an computerized “router” in ChatGPT that chooses a considering or non-thinking mode for the underlying GPT-5 mannequin relying on the problem of the question — has grow to be one of many chief complaints, given the mannequin appeared to default to non-thinking mode for a lot of customers.
Competitors ready within the wings
Thus, the sentiment towards ChatGPT-5 is way from universally constructive, highlighting a serious drawback for OpenAI because it faces growing competitors from main U.S. rivals like Google and Anthropic, and a rising checklist of free, open supply and highly effective Chinese language LLMs providing options that many U.S. fashions lack.
Take the Alibaba Qwen Staff of AI researchers, who simply at present up to date their extremely performant Qwen 3 mannequin to have 1 million token context — giving customers the power to change practically 4x as a lot info with the mannequin in a single again/forth interplay as GPT-5 provides.
Given OpenAI’s different massive launch this week — that of recent open supply gpt-oss fashions — additionally acquired a combined reception from early customers, issues are usually not trying up for the primary devoted AI firm by customers proper now (700 million weekly energetic customers of ChatGPT as of this month).
Certainly, that is additionally exemplified by customers of the betting market Polymarket overwhelmingly deciding following the discharge of GPT-5 that Google would probably have the perfect AI mannequin by the top of this month, August 2025.
Different energy customers like Otherside AI co-founder and CEO Matt Schumer, who acquired early entry to GPT-5 and blogged about it favorably in a evaluation right here, opined that views would shift as extra individuals found out the perfect methods to make use of the brand new mannequin and adjusted their integration approaches:
Whereas it’s nonetheless early days for GPT-5 — and the sentiment may change dramatically as extra customers get their fingers on it and take a look at it for various duties — the early indications are usually not trying like it is a “dwelling run” launch for OpenAI in the identical means that prior releases resembling GPT-4, and even the newer 4o and o3, have been. And that’s a regarding indicator for an organization that simply raised one more funding spherical, but stays unprofitable attributable to its excessive prices of analysis and growth.
