- The Neural Frontier
- Posts
- Is ChatGPT Getting Dumber?
Is ChatGPT Getting Dumber?
Also: Apple throws its hat into the AI ring, and Shopify announces its AI assistant, Sidekick.
Heyyy š!
Itās been a minute, and thereās so much to catch you up on. As youāll expect, weāve been on the frontlines, staying up to date with the topsy-turvy happenings of the AI world.
From Standford-backed studies claiming that ChatGPT is declining in intelligence and Apple finally throwing its hat into the AI ring to Shopifyās new AI-powered Sidekick, we canāt wait to share these updates with you!
Whatās more?
Thereās even an AI-generated #Barbenheimer trailer for you to sink your teeth into. So, what are you waiting for? Hop in!
In this issue, weāve got:
š¤Æ Is ChatGPT getting dumber?
š¤ Apple throws its hat into the AI ring
š¦ø Shopify announces its AI assistant, Sidekick.
š Barbie vs. Oppenheimer: A #Barbenheimer event
ā” The Neural Frontierās weekly picks: 3 AI tools you should be using.
OpenAIās logo on a mint green background
If youāve been keeping up to date with Twitter or Reddit in the last couple of months, youāll have observed one particular repeated question in AI-centric discussions: Is ChatGPT getting dumber š©?
Since its release, the OpenAI-backed tool has had its fair share of praises. In the same vein, thereās also been a lot of complaints as regards accuracy, consistency, and even instances of AI hallucination. And while the above has been often regarded as just random user opinions and isolated events, a report from Standford researchers begs to differ.
Hereās the summary of the report:
āWe find that the performance and behavior of both GPT-3.5 and GPT-4 can vary greatly over time. For example, GPT-4 (March 2023) was very good at identifying prime numbers (accuracy 97.6%), but GPT-4 (June 2023) was very poor on these same questions (accuracy 2.4%). Interestingly, GPT-3.5 (June 2023) was much better than GPT-3.5 (March 2023) in this task. GPT-4 was less willing to answer sensitive questions in June than in March, and both GPT-4 and GPT-3.5 had more formatting mistakes in code generation in June than in March.ā
In response to this, Peter Welinder, OpenAIās VP for Product, tweeted this:
āNo, we haven't made GPT-4 dumber. Quite the opposite: we make each new version smarter than the previous one. Current hypothesis: When you use it more heavily, you start noticing issues you didn't see before.ā
He also prompted users to send specific examples of ChatGPTās regression for further investigation.
In any case, weād love to hear from you! How has your personal experience been?
Is ChatGPT getting dumber? |
A white robot looking at a blue laptop
Even if youāve been living under a rock, you should know that a lot of tech giants have been hopping on the AI train over the last couple of months. And with this ever-growing list, you never know the next tech juggernaut that would come aboard.
In this case, it appears that the talented folks at Apple have been cooking up AI-powered tools to rival OpenAIās endeavors. In this undisclosed list of tools, the tech giant is also working on an AI chatbot. Termed āApple GPT,ā this tool is reportedly powered by Appleās custom framework, āAjax,ā which runs on Google Cloud.
Whatās more?
This framework wonāt support the development of Appleās chatbot alone. According to Bloomberg, it will also be leveraged in the creation of a ChatGPT-esque AI model. And while other details remain under wraps, one thingās for sure: Appleās AI model will be an interesting sight š, to say the least.
Black phone on a table with Shopify email notification open.
In a recent tweet by Shopify CEO Tobi Lutke, the eCommerce giant announced that it has joined the pretty long list of companies leveraging AI in their product and service offerings.
Called āSidekick š¦ø,ā this AI assistant promises to revolutionize how users interact with Shopify. Plus, it flattens the learning curve associated with using Shopify by offering quick answers to user queries, automating tasks, keeping track of your todos, and offering analytics and insights relating to your business endeavors.
For example, you can apply discounts to all products in your store with a simple prompt. Whatās more, you can adjust your theme and sort otherwise stressful tasks in a matter of seconds.
While the release date for Sidekick remains unknown, this is one AI tool that has many on the edge of their seats šŗ.
As we bask in arguably one of the most-hyped premiers in history, a proficient AI-centric cinematographer decided to share a pretty creative and lighthearted re-imagination of #Barbenheimer š š„.
Itās even more impressive when you understand the amount of effort and purposeful prompting it took to put the whole thing together. Now, enough talk. Dig in!
ā” The Neural Frontierās weekly picks: 3 AI tools you should be using.
White robot arm
Yep, itās that time of the week again. Weāve spread our wings and searched far and wide for nifty AI-powered tools to bolster your productivity and spice up your workflow. You already know how this goes. Hop in š!
š”Mini Course Generator: Offering itself as a nifty alternative to clunky traditional course builders, this tool leverages the transformative power of AI to revolutionize the course creation process. From text generation and image generation to first-class personalization, this tool is definitely worth a try.
š¦øSendsteps: With a focus on transforming how you create presentations, Sendsteps helps you create presentations from start to finishāwith just a simple prompt. Yep, it does all the writing, designing, and storytelling. Plus, you can easily refine the output to your taste.
š§ProductAI: ProductAI promises one thing and one thing only: to give you quality product photos without the need for a physicalāand cost-intensiveāphotoshoot.
Phew š ! That one was a tad longer than usual. But, it was pretty fun to put together. To this end, we genuinely hope you had as much fun reading this as we did creating it.
Even more important, we hope that youāve gained some curve-flattening knowledge about the world of AI technology š.
And as we always say, spread the love, and share this newsletter with a friend!
Ciao āØ!