Open AI "Spring Update"
Edition 26: Looks like no Google Wars this week.
Welp, so much for “very trusted sources.”
What’s New?
Mira Murati, Open AI’s CTO, introduced their new flagship product, ChatGPT4o. She and two others demoed some of the new ChatGPT4o features. Capes were demoed on both iOS and MacOS platforms. It is moving toward the integration of true AI with your personal assistant. I wonder what the heck Apple is thinking about this - I hope they can move along from that TV spot mash-down.
The focus of this toned-down “Spring Update” was ChatGPT4.o.
We’re announcing GPT-4o, our new flagship model that can reason across audio, vision, and text in real time.
Details include:
Access to this build is available to both paid and free accounts.
Access to the many GPT’s in the marketplace. What was demoed:
Writing math equations on paper. Using the phone camera to allow Chat to “see” what was written, the user was prompted with requested clues on solving the math equation.
MacOS - code was copied and pasted to Chat allowing her to describe the code’s purpose (computing mean weather temperatures).
Using chat as a translator. In this case, all that was spoken in English was translated to Italian. And vice-versa. Tokens for 20 languages to-date.
The Chat camera can decipher the mood and feelings of the users by view via the phone camera.
Want to learn more. Here are some links. Scroll down to view multiple demonstrations.
No specifics yet on roll-out schedule.
What all of this means
Closer to true A.I. personal assistant that appears to cater to the user versus Siri, whose framework and capabilities the user must learn and operate within. It will certainly make travel more fun. And if the mobile app does indeed have access to the GPT marketplace, this app will kickoff rounds of phone re-designs to be “Optimized for ChatGPT.”
Would be interesting if that part of the equation takes off.
Open AI disclaimer:
GPT-4o has also undergone extensive external red teaming with 70+ external experts in domains such as social psychology, bias and fairness, and misinformation to identify risks that are introduced or amplified by the newly added modalities. We used these learnings to build out our safety interventions in order to improve the safety of interacting with GPT-4o. We will continue to mitigate new risks as they’re discovered.
Meanwhile, the Google Wars appear to be pushed off the calendar for now.
More from us tomorrow. Enjoy your Monday!