The Attention Mechanism with Andrew Mayne

Andrew and Justin discuss the Hugging Face breach, which saw an unreleased OpenAI model find its way into the company's systems during internal testing. They also discuss the launch of Opus 5, the ongoing progress made by Chinese models, and the crunch for compute as 10GW data center plans start to make some motion. Plus, a tribute to the late John C. Dvorak.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:23 - Hugging Face
15:45 - Chinese Models
26:01 - Opus 5
36:11 - 10GW Data Centers
52:29 - RIP John C. Dvorak
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss what's turned out to be a busy July for frontier models, including the launch of Kimi K3, the latest in Anthropic's Fable saga, and the arrival of GPT-5.6. They also dive into Anthropic's strange World Cup ad campaign and OpenAI's relaunched desktop app.

You can watch a video version of this podcast here: https://youtu.be/bTUfneEBn14

Chapters

00:00:00 - Intro
00:01:11 - Kimi and Chinese Models
00:08:26 - Google's Position
00:21:47 - Anthropic's Fable Saga
00:32:31 - Anthropic's World Cup Ad Campaign
00:40:09 - GPT-5.6
00:50:10 - Sites, Speech, and Desktop
00:57:42 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the return of Fable, which arrives with some slight performance changes after a prolonged fight between Anthropic and the US government. What's the future of Anthropic's flagship model, and does it point to the arrival of GPT-5.6 in the coming days? They also discuss GLM-2, Chinese models, and the age of token efficiency, plus a quick look at that Alex Karp interview blowing up your timeline.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:35 - Fable's Return
21:33 - GPT-5.6
30:57 - Chinese Models
46:59 - Alex Karp's CNBC Interview
53:00 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin take a look at the continuing fallout of Anthropic's fight with the government, including the delayed general availability of OpenAI's GPT-5.6. Plus, is China catching up with the US in terms of model performance, agentic apps continue to make their way to mobile devices, and is Apple's recent RAM-related price hike a permanent blemish on the end of Tim Cook's career?

Chapters

00:00:00 - Intro
00:01:02 - Anthropic Fallout Continues
00:14:45 - China's Window?
00:30:22 - Anthropic and OpenAI Timeline Predictions
00:31:53 - GPT-5.6
00:38:22 - 5.6 on Cerberus
00:44:58 - Mobile Agents
00:52:23 - Apple's Price Hikes
01:00:31 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin zoom in on the continued fallout surrounding Anthropic following the government's decision to issue an export-control directive on its Mythos-based models. Now that it's been over a week, what are the next steps for Dario Amodei's company? They also discuss the pending launch of GPT-5.6 and the ongoing AI brain drain currently happening in the offices of Google.

Chapters

00:00:00 - Intro
00:01:42 - Anthropic
00:23:02 - GPT-5.6
00:42:48 - Google Brain Drain
01:03:29 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.