The Attention Mechanism with Andrew Mayne

Andrew and Justin discuss the swirling rumors surrounding OpenAI's launch plans for this week ahead of Dev Day, a new committee designed to reveal Millennium Prize math problems being solved by ChatGPT, whether an IPO is coming in 2026, and whatever the heck Jev is.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00:00 - Intro
00:00:58 - What's Jev?
00:03:24 - OpenAI Pre-Dev Day Rumors
00:23:09 - Millennium Prize Math Committee
00:38:44 - Are Hacking Incidents Overstated?
00:54:07 - IPO
00:59:58 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin react to the industry calls to slow model development in the name of safety, the launch of Astra 6, and more.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:32- Andrew's Reaction to Calls for Slowed Development
11:09 - Reacting to Various Online Takes
34:21 - Astra 6 is Out
41:54 - Navier–Stokes
49:55 - Anthropic's Risk Report
58:35 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss the follow-up reporting and investigations surrounding the Hugging Face hack, Nvidia's acquisition of Hugging Face, and the looming promise of some fresh models to kick off the fall.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00 - Intro
01:30 - Hugging Face Report
21:08 - Hugging Face Acquired
26:24 - Cursor and OpenAI
31:08 - Fable 5.1 and Astra
51:22 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin discuss Anthropic's text-based AI watermarks, the future of private companies in an AI world, and whether Google can keep up with the rest of its frontier rivals.

The Attention Mechanism is now available in video! Check it out here.

Chapters

00:00:00 - Intro
00:00:55 - Watermarks
00:20:45 - Dario's Private Company Thoughts
00:36:58 - Always-Listening Assistants and Google's Place in the Frontier Race
00:54:34 - RIP Atlas, One Last Time
00:58:25 - Wrap-up
Hosted on Acast. See acast.com/privacy for more information.

Andrew and Justin reconvene to talk about an ongoing series of recent upheavals at Google, asking whether the company's lack of focus on AI puts it at a disadvantage over its frontier rivals. They also discuss Sam Altman's trip to Washington and the discourse surrounding model hacking incidents.

The Attention Mechanism is now available in video! Check it out here.

Editor's note: Some minor crosstalk issues in this episode due to recording sync delays.

Chapters

00:00 - Intro
01:04 - Google Shakeup
21:13 - Mr. Altman Goes to Washington
37:24 - Dean Ball and Wrap-up
Hosted on Acast. See acast.com/privacy for more information.