The Product Experience: a Mind the Product podcast

Blaine Billingsley is a Member of Technical Design Staff at OpenAI whose path into the field ran through music composition, spare-change website work at college, and a decade across Gmail, Airbnb, YouTube and Slack. At OpenAI he was hired to work on Presence, then redirected to solve a more immediate problem: making ChatGPT genuinely useful as a daily tool for designers. Working with a single engineer, he built the ChatGPT product design plugin — a bridge between the raw power of Codex and the day-to-day workflow of product teams. In this conversation with Randy Silver, he talks about what design actually means when your interface is a text box, why volume beats perfection in an age of infinite iteration, and why the fundamentals of good product thinking are more durable than the tools used to apply them.

Key takeaways

— The designer's job at an AI company has shifted from pixels to outputs. Deciding what "good" looks like, building the criteria to evaluate it, and heuristically assessing results is now a core part of the role — one that didn't exist in the same form at Gmail or Slack.
— LLMs don't replace structured creativity techniques; they scale them. The crazy eights exercise squeezes eight ideas from a room of people in eight minutes. A well-directed ChatGPT session can return 80 in the same window, alone, while you're at lunch.
— Volume beats perfection. The best way to make a pot isn't to try to make the best pot — it's to make a thousand pots. That logic now applies directly to prototyping: generate at scale, stay unattached, and find the nugget in the noise.
— Evals are closer to synthetic user research than quality assurance. The hardest part isn't building the rubric — it's correctly anticipating what people will actually try to do. Show it to one more person and your assumptions will immediately break.
— The second 80% problem hasn't gone away. Getting to a working prototype is dramatically faster; getting that prototype to production is still gruelling — and becomes harder still when platform direction shifts mid-sprint.
— Small teams with AI assistance need to protect the rituals that keep them aligned. When two people can each produce a week's worth of work in an afternoon, parallel drift becomes the real collaboration risk.
— Role boundaries are dissolving, but specialisations still matter. The question is less "what is your title" and more "what does the band need right now, and can you play that part?"
— Experience brings judgment; freshness brings juice. The best work often comes from junior designers unconstrained by years of accumulated assumptions — and both things need to be in the room.

Chapters 
(00:00) Introduction
(01:14) Blaine's background: from music composition to product design 
(02:32) What design means at OpenAI 
(04:21) The ChatGPT product design plugin 
(06:12) Deciding what to build: the early exploration 
(10:05) Structured creativity and LLM-powered ideation 
(13:37) Volume over perfection: the thousand pots approach 
(16:13) Designing as a two-person team 
(20:29) What is the job now? 
(23:33) Evals as synthetic user research 
(27:08) Testing at scale when you can't know your users 
(30:15) How they actually did the research 
(33:01) The second 80%: from prototype to production 
(35:06) Staying aligned without roadmaps 
(38:19) Demo: the product design plugin 
(44:52) When a prototype isn't ready to ship 
(48:26) Design sprints, reimagined 
(49:27) Advice for joining an AI-first product team 
(52:17) The jazz analogy: experience, freshness and your role in the band 

Featured Links
ChatGPT for Work: https://openai.com/chatgpt 
Codex: https://openai.com/codex 
Figma: https://figma.com 
FigJam: https://www.figma.com/figjam 
Linear: https://linear.app
Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.

Dr Cat Hicks is a psychological scientist and the founder of Catharsis, a human-centred research consultancy that works with engineering organisations. After self-funding her first open-access study into developer motivation, she was recruited to lead the Developer Success Lab at Pluralsight — a three-year programme that generated large-scale empirical research across hundreds of companies and more than 11,000 developers. Her book, The Psychology of Software Teams, published in July 2026, brings that evidence to bear on the question her industry keeps asking: why do smart people in smart organisations so often struggle to work well together? We talk about the hidden costs of treating developers as interchangeable units, what large-scale cycle time data reveals about individual performance, and how product managers can build the conditions for teams to actually thrive.

Key takeaways
The "brains and jars" model — treating developers as interchangeable, isolated computing units — does not just feel demeaning; it actively undermines the collaborative, social work that makes software teams effective, and is linked to burnout, self-censorship, and a breakdown of trust.
Cycle time data from 216 companies and over 11,000 developers shows that individual performance fluctuates dramatically week to week — it is not a stable personal trait — which means slow periods are usually an environmental problem, not a personal one.
Over-production pressure (the constant pull towards short-term delivery) has measurable cascading effects: developers stop mentoring, stop surfacing problems to managers, and stop investing in long-term code quality. It can be measured and, with committed leadership, changed within weeks.
AI is producing genuine identity threats, not just productivity disruption. Teams that lower the "threat temperature" — framing change as a shared technical challenge and affirming that new skills can always be learnt — unlock significantly more adaptive and curious behaviour.
Metacognitive scaffolding — building structured strategies for thinking about your own thinking, not just raw output — is more trainable than cognitive capacity and is almost entirely absent from how agentic coding environments are currently designed.
Superordinate goals (shared outcomes that transcend individual preferences) allow diverse teams, including those who prefer deep solo work, to collaborate productively without demanding that everyone care about the product in the same way.

Chapters
(00:00) Opening 
(01:06) Cat's background and the book 
(04:40) Defining a software team 
(07:02) Building the Developer Success Lab 
(10:26) The brains and jars model 
(13:14) What the model costs teams 
(17:54) Why communicating value is so hard 
(19:04) What change looks like in practice 
(23:01) Code review anxiety and cycle time research 
(27:55) AI's effect on developer identity 
(31:57) Agentic coding and cognitive fatigue 
(35:46) Threat, play, and psychological safety 
(38:19) Working across disciplines 
(43:04) What product managers can do 
(48:00) Wrap-up

Referenced
The Psychology of Software Teams by Dr Cat Hicks
The Programmer's Brain by Felienne Hermans
The Psychology of Computer Programming by Gerald Weinberg
Developer Success Lab (Pluralsight)
DORA project
Catharsis — Dr Cat Hicks's consultancy
Fight for the Human — Dr Cat Hicks's newsletter
Dr Cat Hicks
Learning Opportunities Claude skill — by Dr Cat Hicks
Deliberate practice and chess improvement study (44,000 Chess.com players)
Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.

Faith Forster has spent 15 years in product leadership. She was VP of product at Dex, acquired for approximately $600 million, and went on to serve as CPO at Legal, a payments and compliance platform. She now runs discovery.com, an AI-native platform that helps product leaders and teams make faster, better product decisions by connecting to their tools and synthesising competitor, customer and growth intelligence. She is also the driving force behind the Makers Manifesto — a cross-disciplinary set of values and principles for building great products in the age of AI, developed with 45 contributors from across product, engineering, design, and business leadership.
We discuss:
The manifesto emerged from 96 conversations with product leaders whose grasp of AI ranged from fully automated pipelines to treating it as a faster way to write PRDs — a gap that revealed an industry in urgent need of a shared reference point.
Four values anchor the manifesto: purpose over possibility, value created over effort spent, learning loops over launch plans, and human accountability over full automation.
"Maker" was chosen over "builder" to signal that designers, engineers, salespeople, customer support staff, and founders all share equal ownership of the creation process — regardless of job title.
Feature parity is no longer a defensible moat: when any competitor can replicate a capability within days, durable advantage must come from data, relationships, distribution, and business model.
Product market fit can no longer be treated as a static milestone — in a market where products, competitors, and customer expectations shift simultaneously, fit must become a continuous, living part of decision-making.
"Done" now means adopted, not shipped. AI removes every excuse for clunky, one-size-fits-all experiences, and teams that still equate production deployment with completion are measuring the wrong thing.
Making context explicit — codifying strategy in a form that agents and humans can both act on daily — is the principle teams consistently identify as their most urgent, immediate priority.

Chapters
00:00 Introduction 
01:12 Faith's background 
02:28 Origins of the Makers Manifesto 
06:18 Makers Manifesto vs the Agile Manifesto 
07:23 Why "maker" not "builder" 
11:42 Four values and 16 principles 
15:01 Purpose over possibility 
19:10 Learning loops over launch plans 
22:36 Who gets to be a maker 
28:55 Durable advantage in the AI era 
33:22 Staying close to customers 
36:04 What's next for the manifesto 
43:59 Wrap-up

Referenced
Makers Manifesto — https://makersmanifesto.org
discovery.com — Faith's AI-native product decision platform
Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.

Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.

Our Hosts
Lily Smith enjoys working as a consultant product manager with early-stage and growing startups and as a mentor to other product managers. She’s currently Chief Product Officer at BBC Maestro, and has spent 13 years in the tech industry working with startups in the SaaS and mobile space. She’s worked on a diverse range of products – leading the product teams through discovery, prototyping, testing and delivery. Lily also founded ProductTank Bristol and runs ProductCamp in Bristol and Bath.
Randy Silver is a Leadership & Product Coach and Consultant. He gets teams unstuck, helping you to supercharge your results. Randy's held interim CPO and Leadership roles at scale-ups and SMEs, advised start-ups, and been Head of Product at HSBC and Sainsbury’s. He participated in Silicon Valley Product Group’s Coaching the Coaches forum, and speaks frequently at conferences and events. You can join one of communities he runs for CPOs (CPO Circles), Product Managers (Product In the {A}ether) and Product Coaches. He’s the author of What Do We Do Now? A Product Manager’s Guide to Strategy in the Time of COVID-19. A recovering music journalist and editor, Randy also launched Amazon’s music stores in the US & UK.