Two years ago, the Oxide team encountered data corruption during a fairly simple network data transfer. The ensuing debugging sessions uncovered a truly bizarre bug involving CPU speculation! Bryan and Adam were joined by colleagues John and Rain to discuss the discovery and circuitous hunt to track down the bug.In addition to Bryan Cantrill and Adam Leventhal, speakers included John Gallagher, and Rain Paharia.Previous episodes mentioned:OxF s03e09 - Get You a State Machine for Great GoodOxF s03e20 - Shipping the first Oxide rack: Tales from ManufacturingOxF s04e25 - RTO or GTFOOxF s02e38 - A Debugging OdysseySome of the topics we hit on, in the order that we hit them:The Update FrameworkOmicron Issue #3441 (Oxide Computer GitHub)Omicron Pull Request #3455 (Oxide Computer GitHub)stlouis Issue #454 (Oxide Computer GitHub)Changing psrset.out.txt (Oxide Computer)Commit 5ec2885322423c0cca0d006611b5c9ac94b0f588 (Oxide Computer)Omicron Pull Request #3560 (Oxide Computer GitHub)If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
-------- Ā
1:43:36
--------
1:43:36
When Async Attacks!
What happens when the Oxide API is slow? A podcast episode! More specifically, one about how the team employed all manner of debugging techniques to track it down to one obscure and configurable async runtime feature! Bryan and Adam were joined by members of the team to talk about that journey and the tools we used (and made!) along the way.In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Dave Pacheco, Eliza Weisman, and Augustus Mayo.Previous episodes mentioned:Oxide and the Chamber of MysteriesThe Saga of SagasDTrace at 20Cultural IdiosyncrasiesMr. Nagleās Wild RideA Debugging OdysseyRTO or GTFOSome of the topics we hit on, in the order that we hit them:Falling in Love with RustTokio Runtime Builder ā disable_lifo_slotmagicātrace (GitHub)Magic Trace podcast episode from Jane Streetdieselādtrace (GitHub)omicron issue commentqorbstatemaptokioādtracetokio issue #7411Visualizing Systems with StatemapsPostgreSQL WAL INIT ZEROStatemaps: Visualizing System Behavior (YouTube)The statemaps that we referred to:Nexus by thread, discussed starting at 55:29. (This statemap has some states coalesced; the full version is also available.)Nexus by Tokio task, tagged by thread, discussed starting at 1:15:33The D scripts that we referred to:nexus-statemap.d used to generate the initial statemapnexus-profile.d to understand what was consuming CPUtokio-statemap-tagged.d to generate the Tokio task statemapIf we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
-------- Ā
1:53:35
--------
1:53:35
Diving In with Robert Bogart
On the heels of Bryan's blog post about the similarities between aspiring college athletes finding a team and entrepreneurs raising a round of capital, Bryan and Adam were joined by Robert Bogart to discuss his own experiences with both--and the life lesson accrued along the way.In addition to Bryan Cantrill and Adam Leventhal, we were joined by special guest, Robert Bogart.College Baseball, Venture Capital, and the Long MaybeOxF: DebuggerāDriven DevelopmentAnthony Ervin ā WikipediaEddie Reese ā WikipediaMetaweb ā WikipediaIf we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
-------- Ā
1:43:18
--------
1:43:18
Debugger-Driven Development
Building systems software can be quite opaque, leading to the need for great debugging tools. At Oxide, we've found that debuggers can be even more valuable leading rather than following system development. Bryan and Adam talk with Oxide colleagues about how domain specific debugging tools help us build systems not only more robustly, but faster as well.In addition to Bryan Cantrill and Adam Leventhal, we were joined by Oxide colleagues, Dave Pacheco. John Gallagher, Alan Hanson, and Eliza Weisman.Previous episodes mentioned:OxF: AI Discourse with Steve KlabnikOxF: The Saga of SagasOxF: A Crate is BornOxF: The Network Behind the NetworkOxF: Bringing up CosmoOxF: RIP USENIX ATCOxF: Dijkstraās TweetstormSome of the topics we hit on, in the order that we hit them:omdb ground rulesIf we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
-------- Ā
1:34:49
--------
1:34:49
AI Discourse with Steve Klabnik
Last week, our colleague (and frequent Oxide and Friends guest) Steve Klabnik made some new friends on the Internet with a blog entry on AI discourse. Bryan and Adam were joined by Steve to try to de-polarize the discussion a little.In addition to Bryan Cantrill and Adam Leventhal, we were joined by special guest, Steve Klabnik, and valued listener, Julian Giamblanco (aka "Oatmealdealer").Some of the topics we hit on, in the order that we hit them:Steve's blog post: I am disappointed in the AI discourseOxF: A Baseball Startup with Paul Freedman and Bryan Carmel (The Ballers)OxF: Adversarial Machine Learning with Nicholas CarliniOxF: Hiring Processes with Gergely Orosz ("the RFD 3 podcast episode")OxF: AI Disruption: DeepSeek and CerebrasOxF: Reflecting on Founder Mode ("ego con")If we got something wrong or missed something, please file a PR! Our next show will likely be on Monday at 5p Pacific Time on our Discord server; stay tuned to our Mastodon feeds for details, or subscribe to this calendar. We'd love to have you join us, as we always love to hear from new speakers!
Oxide hosts a weekly Discord show where we discuss a wide range of topics: computer history, startups, Oxide hardware bringup, and other topics du jour. These are the recordings in podcast form.
Join us live (usually Mondays at 5pm PT) https://discord.gg/gcQxNHAKCB
Subscribe to our calendar: https://calendar.google.com/calendar/ical/c_318925f4185aa71c4524d0d6127f31058c9e21f29f017d48a0fca6f564969cd0%40group.calendar.google.com/public/basic.ics