Mark Russinovich, Eric Boyd & Neha Batra join us to discuss the state of AI for Microsoft and OpenAI at Microsoft Build 2024. It’s safe to say that Microsoft is all-in on AI.
Featuring
Sponsors
Cronitor – Cronitor helps you understand your cron jobs. Capture the status, metrics, and output from every cron job and background process. Name and organize each job, and ensure the right people are alerted when something goes wrong.
1Password – Build securely with 1Password - 1Password simplifies how you securely use, manage, and integrate developer credentials. Manage SSH keys and sign Git commits. Access secrets stored in 1Password. Automate administrative tasks. Integrate with third-party tools. Also, check out our INFRASTRUCTURE.md file for more details on how we do secrets with 1Password.
Neon – The fully managed serverless Postgres with a generous free tier. Neon separates storage and compute to offer autoscaling, branching, and bottomless storage.
Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.
Notes & Links
Chapters
| Chapter Number | Chapter Start Time | Chapter Title | Chapter Duration |
| 1 | 00:00 | This is The Changelog | 01:23 |
| 2 | 01:23 | Sponsor: Cronitor | 01:26 |
| 3 | 02:49 | Start the show! | 02:33 |
| 4 | 05:22 | Hallucinations are concerning | 04:35 |
| 5 | 09:57 | AI Red Team at Microsoft | 01:51 |
| 6 | 11:48 | The Crescendo attack | 02:12 |
| 7 | 14:00 | Masterkey attack | 03:09 |
| 8 | 17:09 | AI Red Team's toolkit | 02:21 |
| 9 | 19:30 | What skills do you need? | 02:21 |
| 10 | 21:51 | The state of AI security | 03:42 |
| 11 | 25:33 | Were you a Mr. Robot fan | 02:20 |
| 12 | 27:54 | Do you write good books? | 00:50 |
| 13 | 28:43 | Hard science favorite authors | 02:18 |
| 14 | 31:02 | We're not at risk losing our jobs to AI | 03:49 |
| 15 | 34:51 | Image generation wtih DALL-E | 03:33 |
| 16 | 38:24 | Generating better code | 06:50 |
| 17 | 45:14 | Copilots' everywhere | 03:28 |
| 18 | 48:42 | Coding with the Copilot pause | 01:37 |
| 19 | 50:19 | Copilot + PC | 02:22 |
| 20 | 52:41 | Install the Copilot app | 02:57 |
| 21 | 55:38 | Sponsor: 1Password | 04:51 |
| 22 | 1:00:29 | Eric Boyd on Azure's AI platform | 02:42 |
| 23 | 1:03:11 | Building specialized data centers | 02:09 |
| 24 | 1:05:20 | Announcing GPT-4o is ready | 01:47 |
| 25 | 1:07:07 | Opperating at scale | 02:15 |
| 26 | 1:09:23 | Behind Azure's AI Platform team | 06:17 |
| 27 | 1:15:39 | How SLM can we go? | 00:37 |
| 28 | 1:16:16 | Practices for benchmarking results | 02:27 |
| 29 | 1:18:43 | Prompt Shields | 02:23 |
| 30 | 1:21:06 | AI crafted a sword in Minecraft | 03:11 |
| 31 | 1:24:16 | Hallucinations are challenging | 02:17 |
| 32 | 1:26:34 | 12x cheaper, 6x faster (new Moore's Law?) | 03:57 |
| 33 | 1:30:31 | Are you hopeful about AI? | 05:37 |
| 34 | 1:36:08 | Working with Copilot + PC | 02:35 |
| 35 | 1:38:44 | Choosing a model | 03:32 |
| 36 | 1:42:16 | Moving into the devices | 02:12 |
| 37 | 1:44:28 | Allocating budget to Ai agents | 02:27 |
| 38 | 1:46:55 | What's next for your team? | 02:00 |
| 39 | 1:48:55 | Driving and talking to AI | 02:06 |
| 40 | 1:51:01 | Major gaps. What's missing? | 02:40 |
| 41 | 1:53:40 | Sponsor: Neon | 05:21 |
| 42 | 1:59:01 | Neha Batra is here for the adventure | 03:37 |
| 43 | 2:02:38 | Your journey at GitHub | 03:37 |
| 44 | 2:06:16 | When Satya calls you on stage | 02:52 |
| 45 | 2:09:08 | Open in Workspace | 02:11 |
| 46 | 2:11:18 | How does GitHub Copilot work? | 05:30 |
| 47 | 2:16:49 | Are summaries the killer feature? | 04:13 |
| 48 | 2:21:02 | Every app will be reinvented with AI | 02:00 |
| 49 | 2:23:02 | Anthropomorphization of AI | 02:40 |
| 50 | 2:25:42 | The ReadMe Podcast | 02:16 |
| 51 | 2:27:58 | Sitting the VP seat | 04:16 |
| 52 | 2:32:14 | Daily mantra? | 03:58 |
| 53 | 2:36:12 | Recent major fires? | 03:01 |
| 54 | 2:39:12 | Measuring results | 01:55 |
| 55 | 2:41:07 | Electrifying energy here at Build | 01:31 |
| 56 | 2:42:38 | Wrapping up | 01:28 |
| 57 | 2:44:06 | Whew! What's next? | 02:51 |
Transcript
Play the audio to listen along while you enjoy the transcript. 🎧
Alright, we’re joined by Mark Russinovich, CTO of Azure. Welcome to the show, Mark.
Thank you.
Microsoft Azure.
Correct.
Full brand.
Make sure you get the full brand in there.
You’ve gotta put it all in there. It might be somebody else’s Azure.
Yeah. I’ve been trained to correct people that [unintelligible 00:03:18.16]
Well, you’re being very gracious. You did not correct me.
Yeah.
Microsoft Azure…
As opposed to the Azure nightclub or pool in Vegas.
Oh, is there one?
Yeah.
Okay.
Fantastic. You learn something new every day.
We need some brand clarity here. Free advertising for that pool there in Vegas…
That’s right.
No, we’re here to talk about Microsoft Azure, we’re here to talk about AI, of course… You’re not sick of talking about AI, are you, Mark?
Never.
You can’t be at Build.
Never. That’s not true, Mark… [laughs] I read his face…