Changelog Interviews – Episode #594

Microsoft is all-in on AI: Part 2

with Mark Russinovich, Eric Boyd & Neha Batra

All Episodes

Mark Russinovich, Eric Boyd & Neha Batra join us to discuss the state of AI for Microsoft and OpenAI at Microsoft Build 2024. It’s safe to say that Microsoft is all-in on AI.

Featuring

Sponsors

Cronitor – Cronitor helps you understand your cron jobs. Capture the status, metrics, and output from every cron job and background process. Name and organize each job, and ensure the right people are alerted when something goes wrong.

1Password – Build securely with 1Password - 1Password simplifies how you securely use, manage, and integrate developer credentials. Manage SSH keys and sign Git commits. Access secrets stored in 1Password. Automate administrative tasks. Integrate with third-party tools. Also, check out our INFRASTRUCTURE.md file for more details on how we do secrets with 1Password.

Neon – The fully managed serverless Postgres with a generous free tier. Neon separates storage and compute to offer autoscaling, branching, and bottomless storage.

Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.

Notes & Links

📝 Edit Notes

Chapters

1 00:00 This is The Changelog 01:23
2 01:23 Sponsor: Cronitor 01:26
3 02:49 Start the show! 02:33
4 05:22 Hallucinations are concerning 04:35
5 09:57 AI Red Team at Microsoft 01:51
6 11:48 The Crescendo attack 02:12
7 14:00 Masterkey attack 03:09
8 17:09 AI Red Team's toolkit 02:21
9 19:30 What skills do you need? 02:21
10 21:51 The state of AI security 03:42
11 25:33 Were you a Mr. Robot fan 02:20
12 27:54 Do you write good books? 00:50
13 28:43 Hard science favorite authors 02:18
14 31:02 We're not at risk losing our jobs to AI 03:49
15 34:51 Image generation wtih DALL-E 03:33
16 38:24 Generating better code 06:50
17 45:14 Copilots' everywhere 03:28
18 48:42 Coding with the Copilot pause 01:37
19 50:19 Copilot + PC 02:22
20 52:41 Install the Copilot app 02:57
21 55:38 Sponsor: 1Password 04:51
22 1:00:29 Eric Boyd on Azure's AI platform 02:42
23 1:03:11 Building specialized data centers 02:09
24 1:05:20 Announcing GPT-4o is ready 01:47
25 1:07:07 Opperating at scale 02:15
26 1:09:23 Behind Azure's AI Platform team 06:17
27 1:15:39 How SLM can we go? 00:37
28 1:16:16 Practices for benchmarking results 02:27
29 1:18:43 Prompt Shields 02:23
30 1:21:06 AI crafted a sword in Minecraft 03:11
31 1:24:16 Hallucinations are challenging 02:17
32 1:26:34 12x cheaper, 6x faster (new Moore's Law?) 03:57
33 1:30:31 Are you hopeful about AI? 05:37
34 1:36:08 Working with Copilot + PC 02:35
35 1:38:44 Choosing a model 03:32
36 1:42:16 Moving into the devices 02:12
37 1:44:28 Allocating budget to Ai agents 02:27
38 1:46:55 What's next for your team? 02:00
39 1:48:55 Driving and talking to AI 02:06
40 1:51:01 Major gaps. What's missing? 02:40
41 1:53:40 Sponsor: Neon 05:21
42 1:59:01 Neha Batra is here for the adventure 03:37
43 2:02:38 Your journey at GitHub 03:37
44 2:06:16 When Satya calls you on stage 02:52
45 2:09:08 Open in Workspace 02:11
46 2:11:18 How does GitHub Copilot work? 05:30
47 2:16:49 Are summaries the killer feature? 04:13
48 2:21:02 Every app will be reinvented with AI 02:00
49 2:23:02 Anthropomorphization of AI 02:40
50 2:25:42 The ReadMe Podcast 02:16
51 2:27:58 Sitting the VP seat 04:16
52 2:32:14 Daily mantra? 03:58
53 2:36:12 Recent major fires? 03:01
54 2:39:12 Measuring results 01:55
55 2:41:07 Electrifying energy here at Build 01:31
56 2:42:38 Wrapping up 01:28
57 2:44:06 Whew! What's next? 02:51

Transcript

📝 Edit Transcript

Changelog

Play the audio to listen along while you enjoy the transcript. 🎧

Alright, we’re joined by Mark Russinovich, CTO of Azure. Welcome to the show, Mark.

Thank you.

Microsoft Azure.

Correct.

Full brand.

Make sure you get the full brand in there.

You’ve gotta put it all in there. It might be somebody else’s Azure.

Yeah. I’ve been trained to correct people that [unintelligible 00:03:18.16]

Well, you’re being very gracious. You did not correct me.

Microsoft Azure…

As opposed to the Azure nightclub or pool in Vegas.

Oh, is there one?

Fantastic. You learn something new every day.

We need some brand clarity here. Free advertising for that pool there in Vegas…

That’s right.

No, we’re here to talk about Microsoft Azure, we’re here to talk about AI, of course… You’re not sick of talking about AI, are you, Mark?

You can’t be at Build.

Never. That’s not true, Mark… [laughs] I read his face…