All Episodes
EP 32
·

5,000-Year-Old Bacteria, Solar Storms, Dogs, and Meta’s AI War

Watch 5,000-Year-Old Bacteria, Solar Storms, Dogs, and Meta’s AI War
Hosted by Lester Nare and Krishna Choudhary, this is our first standalone rundown episode — a faster, looser format where we hit several science stories we didn’t have room to turn into full deep dives. This week: bacteria revived from a Romanian ice cave after 5,000 years, a speculative but fascinating theory linking solar storms to earthquakes, new evidence that dogs and humans share genetic roots for personality traits, and the increasingly dramatic fight over the future of AI as Yann LeCun leaves Meta to build a new billion-dollar company focused on world models. Summary Ancient bacteria, modern resistance — a microbe revived from a 5,000-year-old Romanian ice cave resists modern antibiotics and may even contain compounds useful against present-day superbugs. Solar storms and earthquakes? — a Kyoto University theoretical paper suggests space weather could perturb electric fields in Earth’s crust enough to influence faults already near critical stress. Dogs and humans, genetically — a Cambridge / Morris Animal Foundation study finds shared gene pathways that map to personality-like traits in both golden retrievers and humans. The Meta AI split — Yann LeCun leaves Meta to pursue AI systems that model the physical world, arguing that simple scaling of LLMs may never reach real general intelligence.

Keep following the science

Get one clear breakdown and the latest episode each week.

Support From First Principles

Help us cover production costs and keep every episode free for everyone.

Proceedings of the National Academy of Sciences·

GWAS for behavioral traits in golden retrievers identifies genes implicated in human temperament, mental health, and cognition

This study shows that certain genes in golden retrievers are linked to behavioral traits like aggression and trainability, which also correspond to similar traits in humans, including intelligence and mental health issues. Understanding these genetic connections can help improve dog behavior and our approach to mental health in both dogs and humans.

Transcript

Auto-generated from the episode video · 6,580 words

Intro & episode rundown

0:00Frozen for 5,000 years, this ice cave bacterium resists modern antibiotics, which sounds a little bit scary. >> It's very speculative, but even even the fact that the sun could affect earthquakes is is a very interesting >> that is Yann LeCun who has recently left Facebook or Meta in early 2026 and has now raised a billion dollars to build AI that understands the physical world. Hello internet, this is your captain speaking Lester Nare, joined as always by my co-host and our resident PhD Krishna Chaudhary. We are in our first standalone rundown episode. We're going

0:41to cover several stories just at a high level, have a fun conversation. These are stories we didn't get to to do a deep dive this week, but we still want to talk about it and get you guys into your weekend with some fun, exciting talking points with a special segment in the middle, which is going to be a surprise for our resident PhD. Today we're going to cover microbiology on bacteria that was found in frozen caves 5,000 years ago, solar storms and earthquakes

5,000-Year-Old Cave Bacteria Resists Modern Antibiotics

1:10and how they may be related, some of the shared genetic roots between us and dogs, and we will wrap up with an AI story about how the battle for control at Meta AI has now led to the start of a new billion-dollar AI company coming at a different angle than large language models as we know it. We will be learning about the science not quite from the ground up, but at least from the top of the surface because this is from first principles.

1:55Our first story for the rundown today is out of the Institute of biology in Bucharest of the Romanian Academy and it was in the frontiers in microbiology. Frozen for 5,000 years, this ice cave bacterium resists modern antibiotics, which sounds a little bit scary. >> Yeah, dude. This one was pretty pretty weird. Um there is a cave in Romania. It is called the Scărișoara Cave. >> Okay. >> It's got this giant glacier that's about the size of 40 Olympic swimming pools. And that glacier began to form about 13,000 years ago. And what you can do is you can drill cores into that ice and then extract

2:38those samples. And there's bacteria that are preserved in that ice. And bacteria are notorious for surviving being frozen for thousands of years. So, we can bring back to life bacteria that have been frozen for thousands of years. This particular sample is from the 5,000-year-old layer of that glacier. They took it out, they revived it, and they tested it on modern antibiotics. They tested 28 and this bacteria was resistant to 10. >> Not great. >> Yeah, it's really quite strange on the face of it. >> Okay. >> Because modern antibiotics are by

3:19definition modern, right? So, we've developed these you know, antibacterial medication such that it kills bacteria. And these bacteria that are 5,000 years old still have a kind of defense to stuff that we made today. This is in line with a lot of the anti-bac- antibacterial like um resistance that we're faced with as humanity, right? We've been using antibiotics for hundreds of years now. The first real big one was penicillin by Alexander Fleming before World War and because we've been going at it bacteria has evolved to fight against >> Right. >> these antibiotics, right? They've

4:00figured out ways to get around it. And the fact that 10 of these 28 did not work on bacteria that were 5,000 years old suggests that these bacteria were already resistant in the first place, right? Okay, fine. 18 worked, but still the 10 is kind of weird. >> Yeah. Yeah. Yeah. It It's It kind of dovetails with the the story we just talked about as it relates to bringing back samples from space. >> Yeah. >> Uh and the the concern that arises because we don't know what will happen >> Yeah. >> if there happens to be Again, that's a little bit This is real world. We know that it's there. >> Yeah. >> Uh we've tested it. And they're basically pre- They have pre-immunity.

4:42Like They were never our current antibiotic it infrastructure >> to the current antibiotics and yet they're still already immune. >> Right. >> Right? It's quite weird. Um I don't think we should be too worried about these glacial glacial bacteria because these are called psychrobacters. >> Okay. >> Psychrobacteria, which means they're cold-loving. They're not going to survive in the 98 97 98° F environment >> of the body. >> of the body, right? But it's still quite a nice um you know, little problem in molecular biology that like how could this even happen? >> Right. >> And when when you look at like how bacteria

5:23actually evolve, they evolve together. Bacteria are incredibly dynamic with their genomes. They swap genes from one to another all the time. That's actually how we transform bacteria. A lot of times, you know, in an undergrad lab, if you want to like make a bacteria glow in the dark or something with a GFP, which is this fluorescent molecule, what you can do is put in a plasmid, which is a circular piece of DNA that has the GFP code. >> Mhm. >> You put that in and then you heat shock the bacteria. There's something that we've talked about a lot, where you just take the bacteria and you put it in hot water. And then the bacteria kind of freak out and they're like, "What are we doing?" They ingest all sorts of DNA in their from their environment and they

6:03try to transcribe that and see if that'll work. So, bacteria are swapping DNA between themselves and the environment all the time and perhaps through the swapping you get this kind of drug resistance. >> Mhm. >> this this story is that it actually the existence of this reveals how antibiotic resistance evolves naturally. >> Mhm. >> So, that's one thing. The other thing is that this ancient strain also showed the inha bi the So, this ancient strain showed the ability to inhibit the growth of other modern superbugs. >> Oh, wow. >> of like in penicillin, when Alexander Fleming discovered penicillin, it was because it was a natural antibiotic >> Mhm. >> that he had seen there was a mold that

6:44was growing in his Petri dish and around that mold there was no bacteria. And he was like, "The mold is creating something that is killing the bacteria." >> Yes. >> Well, in this case, this ancient strain is able to create compounds that will kill modern superbugs. >> Mhm. >> Right? >> Mhm. >> So, it possesses some kind of enzymatic gene that can hold existing biochemical potential, right? Existing pharmaceutical potential. >> Right. >> And so, it tells us that maybe like we need to look at these kinds of natural places at isolated populations of bacteria to figure out how to beat modern-day superbugs that are now resistant to our back antibacterial

7:26>> Right. >> compounds, antibiotic compounds, but maybe these guys have something >> Right. >> that we can use to defeat them. You know, it's like that Thor um "I can't defeat you, but she can" >> Yeah, yeah. >> thing. Like, but the she can't thing is like these like 5,000 year old bacteria. >> Right. With some a there is a we can look to the past uh to help inform us about how to fight in the present and in the future in a way that was maybe somewhat unexpected in that these bacteria that are 5,000 years old contain sort of an active ingredient >> Yeah. >> that is relevant to sort of a pharmacological pharmaceutical

8:07application today. >> And and historically most antibiotics are developed from bacteria and fungi that live in the soil. >> I see. >> And like they produce natural compounds because over there down there it's like it's like D-Day every day, right? It's just World War all the time. Everyone is trying to eat everyone. And in recent times those pathogens that we found from existing soil bacteria no longer work. Well, we can, you know, go back in time. >> Yeah. >> I think it's it's a pretty cool story at at the heart of it. >> And for it gives a new meaning to the phrase natural immunity. >> Yeah. >> And if we can scale up the same process that

Can Solar Storms Trigger Earthquakes?

8:45allows you to freeze bacteria and reanimate them 5,000 years later, maybe Walt Disney has a chance because if I recall correctly he's currently cryo frozen somewhere deep underneath uh Burbank's headquarters. That is that is rumor. >> That's rumor, of course. >> That's I don't know that to be true. >> anything about it. >> Though not that to be true. But this is again new research paper out of the Institute of Biology in Bucharest of the Romanian Academy. It was in Frontiers in Microbiology. Fun little microbiology story to get us started on our rundown. Number two on our rundown today is can solar storms trigger earthquakes?

9:27>> Yes. >> And scientists propose a surprising link. This is was actually covered by Science Daily. That was out of Kyoto University. Um and the there's a huge solar storm monitoring community on a variety of social media channels. Every time there is a I guess a coronal mass ejection or similar >> there's this like ranking system that's like the Richter scale and everyone's like, "This one is over 9,000, you know, hunker down prepper." But but the there's a there's a potential link here to actually like geological activity. >> Yeah, and that one I was pretty surprised that there is even a theoretical argument that you can make here. And this is mostly a theoretical

10:08argument. This is a theoretical paper. Um what they're doing is showing a surprising theoretical connection between space weather and earthquakes, geological activity on Earth. Now, how does that even what what is the mechanism there, right? Is what I always wonder. So, here's the idea. Um faults on the Earth are poised at a kind of critical spot where there's a lot of stress on them and they're ready to snap, okay? Cuz they've they've been pushed to their brink and like the faults on the Earth are these, you know, plates on the Earth's surface that are contiguous blocks of the Earth's crust that are moving around because

10:48magma underneath is like flowing in a liquid motion and so you you know, you move around just like how um ice on a frozen lake sort of moves around based on currents underneath. So, why would why would that be affected by solar >> Right. >> activity is the idea. Well, solar activity is effectively a bunch of charged particles coming at us. That's effectively what it is, right? There's a bunch of electrons, let's say, that come at us and those electrons are going to create a massive change in the ionosphere. The ionosphere being the outside ions around the Earth's atmosphere that are built by the

11:29magnetic field that sort of um you know, shield us from space weather. Now, that ionosphere is going to get changed up a lot because there's going to be a huge influx of um, charged particles from the sun. That's going to change the electric field on the Earth. The Earth's crust on the other hand has all of these plates that are sort of at this critical point and in between all these plates inside the Earth's crust, there's a lot of water that is in a super critical state because it's under high pressure, it's under high stress. And that water has a bunch of ions. So, the electric field on the outside is going to move around the electric field inside these cracks in the Earth's crust and that could potentially create enough

12:11of a force to actually snap and create high earthquakes, you know, high um, damage earthquakes. >> The The idea is that there is these fields that are all around us all the time and interacting have uh, impacts in the physical nature in which we see and we interact that the tangible things we can touch and feel. And at the scale of the sun >> Yes. >> uh, and the scale of these solar storms >> Yeah. >> the amount of the change in fields in the ionosphere can potentially have a subsequent impact on plate tectonics >> Yeah. >> and and how they move which again, big

12:52enough solar storm means it would not only trigger things like frying electronics and all that other stuff >> Yeah. >> but it could actually physically uh, impact >> the Earth. >> uh, the Earth uh, itself. >> Yeah, and there's like weak correlation between solar activity and geological activity. If you go to 2.5, there's a weak correlation that was out in scientific reports, um, nature scientific reports in 2020. Again, it's not that big and this paper is not claiming, this current paper out in 2026 is not claiming that, you know, solar flares directly cause all quakes, but the research provides this like kind of new mechanism to explain maybe unusual ionospheric activity and that

13:34connection with major quakes. Because in 2024 there was the Noto Peninsula quake. And that was preceded by a really large solar storm. And so there's these coincident sort of We don't have enough data to like, you know, the sigma isn't down to five, but it's there and this is exploring some of the mechanisms. I think that's I think that was like pretty cool. >> Yeah, that that No, that is >> It's very speculative, but even even the fact that the sun could affect earthquakes >> is is a very interesting >> that is and I think the plot of a future upcoming Jerry Bruckheimer produced disaster movie. Jerry, if you want a

Are You Smarter Than Science?

14:11scientific advisor, I think I know someone I can suggest for >> I've done it before, so >> Uh Great. So, this is again out of Kyoto University, which is fine. I mean, not funny. It's interesting. Obviously, Japan has had very dramatic earthquakes. If we think of Fukushima, etc. >> Yeah, so they have a very concerted effort to try to figure it out. And this was in the International Journal of Plasma Environmental Science and Technology. >> Yes. Yes, makes sense. Makes sense. Um This is going to be fun. >> All right, here we go. >> And we're going to try this. And if it doesn't work, you're not going to hear this on the final episode, but we are going to start a new game show segment

14:53called Are You Smarter Than a Scientist? Welcome, ladies and gentlemen, with our resident PhD, Krishna Chowdhury, who will be our scientist of the day. And we will have one question Family Feud style for you to answer. And today's segment question for Are You Smarter Than a Scientist? is Can you name the 10 most abundant elements in the human body? We have 10 on this list. Okay. >> All right. Okay. So, um I'm not sure if when you mean abundant, if you mean by number or by mass. So, let's test it out and start with hydrogen.

15:34>> Okay. So, we have you on the board with hydrogen. >> Okay. So, hydrogen is number three, which means that you are going for by mass and not by number. Um >> Maybe. >> So, let's go with oxygen. That should be number one. >> Is it number one, ladies and gentlemen? And >> Yes. >> Oxygen is number one. >> 70% of the body is H2O, so that tracks. Let's go with carbon. >> Okay. Carbon. Is carbon on the board? We got the top three. >> Okay. And then nitrogen. That should round out four. >> Okay. So, you think that nitrogen is going to be number four? Is nitrogen

16:15number four? You are on a roll. We have our top four. >> Okay. So, we got our top four. All right. Um >> That was the easy stuff. I expected to get that. >> Yeah. So, now let's do Now, I don't know if this is going to be number five, but I know it should be phosphorus because nucleic acids, ATP. >> Okay. So, phosphorus >> of our cell membrane. >> Uh not number five, but still on the board at number six. >> six. So, there's something in between nitrogen and phosphorus? Um only thing I can think of is sulfur. >> Okay. >> Let's go with sulfur. >> Okay. >> That's in proteins. >> We We may have sulfur on the board,

16:56but it's going to be at the number eight spot. >> What am I doing wrong? Um wow. What is number five? >> Mhm. >> Nitrogen >> So, So, right now we have oxygen number one, carbon two, hydrogen three, nitrogen four, phosphorus six, and sulfur eight. We are missing five, seven, nine, and 10. No cheating. >> All right. Um Let's do um So, sulfur is already in there. Wow. Um Oh, calcium for our bones. >> We have number five on the board with calcium. >> All right. There we go.

17:37Um all right. Now, let's do >> Reminder, you have three strikes. >> Oh, I do have three strikes. Okay. I don't want to use any though. You know me. Um okay. So, I think now we should get into ions. So, I'm going to go with, you know, the bread and butter of our nervous system and ions in general. So, let's go with sodium first. It's why we like salt. >> Sodium is on the board at number nine. We have two left, number seven and number 10. >> Let's do potassium. >> Is potassium on the board? It is at number seven. >> we got sodium and potassium. That's our

18:17NaK channels. >> So, you just >> neuroscientists out there. >> One left, our number 10. This might be a tough one. >> This one's a tough one. >> This might be a tough one. >> Okay. So, um >> Okay, we oxygen, carbon, hydrogen, nitrogen calcium phosphorus potassium, sulfur, and sodium. We are looking for the 10 most abundant elements in the human body. If you at home have gotten this before Krishna, you may be smarter than a scientist. >> Uh I don't know. Okay, I'm going to guess on this one. I'm going to go with iron >> Okay. >> because of our blood, hemoglobin.

18:58>> Iron, is it on the board? >> Iron is not. Okay. >> Not on the board, strike number one. >> Um >> Got two more strikes in the chamber. We do not have phone a friend. We do not have any escape routes. >> Uh we already got calcium. Um >> I put you on the spot today, I know. This one's a hard one. >> Let's go with zinc. Zinc is heavy >> Okay. >> and I know that we need it. >> Okay. >> I just don't know for what. I'm going to go with zinc. >> Number 10. >> So, even if we don't need a lot >> Is it zinc? No.

19:39>> Oh my god. >> It is not zinc. >> All right. Um >> One more strike left for the 10 most abundant elements in the human body. >> Um All right, let's It's so it's I'm thinking it's either iodine because I know we need iodine. That's why we need iodized salt or magnesium. I know a lot of people take supplements of magnesium. But people also take iron supplements and that wasn't on it. Let's go with magnesium. >> Final answer? >> Yeah, let's do it. >> Final answer for the number 10 spot. 10 most abundant elements in the body. Is it No.

20:20>> All right, what is it? >> It is not. Our number 10 spot, if you're at home, plug in your guesses now. For our number 10 spot, the answer was chlorine. >> How did I How did I Oh my god, I even said salt. Sodium chloride. Wow. >> That's ridiculous. >> This was our first rendition of Are You Smarter Than a Scientist? If you got all 10, you may have won out on this week one. So, this was our first go-around doing this. I think it was pretty But that's just that's just my personal

21:02opinion. I now have also access to a soundboard, so this can get very outrageous very quickly. I will be sure to hold it in as much as possible, but it looks like for the most part everything

Golden Retriever Genes Linked to Human Traits

21:16went smoothly on the board itself. I think this could be super fun. >> be really fun. >> so again, let us know in the comments if you are intrigued by Are You Smarter Than Scientist and would like to see us bring that segment into the rundown episode on a regular basis. We are going to now go into our third story of the day, which was the one about the link the a shared genetic link between humans and dogs. And this is about golden retriever genes linked to anxiety, aggression, and intelligence in humans out of the University of Cambridge and the Morris Animal Foundation in the Proceedings of

21:57the National Academy of Sciences. >> Yeah, this was a really cool one. Um, they studied 1,300 golden retrievers, and it turns out that not all golden retrievers have the same personality. I mean, anyone who has multiple golden retrievers or has seen multiple golden retrievers knows this. They're not like a one brand type dog. There's dogs that are shy, there are dog There are dogs that are, you know, a little timid. There's dogs that are very, very social. So, there's enough genetic variation within golden retrievers where when these scientists studied 1,300 golden retrievers, they could figure out genes that were related to certain traits. Each of these 1,300 golden retrievers, the owners of

22:38those dogs got like a little questionnaire about like, you know, personality traits for your dog, and then they could correlate using the genetic data certain genes with certain traits. And then when they went and looked at humans and those human traits, the same genes mapped to the similar human traits. >> Interesting. >> Interesting. So, there's there's two kind of points of data. There's sort of a a quantitative data which is the genetic piece >> and there's like a qualitative data point which is the the survey. >> Exactly. >> And they there was the survey there was a reference point both for dogs and the personality traits on the qualitative side and humans. >> And when they met they looked at the

23:19genes that were being expressed that mapped to the personalities on in dogs >> Yeah. >> based on the feedback from the owners. What's interesting is that if you point to those same genes in humans the same qualitative data >> Yes. >> matches up. >> Yeah. And you can you can map the genes together because even though obviously the the golden retriever gene and the human gene are not going to be identical. >> Sure. >> we're humans. >> Yes. >> But you can look at the sequence of nucleotides the ATGC ATGC and you can find overlap where like this gene is like there's only very few mutations, right? So it's definitely the same gene. >> Yeah. >> And then from that they can figure out these genes that are actually related. There's one gene for example PTPN1.

23:59This was linked to aggression towards other dogs in golden retrievers and it's associated with intelligence and depression in humans. >> Mhm. >> So not same same >> Yes. >> but it's really kind of this meta behavioral state >> Right. >> or personality type >> Yes. >> that these genes are controlling. That's what they were very careful about like making that distinction. That this is not like you know a one-to-one mapping >> Mhm. >> but it's rather like a shared biological root for overarching personality. >> It's it's more meant to be a framework versus like a purely like for lack of a better term like diagnostic >> Exactly. >> discrete diagnostic tool.

24:40>> Yeah. >> And it helps create a a a scaffolding by which to kind of architect the structures uh and then you can swap out the variables within those structures as that makes sense. >> Yeah. >> Yeah. >> And it also like leads to like insights in training dogs for example >> Yeah. Yeah. >> because like certain dogs might just be a certain way because of the genetic makeup, mhm, right? And it has nothing to do with like their history or like so on and so forth. Here's a quote from one of the lead researchers. Um, if your golden retriever cowers behind the sofa every time the doorbell rings, perhaps you might have a bit more empathy if you know they're genetically driven to feel sensitive and anxious.

25:20>> As >> from this researcher from the University of Cambridge, Ana Morris Nuevo. >> It's it's funny. Um, as a uh someone who has three dogs >> Mhm. >> who have very, very, very distinct and different personalities. Um it it it's an interesting just to think about. Um, and and also I as we continue to sort of in a variety cuz we've touched a lot of genetic stories. >> Yeah. >> Um, especially in the last couple of weeks. And just the breadth and depth of the increase in our in our understanding of like this fundamental like, you know, the instruction manual for how our

26:02bodies and all like living beings like create the stuff the factories. >> Yeah. >> Right? And the and the the IP that generates it's as we continue to learn more, it it it's not only the understanding piece, which is the first step, uh but that understanding is also and already being applied uh because there's a whole variety of things we can now do uh because we actually know the map. >> Yep. >> Uh we actually have that baseline reference point. Uh and we always love a dog story. >> Yes, always. Whenever I see dog stories in science news, I'm like, yep, we're going to cover it. >> Uh the uh the corgi story continues to be I think our most popular dog story.

26:43>> Yes. >> And then the the whale, the pods attacking the >> That's our biggest animal >> story. >> It's actually our biggest story ever, which I still can't >> it's still so surprising to me. Um we're going to wrap up the rundown today. Again, super casual Friday, almost summer Fridays. Here it's 92° in

Yann LeCun’s New AI Company and World Models

27:00Los Angeles, California currently, which is um uh >> That's an average March Friday so I don't know. >> Uh we're finally over the rain, I think, apparently, uh which is great. And our last story is is, you know, interesting because it dovetails with a lot of the AI stories we've talked about. And there's both a human personality side to the story and sort of like a an actual science part to the story. And this is related to uh Yann LeCun, who has recently left Facebook or Meta uh in early 2026 and has now raised a billion dollars to build AI that

27:41understands the physical world. And this is related to This was covered by Wired, and there's there's a lot of background to this story. I'll kind of just quickly paint a picture before we kind of get into the physical world AI piece. You know, in terms of if you've listened to any of the frontier model CEOs over the last 12 months, so this is Sardemus Sassabis at Google DeepMind, who runs all of Google's AI products, Gemini, everything that's integrated with Google Workspace. You have uh Dario Amadei at uh CEO of Anthropic, who has the Claude and Claude Code and Co-work. They've been very much

28:23in the zeitgeist and in the mainstream because of their ongoing kerfuffle with the Pentagon over usage of Claude within military applications, specifically autonomous weapons and mass surveillance, uh primarily focused on civilian, but you could argue generally. And particularly with Davos, the Davos speeches that just happened all all of them were there and talking about all the you know all the journalists are like where is this going and when are we going to get to quote AGI artificial general intelligence or ASI artificial super intelligence and can simply scaling the current architectures meaning putting more compute and more

29:04data into it get us there or do are we missing a fundamental architecture or concept that needs to be included in order to actually make that that jump and Jan LeCun has been very vocal about his perspective that the scaling laws are not going to get you to AGI. >> Yeah yeah he's he's been very vocal about that and he's had some real like really nice like little analogies about why he thinks that is he he equates it to you know the models of Ptolemy >> Mhm. >> on the epicycles and how you know before Copernicus everyone was trying to fit

29:44the earth as the center of the universe and so they came up with orbits around earth but obviously Mars does this weird retrograde motion where it goes backwards and so Ptolemy decided okay I'm going to put an epicycle which is Mars has a big circle around the earth but then around that circle there's a little circle that Mars goes around so every once in a while on that little circle it's going to go back but then as you get closer and closer and the data gets harder and harder you just start adding more and more epicycles and it turns out because of something called Fourier transforms in mathematics for infinitely the more the more epicycles you add the closer and closer you'll get to the ground truth and you'll never discover Kepler's ellipses

30:24if you don't have a fundamental change right and and Jan LeCun is saying that basically our scaling hypothesis which is just make the parameters more and more we're just adding epicycles and fitting data but the underlying parameter of Newtonian gravity and the one over r squared dependence were missing that entirely. I like that little >> That's a great That's a great like reference point. >> Yeah. >> And just to briefly kind of touch on So, you know, people talk about chat GPT and cloud and all this and in the fundamental architecture that is undergirding them is this idea of large language models. >> Mhm.

31:05>> And you know, so the idea is you're optimizing language as a as a an abstract or as a construct. And both Demis Hassabis and Yann LeCun in the last 6 to 12 months have discussed the importance of world models. Um, this idea that language models are not actually having this fundamental understanding of the physics of reality, which is what has maybe made it a little bit more difficult to get image generation and video generation that out of the box feels real. >> Mhm. >> What seems to have happened is these LLMs have sort of created their this this like uh abstraction of what they like what

31:46they understand physics to be. >> Yeah. >> But it is not actually grounded to like the real fundamentals. >> Yeah. >> And so this has now become the new hot topic is world models. Actually believe Google's already introduced for public consumption a version of their world model >> Oh, okay. >> where you can go into the interface and it's procedurally generating a 3D environment >> Okay. >> in real time as you move around it. And you can choose the POV of like a cat or you know, a bird flying through the air. And so it's not like a video game where all the levels have been explicitly coded by the developers already. And then when you get to the edge, you can't walk deeper into the forest cuz there's an invisible fence in the Pokémon

32:28forest. Uh, it just continually will procedurally generate generate on the fly as you move around. So, as far as I'm aware, that's the first world model kind of thing at scale that's launched. But, it seems like Jan agrees with this viewpoint and is trying to push forth. And with his new company, Advanced Machine Intelligence, they're trying to focus on this idea of building AI world models to actually understand like physical 3D spaces, which becomes much more valuable in applications like having any kind of humanoid robotics do anything in a physical environment,

33:09whether that's in a manufacturing context, in a residential context. Um Driving's maybe a little bit different uh because it's such a rules-based system. Yeah. Whereas, having a home humanoid robot at home, where you want to be able to have it fold your laundry, do the dishes, pick up stuff off the floor. It's like unstructured tasks. >> Yeah. And I think just in general, too, even for language, right? And like producing text that makes sense, or producing recommendations that make sense. Having a world model is a is a huge deal, right? It'll give you recommendations that actually make sense because it understands how fundamental physics works, and so on and so forth, right? >> There's one other sort of interesting

33:50palace intrigue, corporate drama aspect to this story, which is um Meta ended up acquiring uh so, Mark Zuckerberg ended up acquiring this sort of AI infrastructure company, Scale AI, which was led by this 20-something, you know, super genius uh Alexander Wang. Not that Alexander Wang. Uh different one. And, you know, with no E between the D and the R at the end, which is interesting. And they acquired a Meta acquired their Scale AI for uh $14.3 billion. And the idea was it was they were building like a tagging and training kind of pipeline system that was supposed to accelerate, you know, OLAMA and all of Meta's AI work. Now, he

34:35Alexander Wang was brought in and became Meta's like first chief of AI, right? Or our head of AI, right? And you already have the legend Yann LeCun there, right? And so >> Yeah, and Yann LeCun is not your head of AI. >> Right. And and what seems to have been from the outside looking in part of the drama here is, you know, Yann is more on the researcher uh kind of viewpoint. So, you could probably categorize like Sam Altman and Mark Zuckerberg in the scorched earth philosophy. Just spend money, get to the scale fastest cuz whoever gets there first wins. And then the Yann LeCun and Demis Hassabis are more on the if we have the deepest research bench,

35:15we will be the ones who win. And research is the driver of product, not product being the driver of research or product being the driver of implementation. And Dario at Anthropic is like kind of somewhere in between those two. So, it seems to be the case that he was uh sidelined because he wasn't moving quick enough or Zuckerberg was worried about losing. And one of the reasons that Mark Zuckerberg is so motivated to not lose the AI battle against everybody else and why he was one of the first movers to really expect like do a huge amount of capital expenditure to build out Meta's infrastructure is when we were going through the transition from desktop to mobile in the

35:55early 2010s, Facebook missed the opportunity to build the hardware device for mobile. And what ended up happening is they became victim to Apple and Android as related to getting distribution to their end customers. So, there was a famous battle between Facebook and Apple where they were like, "If you want to keep stealing users' data, uh we're going to kick you out of the app App Store." >> Okay. >> And Zuckerberg never again, he vowed never again to allow someone to be able to control his distribution in that way. That's why he went big on VR and Oculus because he's like if that's the next medium, no one's going to beat me. That's why he went big on AI and all

36:35this because if that's the next medium, no one is going to beat me. However, all Apple has to do to kind of really kill a lot of these and this is kind of the the bare case for a lot of the foundational models. If Apple finally decides to do something good and do a local only relatively high quality model on device

Wrap-Up & Listener Feedback

36:55>> Yeah. >> that no longer needs you to have a ChatGPT subscription or any of these other things and they have all they have billions of devices everywhere and become the first AI of choice, it is going to become very sticky for some of these model providers. So we'll see. But but Yann LeCun is out at Meta. He's starting his new thing. I think he's going to need more than a billion dollars. >> Yeah, he has a billion dollars already from the likes of Mark Cuban, Eric Schmidt. >> Yep. >> Um and it values at 3.5 billion. >> Already. >> Already and in like 6 months of starting. Crazy. >> going to and this is just the the valuations of these AI companies is just outrageous. But again, people are viewing it as, you know, end game

37:36technology. So >> Yeah. >> Uh with that, we are going to wrap up our rundown for this Friday. Touched on a nice fun microbiology story. Although it's not that fun if it ends up killing us all. Solar storms and earthquakes, maybe this was not so happy and dandy. But we had our are you smarter than a scientist we got nine out of 10, shared genetics between us and dogs, and the battle for AI continues as people throw money everywhere. We are we are going to ask again for feedback. This is going to be the third episode that comes out this week. We're splitting it out so that they're shorter, more bite-sized, easier to consume and digest on your commute, during your workout, and it just becomes

38:18easier to share with friends if you want them to listen to a specific section. So let us know if you do like that structure and that setup, we will continue on accordingly. I am your host, Lester Narh, joined as always by my co-host and our resident PhD, who may be as smart as a scientist, Christian Choudhury. We will see you all next week.