China's AI Breakthrough, Time Crystals, Hidden Viruses, & Brightest Cosmic Signal

Keep following the science
Get one clear breakdown and the latest episode each week.
Support From First Principles
Help us cover production costs and keep every episode free for everyone.
Transcript
Auto-generated from the episode video · 18,807 words
0:00Hello internet. This is your captain speaking Lester Narre joined as always by my co-host and our resident PhD Krishna Chowdery. This is from first principles. We have a great episode for you this week. We're going to cover four stories in AI, space, and immunology. Starting with a new story out of China's Deepseek, which says its AI model costs just $294,000 to train. This is really important and we're going to go a deep dive into why. Followed up by our second story. Sounds like we may have discovered the Ocarina of Time. We may need to get Zelda involved as scientists just made the first time crystal that you can see. I'm
0:41really interested in talking to you about that one. >> That's cool. >> The third story is about hidden viruses in our DNA that could be medicine's next big breakthrough. And we're going to end with space with the brightest fast radio burst ever detected and how it could help us solve an enduring cosmic mystery. This is from first principles [Music]
1:17my friend. How's it going? >> Episode nine. >> Episode nine. 10K followers on Instagram. >> We still haven't been uh shut down by the FCC yet. >> Yeah. Yeah. Yeah. Yeah. It's coming though. >> It's coming. >> We're talking too much science. It's coming. >> It's coming. They're going to defund us and then ban us. But before they do, >> Yeah. >> we're going to talk about some great stories. >> Uh the first one, we always end up touching on AI. Yeah. >> There's a lot of research going on in AI in a variety of ways. Yep. Um and our first story uh was it was a story in in Reuters uh that also had two Nature papers that were related to it. >> Yeah. >> The headline on this is China's Deep Seek says its uh AI model has hit a cost
1:57of just $294,000 to train uh this the sort of by line is in a paper that is likely to reignite the debate over Beijing's place in the race to develop AI. Yeah. this sort of cost which is significantly lower uh than the figures that we see in the US and I know we've talked about Deep Seek and all of this quite a bit. Yeah. Uh it's a it's a crazy model and the fact that the team like put out a peerreview paper you know no one else has done that in the field of AI like gone to nature and put out okay this is how we trained this is how we did it >> it is there actually it's it's kind of
2:40crazy that China is setting the precedent for open science in the field of AI >> right >> it is very interesting and not only one but two papers in in nature main brand Yeah, not a nature sub, you know, sub. >> This isn't e. This isn't even like, you know, nurips. This is nature. >> And you know what I thought would be helpful, uh, we're going to do sort of two aspects on this story. >> Yeah. >> Um, folks might have seen the Deep Seek news, you know, earlier in the year when there was sort of a big outcry about it. >> Yeah. They released in January, I think, and then all of our stocks failed. >> Yes. It was a big deal. Um, but January wasn't the start of this great power war
3:22over AI, right? >> And I thought it would be good to just go over a couple of beats on the sort of geopolitical context that this research paper kind of came out in. >> Yeah. Yeah. >> And to sort of set the stage, right, there's an AI great power competition between the US and China. >> Um, AI as we know it has existed for quite some time. Uh, you know, before all this generative AI stuff. Um but in the sort of recent context uh we're going to start in 2017 where China launched its next generation AI plan >> which said it was going to lead the world in AI by 2030. >> Uh they're famous for their 5year plans, >> right? And the idea is US has been the the global hegeimon forever. China's
4:04looking at a way in which it can sort of destabilize that control. Yeah. Uh and Xi Jinping uh leader of the Chinese Communist Party uh said that advanced tech is the sharp weapon of modern states. >> Yeah, it's true. And as we've discussed, you know, on this podcast previously, you know, there is a very strong relationship between the military intelligence and national security apparatus within nation states and frontier technologies, AI just being one of those. Um, and then in 2021, what was interesting is the US National Security Commission on AI, which was chaired by uh the former Google CEO Eric Schmidt, warned that American dominance in AI was
4:45not guaranteed. So, we already have this setup of of that friction. >> Wow. >> Now, if we go into the Biden era policies because the US government, as we know, as it relates to technology innovation is usually reactive as opposed to proactive. If we look at the internet as an example, they allowed innovation to happen and then they put in a regulatory infrastructure after the fact >> with AI because of the popular conversation from the likes of folks like the richest man in the world depending on the day Elon Musk really ringing the alarm on you know AI safety. >> Yeah. >> Which has created this accelerationist decelerationist dichotomy within Silicon Valley. >> Um the Biden era was the first administration to take policy in earnest
5:26in terms of AI specifically. Okay. >> And this started in August 2022 when Biden signed the chips and science act which many people have probably heard the chips act. >> Yeah. The chips act. >> $250 billion bipartisan bill aimed at boosting US semiconductor manufacturing and innovation. This dovetales with the ron shoring of manufacturing conversation postco. Uh there was 52.7 billion in supplemental appropriations that was specific to semiconductor related programs. Okay. >> For 2023 through 2027. The idea being that it was also going to create guard rails preventing recipients like Intel and TSMC uh from expanding their advanced fabs in China. So we can see
6:09the theory of the case here was can we create a choke point at the hardware level because these chips were viewed at the time as being the key aspect of the stack that was going to be the driver of progress and innovation. And TSMC is in Taiwan, which is like now iffy if it's if China's going to do something, right? >> Correct. China's been doing a huge military buildup and training around this idea of we're going to take Taiwan. >> Yeah. Yeah. That's basically their thesis right? >> We're going to take Taiwan and you don't want to be here when that happens to us, the US. >> Yeah. Yeah. >> And so the there are a lot of layers to this. The Taiwan point is a really important one. >> Now 2022, we're still in 22. August
6:50chips act jobs. Uh uh and then October 7th, 2022 uh the October 7th controls were established which are export controls. Now they named it this prior to the unfortunate October 7th of 2023 which is the Israel Gaza conflict. >> But at the time uh this was a restriction on exports of specific Nvidia and AMD chips. the uh H100s H100s, A100s, and the AMD MDI2 MI250s. >> Uh which basically meant this was the whole we have a small yard, >> high fence. Yeah. >> Uh making it really really difficult to get these sort of frontier chips. >> Yeah. And the thesis was that like these
7:31chips are the future. Yes. And without these chips, you can't do >> Exactly. That was that was the theory of the case at the time. Yeah, >> as a small side note, it's interesting that a month almost just over a month later in on November 22nd uh 2022, CHACBT launched. >> Ah okay. So all this conversation was happening prior even to the the meteoric rise of the first real you know production level uh LLM generative AI accessible to millions of people and the growth curve as we all know >> I mean that ch was the moment where now everyone was like oh AI is here >> yes it's not just this thing people are
8:12saying d it's not theoretical >> I I can literally chat with it and it's like giving me amazing answers. >> Yes. >> Yes. >> So, now we're moving into 2023, >> right? >> Uh so throughout 2023, now the Biden administration is not only trying to create the choke points domestically, but now we're going out to our allies uh all across the world to sort of expand that tightening. So this included uh in the Netherlands with uh ASML and in Japan with Nikon and Tokyo Electron blocking them from providing China access to their lithography tools which are used to actually build and generate these more advanced chips. Yeah. Uh this
8:54was followed up by in August of 23 executive order 14105 uh which now also restricted investment from US investors into any China AI or quantum firm. Okay. So they're they're just like effectively slowly like choking all pathways >> right to hardware innovation. >> Yeah. For hardware innovation. >> For hardware innovation. Okay. >> Right. So while this was all happening in 23 uh interestingly enough uh there was the very very sort of public falling out of the founder or CEO at OpenAI Sam Alman. So you many folks may remember
9:35there was that huge board battle. >> I forgot about Yeah, dude. >> He was ousted in ousted. >> Yes. Oh my god. >> And this was around OpenAI was a nonprofit. >> They were doing a lot of for-profit moves. They wanted to kind of rejigger their structure and it kind of signified the realization across the Silicon Valley consensus that this thing was going to be bigger, more powerful, more impactful, more money generating than even they had seen they had predicted was happening quicker than they expected. >> Um, so there was that power struggle, >> right? >> Ultimately the king returned to the castle >> uh and re got to his Sam re got his position as CEO. But all this we've
10:16talked about so far has been the US side. >> Yeah. >> So in 23 China's response like what has China been doing as the US? Yeah. We've been battling internally. Yes. >> So to speak >> and to sort of create this uh regulatory regime around access to chips, >> right? So what's China been doing? So, China uh had firms like Huawei introduce their own, you know, what they call frontier chips uh with ascend the ascend AI chip uh as well as uh shocking the global community when SMIC uh released their 7 nanometer process uh for for smartphone chips which again the idea was TM TSMC has really had a monopoly on
10:59the seven five and I believe three now nanometer chip Their latest is three, but like sub 10 was them, >> right? And and no one else could really do it. And that was like a really big bottleneck. Um >> both for and there's both operational reasons and proprietary intellectual property reasons why that's difficult. >> Yeah. >> Um they also then had uh their other big conglomerate technology companies by Alibaba uh begin to put out their own chatbt type LLM. So, we had Quen, we had Erniebot um >> but nobody really, >> no one really thought, no one cared. They were all trained on the cut down Nvidia H800 GPUs, which were still allowed to be sold to China, but they
11:40were massively sort of handicapped. Yeah. Um, interestingly now, now we're sort of getting into 2024, which is more of the same, but we talked about the intersection of the national security state, the intelligence community, military intelligence, and Frontier Technologies. >> Yeah. >> And Mark Andre made this interesting uh note in a podcast where he basically was trying to call out the folks who are called Dels or the folks who are really uh heavy on AI safety. >> Uh deceleration. Okay. >> Yeah. the the decelerationists who were saying let's slow down let's slow our roll >> Elon is a famous one >> Elon is arguably the most famous decelerationist >> and Mark Andre's point was if you
12:23believe that this threat is as as existential as nuclear weapons >> sure >> you're still allowing these open AI employees to go to an unprotected unsecured building in the same way that not in the same way that like nuclear facilities are protected from a operational security perspective so he's like if you believe this to be true. The entire operating infrastructure of these companies needs to change. >> Yeah, >> the >> that's fair actually. I didn't I never thought about that, but yeah, >> it's it's a fair argument, right? And in 2024 in on June 13th after all this board kurfuffle in 23 the former head of the national security agency and commander of US cyber command
13:04uh Paul Nakason was added to the open AI board which was the first salvo in what I like to call the nationalization of the frontier models in the United States. Got it. Right now the national security state has a seat at the table. uh shortly after OpenAI announced several projects with the Pentagon, the DoD around using it. So this is all background leading up to the Sputnik moment for China. >> That was a big one >> which is in January of this year uh 2025 when the Chinese startup Deepseek released their R1 model which was claiming at the time chatbt4 level reasoning. So this is like our best most
13:45frontier. This is pre- chatbt5 which we now have. today in September. Uh fully trained on Nvidia H800's >> the not good chips. >> The not good chips. Yeah. >> Uh using a mixture of experts techniques for the training alongside with reinforcement learning at what we now understand to be a sub $300,000 training cost. Now it's important to note the amount of money that anthropic uh open AI uh meta has raised to train gro >> to train their foundation models is in the order of tens of millions hundreds of millions of dollars. >> Yeah. >> So these are this is an orders of magnitude >> of magnitude less
14:26>> difference. And so what we ended up creating by doing this choke point on the hardware side was you know uh necessity is the father invention or whatever right >> China then said okay let's innovate on the training model and infrastructure to try to get the same efficacy without >> on the algorithms >> on the algorithm and the software not on the hardware. So this created a huge uh you know surprise from a lot of US observers because the the the the consensus was if we choke off the hardware they got nothing. >> Yeah. >> And this totally blew that out of the water. So at first there was fascination which was immediately followed by the national security narrative taking over.
15:08An interesting point about what China did with uh Deepseek was it was also if we exclude llama uh Meta Meta's llama which models which are open- source open weights. Yeah. >> Um but arguably weren't as competitive as R1. >> China was the first frontier scale openweight model. >> Yeah. Yeah. They just published their weights, >> right? Which the point here is then you can take it and make it into whatever you want to. So the app for deepseek became the number one most downloaded app globally. Oh that it was then banned in India, Italy, Australia, Taiwan because the national security narrative came in and it was like this is a propaganda tool. It's a it's a data
15:49siphoning tool. >> Uh don't trust DeSeek. But it strategically left out the point about the fact that you could download the model. >> Yeah. >> Run it locally >> and change the weights however you wanted to. So with Deep Seek, if you tried to look up Tianaan Square, >> Yeah. >> you weren't going to get an answer >> really, >> right? So they were, you know, >> classic >> doing a little bit on their own. >> Yeah. Yeah. Yeah. Of course. >> On the information control, but it's open weights. >> So if you want the tan and square answer, >> you can do it on your own. But >> Oh, interesting. I see. Yeah. >> The narrative really tried to avoid talking about that point. At the same time, people started calling open AI closed AI because they had never had an
16:31open source model. They never had a research paper >> around their process. So now this brings us to where we are today with these two new papers in nature >> uh which go a little bit deeper into how deepsek went through their process and we'll sort of talk about this but I think that background is important context to understand like why does deepseek matter? >> Yeah. Why is it uniquely different than Chad GBT than Claude than you know Gemini all these other models a and why is it important that they actually have a peerreview paper? We always talk a lot of the US conversation around science
17:12research is oh China's papers they fake the data yeah they're not really good they're not where we are and I think this this has been a a unfortunate uh viewpoint in the US about China generally not only with cars saying they just steal our stuff also with this that is a little bit outdated because we're seeing with cars the best EV cars in the world are made by China It's not arguable. They make them cheaper, faster better stronger. >> Yeah. >> Uh which we've now put tariffs on in order to say, "Oh, don't look here. There's no problem. Ford is still the best." And AI is taking a similar in terms of our posture, a similar
17:52political stance that China doesn't really know what they're doing. This is not really a big deal. Blah blah blah. And I think we need to be careful about ascribing a narrative that may have been true 15, 20 years ago. >> Yeah. >> That's certainly not true now. That's certainly not true. >> We've covered Chinese research. We've covered the hexagonal diamonds that were first created by China. Everyone's been going after them. But two labs in China were going after them and actually one of them succeeded, right? >> Like >> and it's the proof is in the pudding. They made it. They have all the tests, >> right? >> And there's peer-review paper again. >> And it's out in nature. >> It's out in nature. >> Um and we always talk about well this and that. So now that we've given that
18:33context, let's talk about these two new papers. Yeah, these papers are um pretty incredible in the fact that they are the first peer-reviewed paper from a sort of premier AI large language model, right? you have like obviously ChachiBT, Gemini, Grock, all of these large language models, but they haven't actually published anything that shows sort of okay that the that you know I I'm sure that the the team at Deep Seek has kept some secrets to themselves, but the fact that they've actually gone out and published this peerreview paper is I think quite a watershed moment for the AI community, right? because they're
19:14trailblazing this idea that maybe AI is a part of open science and maybe it should be out in the open just like normal science, right? Where it's like you as a scientist you find something cool or you make something cool, you put it out in a peer-reviewed paper, right? And you get let experts actually talk back to you and then like see how things actually work, right? You want to get into the nitty-gritty of it. Um, in the technical details, this paper is quite interesting because it tells us some of the tricks that they used in actually making it possible to train something like DeepSeek on perhaps only H1 H800s.
19:54Again, maybe not, right? There's always a possibility that they're not totally forthcoming, >> right? >> But they've they've sort of laid bare some of their strategies, and I think that's quite interesting. I I want to actually just do make two small yeah context notes that I think are interesting here. One is one is that the the founder of deepseek ar his his story is that the reason they ended up creating uh R1 >> was actually he was doing uh uh trading like financial tra like finance trading >> right it was related to a hedge fund >> it was a hedge fund plan they were like we want a more powerful model to utilize
20:35for so it wasn't even their core it was an outgrowth of another like need >> and then I I want to talk about this open sourcing concept of like why China did the like why are they doing this open source open weights move. There was an interesting um u there's a podcast the BG2 podcast with two US investors um Brad Gersner and Bill Gurley and they've been talking about this a lot. If you look at China's strategy generally as it relates to if you're in a world where the US already has dominance in a lot of these technologies that are closed source >> from a from from a how do we remain competitive angle this is actually what Facebook did by trying to have Llama be
21:16open is the the best thing you can do to battle closed source is to create an open source ecosystem right that now becomes competitive with that clos source because you're going to then now get input from a wider array of experts that invest in your version of the future. And so for China, there was an incentive >> geopolitically to go open source being a second mover as the means by which to combat the closed source dominance of the US. So this deepseek model is not an isolated incident of China using open-source as a way to backstab US's closed source dominance. >> Yeah. There's like a there's there's a
21:56strategy. Yes. behind this >> that is a larger part of how China is trying to spread its influence across these areas in which the current west's control and and buy in is waning. Yeah. I mean I think they figure that like the world is a really big place. Okay. And these developing economies are exactly that developing right? They're getting bigger. People are getting more affluent. technologies there are gonna start getting better and better and they're going to require AI to keep up with the rest of the world, right? And maybe they don't want to pay whatever
22:36royalties, right, to to these closed >> systems. I think I Yeah, I think I think it's really cool. Um, and I think the idea that DeepC came out right with their model in January, I think it was also a watershed moment for the rest of the AI community in terms of finding out the efficacy of something like a pure reinforcement learning approach. Okay. rather than some of the techniques that chat GPT and these other firms had used which was a supervised fine-tuning or the sort of human feedback reinforcement learning which always requires a human in the in in the loop. Yes. >> Right. What these guys did was um kind
23:19of a pure reinforcement learning approach and that's something that they've laid out in this paper in nature. Okay. The idea is that sort of traditional LLM reasoning models, what they do is they require human input in order to steer them towards the correct answer, right? In order to be like, okay, this is this was not quite what I wanted. This is this is what I wanted, right? There were a bunch of like Kenyans that were hired by OpenAI to basically do this, right? And I don't know how many, but like that was a whole thing back in the day. And you know, that's fine for that. that's fine but it's it's quite expensive in terms of >> like getting human annotated >> chain of thought data and so on and so
24:00forth. But on the other hand, there's actually a disadvantage to using humans because then you are limited to human reasoning. Okay, there could be other ways to reason about a problem that wouldn't quite occur to a human being >> that perhaps if we gave the entire control to the machine itself, the machine could figure out on its own, right? So, so there's an inherent disadvantage that I think these guys at DeepSeek actually like latched on to, right? And they figured that what we could do is we could we could use a pure reinforcement learning strategy >> where there's a reward signal. So the way the reinforcement learning works is
24:40you've got your model, right? And then it tries to find an answer. This works for well- definfined tasks where there's a right and wrong answer. And there's a really nice way to compare your answer to the right answer and figure out what a reward should be. A reward being if my answer is closely aligned to the right answer, then I'm on the right track and the strategy that I've been using is sort of on the right track. and otherwise maybe I need to try a different strategy. It's actually very close to how um neural systems work, right? We we we've studied reinforcement learning like at the biological level when it comes to like you know a rat trying to find
25:21cheese in a maze, right? We've we've literally gone into the brain and found that these how at the nitty-gritty level, at the cellular level, how this stuff works. And now and now we're kind of translating that into the AI neural network space, the artificial neural network space. >> Mhm. >> So if we use pure reinforcement learning, what that does is it bypasses human labeled reasoning steps and then we can actually explore just computationally the entire paradigm of how to solve a problem >> which is I think very cool. Um so that's one of the things that's revealed by this paper. the fact that they used pure reinforcement learning. Okay. Um it was
26:04this autonomous exploration and a development of problem solving strategies. And what you could see and what they report in the paper is you could see the the network sort of use that RL technique reinforcement learning to get better at finding the right answer. So what what what they noticed is um for example the length of the answers would get progressively longer >> because the neural network wanted to get better and better at finding that right answer in this large language model type of thing. They also had this thing called the aha moment which is when I was like oh this is like working way better than we thought which is when you know in the chain of thought you can
26:45actually output the thought that this thing is doing right >> and um the model would start using the world the word wait >> that was never explicitly put into the training regime. Okay. But what the model would start doing is as it was if it was trying to get to an answer and it was like sensing that it was rushing things and just trying to get it done quickly it would use this thing wait >> that's >> and then and then it would backtrack and try to figure out if there's a better way to rethink what it had just thought >> and then keep going. >> That's like >> some meta level like weird weird stuff,
27:27dude. like that. It's just using this word wait in the context that the word wait means wait and let's try to figure out what we just said in a in a in a nice way. You know, I think I think that's that's that's kind of crazy to to backtrack and then so it developed these autonomous sophisticated reasoning patterns to try to you know solve the problem and it's no longer limited by the human guided approach. >> Right. >> Right. which also has bias issues >> related to human reinforcement learning because now if you have a bunch of Kenyans doing it >> there's cultural differences there's educational differences
28:08>> and so you you this is where people sort of have concerns about the Silicon Valley elite being the ones controlling the parameters and mind space that these models sort of have. So it's but that this is like a a very pure play >> Yeah. >> version that kind of abstracts away the need for at least in some cases for the human input to be such a big driver in how it determines answers. >> That's right. Yeah. So so that was the reinforcement learning part right which is like okay that that's a training strategy. They also had this philosophy sort of of efficiency over everything right because of what you talked about where you know the powers that be let's
28:49say have crippled their access to hardware. >> So what can we do we can innovate with algorithms and we can in innovate with strategy. So there there's a two-pronged approach that they at least revealed in this nature paper. The first one is this idea of mixture of experts, right? This architecture where what you can do is have a giant model, the deepse model itself is um 671 billion total parameters which is on par with some of the big chatpts and things like that. I think chatb5 has like on the order of trillion or more but some of the earlier models have hundreds of billions. So it's in the same regime. But when it
29:30comes to actually inference, the number of active parameters used is only 37 billion. >> Okay, which is 20 times less than the total size of this network because what they're doing is they've got they've got this sort of network on top. Yes. >> That that comes in in the very beginning and it's kind of a router. Okay. What it does is you've got you've got this 600 billion parameter network, but if you ask it a certain question, there's only a certain subset of that network that would be very good at answering that question. And that becomes that 37 billion part. Mh. >> So you they they've implemented this router mechanism that takes in the
30:10prompt of whatever you put in and then it sort of routes that prompt to a subset of the network and now inference becomes faster. It becomes less expensive in terms of maybe you don't need an H100 GPU, right? Maybe you can do with that H >> 800 >> or you know that that previous model and you can actually like get a quick answer and it'll be just as good. >> Right. Right. >> Right. So that's one of the strategies that they used. The other strategy that they used was during training they had this um idea of using um a reward system. Right? In in reinforcement learning you have to have a way of
30:51sort of quantifying how much the reward is >> and then steering the network towards getting more of that kind of reward. Right? So the way that traditional LLMs um have been trained is through this process called proximal policy optimization. Okay, PO. It's this idea that you have your policy maker which is your LLM that's like actually outputting the the language that gets output whenever you do the chat. Yes. >> But then there's this thing on top which is kind of like the critic model. And what that critic model is doing is it's during the training process it is taking
31:31the output of the policy which is the output of the model and then it's trying to guess at what the reward is going to be. Okay. And then what you can do is you can use this critic model and the advantage that you get. The advantage being what is my guest advantage at this particular strategy. That's what this critic model calculates. And what this critic model does is feed back that advantage to the big LLM to tell it, okay, you're on the right track. This strategy is working or no, it's not working. >> Crucially, this is very expensive because now you've got two models that you're training, right? You've got two models and as the LLM gets bigger and bigger, the critic model has to get
32:13bigger and bigger to try to figure out how to calculate that advantage in whatever scenario, whatever game you're playing, whether it's text generation, whether it's whatever, right? So, if you've got a bunch of H100s, that's fine, right? If you've got billions of dollars of funding from random VC firms, that's fine. But if you're deepseek, that's no longer tenable. M. >> So what these guys did was they used a different strategy called group relative policy optimization. >> Okay. They don't have this second critic model that they're doubly training, right? They don't have this 2x parameter blow up. >> What they have >> is their original LLM.
32:54>> And what it's going to do is it's going to output a bunch of different answers. Okay, let's say for the sake of argument, let's say 10 different answers. And then what it's going to do is it's going to calculate the reward for each which we can get because this is a reinforcement learning strategy. And there's going to be a mean and standard deviation. There's going to be a distribution that you can calculate about that 10 different strategies. >> There's going to be some that are above the mean >> which means that that is better than those others. >> The whole idea is you're trying to get this idea of advantage. which are the strategies that give me advantage and which are the strategies that don't in the ones before in the traditional LLMs
33:36the ones that we're doing in the states and in the west we've got this separate neural network that is calculating that advantage and telling the the original one where to go here the original one is coming up with different answers and then creating a distribution out of that and then figuring out okay I should I should go here >> to this part >> whatever I did here that's what's good whatever I did here that's what's bad because I came up with eight 10 different answers. These guys were bad. These guys were good. Right. So, you don't need this second >> giant neural network to train. >> Mhm. >> Right. So, it's it's it's a really interesting strategy where you're choked by the hardware, but you're saying,
34:16"Okay, well, I've got a few tricks up my sleeve." Yes. >> Right. >> Yes. >> I I think it's I think it's rather cool. I I think that this is an important you know there there is always because of this nexus between nation states trying to acrue and maintain power and the importance of frontier technologies to that goal. We're always going to see policy impact how these technologies grow and progress. The Biden administration made a bet that hardware strangulation to China was the best path at creating
34:57advantage for the US in the race. And it was a well-informed bet, right? Because like everyone who had been doing AI thought that that was the masterpiece, right? That the hardware was it, >> right? Ever since ever since 2012 when Alexet came out and what they could do is actually use GPUs to train in parallel and then just all of the mathematics of matrix multiplication and back propagation could be done on GPUs. Yes, >> that's when it was, you know, ever since then, we've sort of taken for granted that, oh, GPUs are really >> what matter. But, but we've created good enough GPUs. >> Yes. >> That we've taken for granted that like the best GPU is always the best. But
35:39actually, the H800 is like a good enough GPU now. >> Yes. >> That it can do enough of the math. >> Yes. >> That now we now these guys can can actually go and, >> you know, start start tweaking the knobs. >> Yeah. start tweing the knobs. >> It's a really, you know, the cost difference is crazy. The equivalence of efficacy of the models given the cost difference is even crazier. >> And it is going to continue to be this this hardware software attention, where do you innovate more? Um, where has the most uh aggregate value in terms of
36:19continuing to increase the power and efficacy of these models? It's going to continue to be a rolling story. Yeah. >> I think again to your point at the top of when we started the story. It is very interesting that for the amount of time I remember using GPT2 uh in my company trying to see you know trying to gauge when is this stuff going to be ready for production years ago and it is uh the jury is not out. >> Yeah. yet on on this journey to AGI and artificial super intelligence which of these two levers that we're pulling are going to create those
36:59incremental because we sort of seen the models are kind of sort starting to aggregate at a similar level of performance >> and the the gains from your walled garden are becoming less and less. >> Yeah. And this is a classic battle in every technology revolution that's ever existed >> in terms of the tension between closed source and open source. >> Yeah, >> open source has always been, you know, all servers run on Linux. Linux open is open source. >> Why is that? >> Everyone uses Python. >> Everyone uses Python open source. And the reason, the theory of the case is when you open source, there's a more of a distributed incentive to create
37:40security. Exactly. >> Because everyone wants it to work. you're having more viewpoints inputting into the the system itself and you're limited by your resources if you go closed source by your talent. The way in which in the US we deal with that is Facebook gives billion-dollar offers to the best AI researchers. But at some point, this is the forever tension in technology revolutions. And it's interesting to see it play out in this geopolitical sphere where the the the the winner or the the the import of the battle is so high. >> Yeah. Yeah. The stakes are really high. >> It's really high. >> Yeah. Yeah. >> Um and so great first story. I I love
38:21the the AI story is always great because a lot of times people just talk about the end product. >> We haven't had a lot of research papers to talk about. >> No. It's it's kind of cool that like, you know, we got a sort of, you know, look under the box to see to see how it all worked. And they and they were also forthcoming about some of the challenges that they had. Like they um, you know, when they when they first started out with Deepseek R10, yes, which is the one that they didn't release. They were having this trouble where like the output would be like half Chinese, half English, >> right? So then what they did was they had cold start data. So it wasn't completely all blind reinforcement learning. What they did was they primed the model with human data, okay, to to
39:04actually sort of give it a running start and not have it like from the very beginning start doing random random stuff. Mh. >> So what you do is you can have a small subset of humanlabeled training data that like creates a sort of >> neighborhood of parameters. Okay, where where okay like the the model sort of settles in on this neighborhood of where the numbers should be for all of these weights and then you can fine-tune it. >> And finetuning is is a coarse grained word because obviously like a lot of training was done afterwards. But like after that initial sort of like okay don't do like the stupid stuff of like half Chinese half English but then now get into the you know how do you problem solve? How do you how do you how do you
39:45actually make a really nice LLM? So, so they were forthcoming about some of their challenges, which I think is is kind of interesting. >> And again, it goes back to the sort of the narrative violation that the current CCP has put ourselves in where in the US, we're still viewing their operating system as what it was 20 years ago. But they are being nimble in understanding the changing environment and trying to reposition. >> Yeah. >> Again, you can argue that it's contrived or not. >> Yeah. I mean, you know, knowing China, of course, there's stuff that we don't know about, right? Of course, probably like Deepseek is entrenched with the CCP. I'm just saying, you know, like I'm
40:28just saying it's probably true. But they're doing the work. They're they're publishing peer-reviewed papers. They're they're, you know, coming out with cutting edge AI and they're doing it without the H100s or at least not with the kind of access that, you know, companies have in America. Perhaps they do have H100s from shell companies in Bhutan or whatever, >> which is which is one of the arguments that is that they've been doing this illicit market trading in order to get access, but the point is they don't even need it. >> Yeah. Yeah. It turns out like, you know, people people are now now that this is out, they're going to try using these strategies now and we're going to see if if the rubber meets the road, you know, >> and you know, now since
41:10Deep Seek came out, >> uh, Meta was already releasing openweight models and they've I think they've actually incorporated some of the mixture of experts architecture into the llama models. I think people are taking this sort of reinforcement learning strategy very seriously too where they're saying okay maybe I don't need a bunch of Kenyans to just keep annotating my outputs right >> correct and we now just in the last month and a half have an open-source open AI model and it is very easy to argue that we would not have >> an open >> weights open AI model without deepse >> there was not an incentive Why would they do it open to do so? But they had
41:52to answer to investors and the competition, etc. Great, great update here. We'll definitely be touching on AI more. >> We're going to go to our next story, which I'm very excited about cuz I don't know what any of it means. >> Um, the headline on our second story, scientists just made the first time crystal that you can see. We have an ocarina of time. Yes. Physicists at the University of Colorado Boulder have created the first time crystal that humans can actually see using liquid crystals that swirl into a neverending pattern when illuminated by light. They put out their paper in nature materials. There's been a lot of coverage of this one. I always see all these Tik Tok. I really love it. >> Time crystals and all this.
42:34>> Yeah. It's very Marvel, very Doctor Who, you know, like this is how we beat Thanos. >> Mr. Str Doctor Strange. >> Yeah. All sorts of Yeah. So, so help me understand, you know, what exactly is is going on with this time crystals paper. >> Yeah. So, well, fir first let's talk about what are time crystals. >> I would like to know that. >> Okay. So, before we even do that, normal crystals. Okay. We talked about diamond the other day. >> Yes. >> Um, the simplest crystal I can think of is table salt. >> Okay. >> NaCCl, sodium chloride. Um, you can imagine there's a sodium atom and a chlorine atom. sodium atom, chlorine atom, sodium glad atom, chlorine atom in this regular sort of chessboard like
43:14structure but a 3D sort of chessboard of uh sodium chlorine sodium chlorine. The reason why this is a crystal, right? What characterizes it as a crystal is you've got a discrete space symmetry breaking. Okay, this is a technical term in physics that just means if I take the crystal and I move it over by one >> spacing, I will get the same thing back. >> Okay. >> Okay. You can imagine I've got the NA the NaCCl and then there's another NaCCl here, right? I can take that entire crystal and move it by a whole molecule and I'll have the same thing repeating, right? Just like in a chessboard, right?
43:54Imagine an infinite chessboard. That thing is a crystal in some sense, right? It's a 2D crystal because there's black, white, black, white. If I if I take up the chessboard and I move it over two sort of squares, I'll get the same exact chessboard. >> Right? So that's what's called uh symmetry breaking in space. >> Okay. Where it's no longer continuous because you can't just arbitrarily move this thing around. You have to move it by the lattice spacing, right? The lattice constant of the crystal. >> Yes. >> So that's what makes it a crystal. Okay. >> And it's also resilient to forces and stress, right? Like a diamond, for example, great way. I I put stress on it. The crystalline structure of the
44:35carbon atoms isn't really going to change because the the way that these carbon atoms are bonded to each other, they're resilient to like push and pull, you know, heated up that >> that structure is going to be resilient. Yes. Right. So, there was a guy Frank Wilchek. He was a Nobel um laurate. He won the Nobel Prize in 2004 for discovering something called asmtoic freedom, which has to do with the ways that quarks um behave inside the atomic nucleus. Um we can get into that some other day. >> I think we need some asmtoic freedom in the US right now, but that's a whole another story. >> That's a whole another story as well for another day. But um he he won the Nobel Prize in 2004 and he's been very active
45:15in physics ever since. He's discovered things called axons and like he's done stuff with cosmology. Um and one of the things that he proposed back in 2012 was this idea of a time crystal. Okay. So he figured it's it's a very interesting quite simple argument. Okay. He said that the laws of physics are symmetric to space translations. Right? Meaning if I do a if I do an experiment here and then I you know take up the experiment and I move it somewhere else the results of the experiment should be the same right if if all the environments are the same and that's because there's no special coordinate in the universe right
45:55there's no like like there's no like oh it's just like here is where where things happen right there's no um there's no special spatial coordinate well similarly the laws of the universe are also symmetric in time Right? If I do an experiment now and then I do it the next day, should be the same. >> So if we have things that break spatial symmetry >> by creating crystals in space, right, where you have clearly like carbon >> making the diamond or NCL making table salt. So you clearly have spatial crystals. What if I have a breaking of the time symmetry to create a time crystal? And what would that look like?
46:36What what that would look like is you've got some kind of periodic system that returns to its original form >> periodically, right? So, just like how with a space crystal like the chessboard, I can take it up and I can move it in space and then put it back and it'll be the same thing in time. For example, a sine wave, right? Mathematically, a sine wave is >> symmetric in time to that >> period, right? I can pick up the sine wave. I can move it one entire period and put it back and it'll be the same sine wave. >> Yes. >> I should be able to have that >> in like the physical world. >> Okay. Because you know >> it's it's kind of same same
47:18theoretically >> theoretically it should be positive and it kind of makes sense. If if I have the same sort of symmetry breaking in space I should have the same sort of symmetry breaking in time. Well, it wasn't quite that simple. Okay. So right after he published that it was it was you know Frank Wilch is doing this Nobel Prize winner he's very famous physicist. So everyone's like okay is this possible and actually it turns out the way that he had envisioned it is not >> okay >> so um people came out and they published something called the no-go theorem for time crystals which was that Frank Frank Wilch's original idea was that this time crystal is going to be in the ground state which means it's in its lowest energy state there's nothing pumping on
47:59it it's just you know crystals can be in their lower energy state right I can cool a crystal down to like near 0 Kelvin and it's going to remain in its crystal form. And that's what really like that means that it's an inherent property of the of the material itself, right? And it's not something that coming from outside creating this order. >> Mhm. >> Frank Wilchek's idea was that you can have a a system that is in its ground state, right? In its lowest energy state, there's nothing coming in and it's still going to behave in this sort of periodic manner. Yes. Okay. That turns out can't be the case. Okay. Okay. So the no-go theorem said that a true equilibrium ground state cannot have persistent periodic motion. Meaning like
48:40if you've if you've cooled something down to its ground state, it's going to be stationary. And that kind of makes sense, right? Because if it's moving around in its ground state, that means there's some kinetic energy that I can extract and it's not really the true ground state, right? Okay. So that's fine. But then people started wondering, all right, fine. I don't need something to be in equilibrium at its ground state. What if I pump it with stuff? Can I create a crystal that way? What if I pump it with energy? So, it's now a non-equilibrium state like there's there's energy coming in and then there's energy going out. But the way that this energy is transformed inside the system creates this periodic motion within the system, right?
49:20>> Turns out that was possible. And for the longest time, people were studying these things called discrete time crystals. um they were systems that were kept out of equilibrium by this outside force. And it's not as simple as just like you just pump it rhythmically and then this thing goes by that you know then it's like oh like me on a swing like doing my legs is a time crystal like me at the playground is a time no that's not it's not quite as simple. What you need is you need you need the the pumping to be done at a certain frequency and then the the crystal itself is doing it at a different frequency. Maybe it's at a harmonic right? >> And um there were specialized quantum systems that could do this, right? There
50:02were nuclear spins, trapped ions, cold cold atoms at extremely low temperatures, quantum weirdness, you know, it's like cool, >> but it's cool, but that's about it, right? Like maybe in a hundred years it can it can lead to like, you know, quantum devices and things like that. This paper is very cool because it's doing it in a classical system which means no quantum weirdness >> and it's doing it at room temperature. >> Wow. >> And it's doing it at a big enough scale that we can see with our naked eye. >> This is giving me LK99 vibes. >> It Yeah. But this is out of UC Boulder. >> Yeah. So it's legit >> and so it's pretty legit. UC Boulder has
50:42probably the best department out of anywhere in the world. Okay. Atomic Molecular Optical. Those guys, those guys do it. >> Let's invest in our university research institutions. >> Like I mean, you know, Boulder has like the most PhDs out of any out of any city. >> I heard this recently. >> Yeah. And a lot of it has to do with UC Boulder. Out of UC Boulder came NIST, which is the National Institute for Standards and Technology. There's a bunch of other science labs just in Boulder. UC Boulder itself has like four Nobel prizes in physics just for Okay. like not like, okay, there's one for cosmology, one for it's just all like in the lab making like materials, right? They they they made the first Bose Einstein condensate. They're the ones
51:23who figured out how to trap ions using lasers and cool them down using lasers. So, they're a very good So, when a paper comes out of UC Boulder and it's an AMO, it's like, okay, these guys probably talk to their department and if it didn't pass like their >> Yeah. Yeah. Yeah. It's like so so it's it's it's a really cool little thing that they've made out of liquid crystals. >> Right. These are the LCDs. >> Mhm. >> And and they made a a microscopic time crystal. Okay. The and and what you can do is what's really cool is first of all you don't need a laser or uh oscillating magnetic field like in those old
52:04>> time crystals. In the old ones, you needed a quantum system and you needed a laser which means coherent light of a single frequency and then you or like a magnetic field. It's oscillating at a single frequency and then that sort of >> you know drives this quantum system to to do this periodic motion. This is just like a light. You just shine a light on it and then it uses the energy from that light to create this periodic motion. Okay. And um it just uses LCD like liquid crystal technology, pneumatic liquid crystals. So, the way that liquid crystals work, like you know, you've used liquid crystals before. Um, it's it's a really simple technology. It actually won the Nobel Prize. Um, the idea is, so what does it mean by a
52:45liquid crystal? Okay, a crystal you usually think of as a solid. >> Yes. >> Right. A solid meaning you've got atoms in a regularly spaced pattern and they don't really move. Mhm. >> In the liquid crystal, you've got molecules that are all sort of uh you can think of them as like rods, many tiny rods. They're molecules that are elongated and you can manipulate their direction using an electric field. >> Okay. >> Okay. So, if you put an electric field in this direction, all of the molecules align in that direction. And you can have an electric field in this direction, which means all the molecules align in this direction. And what these molecules do is because they're small
53:25enough, they can actually influence the propagation of light. >> Okay? And so that's exactly how liquid crystal displays work. What you do is you have a backlight, >> okay, that like lets and then you have a polarizer that polarizes all the light. So all of the electric fields are propagating in one direction. >> And what you can do is you can have a liquid crystal interface in between another polarizer. So now if the light gets to the other polarizer and it's polarized in the same direction, it's going to be let through. But if the light is polarized in a different direction, in the perpendicular direction, then it's going to be blocked. And what you can do is use an electric field to manipulate the liquid crystals in the middle
54:07>> to influence the propagation of light. >> That's the fundamental technology. That makesense. Okay. So you can have an electric field that sort of rotates the light and then if it rotates in exactly the right way then the light is going to go through and I'm going to see something. >> But if there's no electric field or if I make the electric field this way then all the rods are going to be um you know sort of in the perpendicular direction the light is not going to rotate and I'm going to get blocked. Yes. >> And that's fundamentally how liquid crystals work. There are these they're liquid in the sense that you know just how in a liquid the molecules can move around. In this case, these liquid molecules, these rod-like molecules can move around and they can be controlled by an electric field and they can be controlled by
54:48light itself. Right? So they figured what I can do is I can create a liquid crystal and this liquid crystal has exactly the right properties where it can sort of act like a giant sort of I guess okay so this liquid crystal can be can be oriented in such a way that it when when it's shined on by light >> what you're going to get is deformationations in the crystal. Okay, tiny little deformation. So what you can what you can imagine is let's say all of the liquid crystals, all of the the
55:28these rods are oriented in one direction. Okay, >> and now what I do is I introduce a tiny kink in this lattice. So they're all oriented in one direction, but I've taken like a tiny little neighborhood and I've like bent them in in a certain way. Okay. What you can do is create a material such that that bend which becomes this sort of topological defect. Yes. This like idea of like okay this neighborhood has a tiny little bend or a twist. That twist can then influence the stuff around it which can influence the stuff around it which can influence the stuff around it. And what you get is this sort of traveling wave of disturbance. >> Yes. >> Okay. There what they're what are called topological solutons in physics. this
56:10idea that like I've got this like disturbance and that disturbance kind of acts like a particle. >> Okay? Because um it travels the same way as a particle. The orientation of that disturbance can have a charge in the sense that if I >> twist it clockwise, then it's a plus one. And if I twist it counterclockwise, it's a minus one. And that charge is conserved in the same way that sort of charge is conserved if I were to have like electrons moving around, right? and they can cancel each other out kind of the same way that charges cancel each other out, right? So they created this thing and they actually did the numerical calculation. So they they they wrote down an equation for how these
56:50solutons would interact with each other and all of these deformations act like little quasi particles that interact with each other and have a physics to themselves >> that is an emergent property of the little tiny rods themselves. that initial disturbance that has now created a cascade that is now independent of the initial source necessarily being >> Yeah. And and it's like it's on top of the rods themselves. The rods actually aren't the particles anymore. It's like the the way in which the rods are oriented becomes a particle mathematically, right? You can like describe like you can describe the twist
57:31itself as this thing that propagates rather than the rods cuz the rods are just staying where they are. >> Right. >> Right. That's what the crystal part of it. >> But the the the way that the rods move that disturbance moves around like a particle. >> This is really >> which is kind of cool. Right. >> No, it's very that's like very interesting. >> Yeah, dude. Solatons have been around like I think in the 1800s there's this British guy. I forget his name. Um maybe we'll put it up. Yes. But um it's a funny story because what he saw was he was he was you know these British physicists back in the day very rich, right? So he's on horseback in the countryside, right? And he's like he's like on horseback and he sees a canal and then there's a boat and the boat
58:12like breaks suddenly. Okay. And when the boat breaks suddenly, >> it created this wave and he noticed that the wave just kept propagating. >> And then he was on horseback and he's got nothing to do. He's probably, you know, got a estate that like gets him money like in Downtown Abbey or whatever. So he's like, "Fuck it. I'm going to I'm going to follow this wave." And he followed it for 2 miles. >> There was a wave that kept reinforcing itself and it acted kind of like a particle, right? In the sense that the wave didn't really dissipate until 2 miles later. And he could follow this thing and he discovered the first soliton. There's a little plaque where he lived where it's like, "This is the guy who discovered the first soliton." And um ever since then they've been
58:54observed in all sorts of sort of material sciences. You've we've observed them in biology and quantum systems. And this is exactly one of those things where it's like there's a wave that's being propagated and that wave sort of reinforces itself because of the way that the the the medium itself works. >> Works, right? You know, right? It's it it is a combination of that input and the structure of the medium. >> Yes. Exactly. The liquid crystal. Yeah. Uh and the structure of the liquid crystal crystal enables it to continue the propagation of the wave independent like as as a as an as an emergent property of the structures initial conditions. >> Exactly. Yeah. Yeah. And so they they they figured that they could use this to
59:35make a classical time crystal because this is not quantum. This is this is just the the rods themselves are like you know multip many many atoms big. So these guys are interacting through just classical effects. Yes. Right. And so what you can do is you can have a liquid crystal embedded inside glass, right, that have these two layers. And as one layer sort of moves, it influences the light on the other layer and then that thing moves and there's this feedback cycle, right? And that feedback cycle is what creates this propagation of the time crystal. And it's it's really a space-time crystal because what you're seeing you you can actually you can actually look at the videos and you can see like this the the colors move.
1:00:19>> Mhm. in real time and and the wavelength is like you know about half a millimeter to a millimeter which means you can see it with your naked eye and and it's moving through this liquid crystal in this sort of propagating you know traveling wave right >> and it it it was huge because one one of the one of the big things that defines a crystal right is it has to be as I said before um crystals have to be resilient >> yes >> to stress right okay if I take a diamond and I press it or I heat it the diamond is going to retain its temperature. So, how did they actually test that here? Well, what you can do is you can like poke it. >> Yeah. >> And the the the pattern stays, which
1:01:00means that it is a two true time crystal, >> right? It is resilient to the poking the poking of it already has. >> Yeah, it's got some time crystal going through and then when I poke it, the time crystal sort of like it recovers where I poke it. Of course, it's going to like mess up, but I remove it and then the the the the crystal regains its properties. The other thing they did was they would they would um vary the brightness of the light because it can't be that like you know it depends really heavily on the brightness of the light. So they they randomly varied the brightness of the light. the crystal kept going which means that what what this is is really an intrinsic property of the material itself rather than the drive that's coming from the outside. >> Yes. Yes. Yeah. No, that that's a very
1:01:41that that's exactly that. >> And and and then the final the final nail in the coffin for me was um what they did was they would turn off the light and then that they would turn it back on again. And if this is not a true crystal, if this is simply a response to the light, then when I turned it off, I mean, sorry, when I turned it back on, the crystal would start up at exactly the same phase every time. Meaning, I turn it on, 5 minutes later, the same pattern, I mean, sorry, 5 seconds later, the same pattern emergence as at exactly the same spot. M >> but what what would happen was they would turn it off and then they turn the light back on and it would randomly order itself. The same crystal would
1:02:23start but at different starting points in that wave. Do you see what I'm saying? Like the phase offset was completely random which again tells you this is not a property of the outside drive. It's a property of the of the material itself. So this is truly a time crystal that is macroscopic and it's something we can see. This is this is I mean this is so this is this is really fascinating. >> It's really cool and and like okay you might be thinking okay this is like this is cool right? >> Then I got into reading about the applications. >> Okay. Okay. The applications for this are like like science fiction to me. Okay.
1:03:04>> Most of them have to do with like cryptography and security. Okay. First one I'll tell you about. Imagine we make this thing cheap. We can stick it on a dollar bill. >> Oh, right. As a as a cryptographic signature. >> As a cryptographic signature. Now, if you want to test whether your Benjamin is a real Benjamin, you take your iPhone flashlight, stick it on there. It's going to have this pattern, right? Because all it needs is an external drive. And the pattern is we can make it really hard to duplicate, right? So, you know that strip that's on the Benjamin? We can have that strip be a time crystal that like like literally like like
1:03:44>> propagates. Yes. Right. And then you'll know, okay, that's a real one. >> It has a signature that only >> and it's going to be so hard to duplicate. >> Right. Right. >> Right. >> Right. That that's >> that's so cool. >> No, that's very I this that's actually really >> Yeah. And the other one is like 2D like so you know usually we have 2D barcodes like a QR code is a 2D. Now you can have a 2D plus one barcode. You can have you can have um a QR code that is 2D and then when you shine a light on it, the QR code itself changes into different >> QR codes. You can have multiple QR codes on top that have different periodicities so that like let's say one is like two
1:04:26seconds and the other one is 3 seconds and the other one is 5 seconds. Well, then the next time that it's going to become a full QR code is going to be 5 * 3 * 2, which is 30, right? So, you're going to have to wait 30 seconds to get the actual QR code. Right. You can you can imagine you've you've you've like you've introduced a whole new dimension. >> Yes. >> To to security, >> a manipulatable dimension. >> Yeah. And and and the whole point is this is this is at room temperature, >> right? >> And it's macroscopic macroscopic. It's something I can see. I don't need a a telescope or like weird ions and lasers to actually Oh, look. It's doing the thing. >> This is why I made the the LK99
1:05:08reference, not because of whether it was real or not real, but because it's room temperature and macroscopic. And the reason why that's material is that means >> the the the the transition from theoretical to production application. >> Yeah. Now, we just got to make it cheap, which is honestly kind of like the easier part of the innovation, right? Exactly. You know, it's an engineering problem. >> Yeah. Now it's like, okay, cuz we can make LCDs real cheap now. >> Right. Right. Right. This is >> And like this this, you know, it's not it doesn't need a power source. You just need to put it on there. The power source is the light that I'm going to shine on it. >> It's kind of cool. >> I'm seeing from the um from the abstract here. uh their potential uh techn uh
1:05:49technological utility includes optical devices, photonic space-time crystal generators telecommunications anti-counterfeiting design and again this is just a first we haven't even talked about >> yeah I mean I only I only talked about the the anti-counterfeiting and the security part but yeah as you said devices >> all sorts all sorts of implications in terms of what we can get out of now this fundamental >> um like implementation exper experimentally at room temperature in a macroscopic form, which is >> Yeah. I mean, there's a reason why it was like picked up by so many news outlets right? >> Yeah. Yeah. It was curved by this is quite a big deal. Yeah. >> This is quite This is quite good. They didn't get the They got nature materials. They could have put it in
1:06:30nature, but they said we put in nature materials. >> Uh >> they probably tried in nature first. Usually everyone does. >> First time crystals that you can see. >> Really interesting story. And the background is also >> helpful to understand. and we live in LA, so we know a lot of people that like to talk about crystals. This is a little bit different than those crystals. >> Mhm. >> Um, >> yeah, this one actually works. >> Speaking of California, for our third story, we're now going to move into the immunology space. Headline, hidden viruses in our DNA could be medicine's next big breakthrough. Scientists at La Hoya Institute for Immunology, when they're not out surfing on the beautiful sand beaches of San Diego, have decoded
1:07:12the 3D structure of an ancient viral protein hidden >> within our DNA, our own DNA. >> Our own DNA. This protein found on cancer and autoimmune cells has a unique shape that could unlock new diagnostics and therapies. This was published in Science Advances. Um again this is uh another California university. We have the most papers, the most patents, the most laureates. I just always have to make sure people know that we are winning. >> Yeah, we are winning. We are we are winning. This is La Hoya, California, baby. It's um it's right next to UC San Diego. UC San Diego is an amazing amazing crucible for biotechnology and
1:07:54molecular biology research. It's kind of like the Silicon Valley for biology in some sense. Um, and this is a really groundbreaking achievement. It's the first time that we have ever published the structure of a human endogenous retrovirus. Okay. And this is a virus that hides within our own DNA. You and ours. >> I didn't even know that was possible. >> Yeah. This is crazy, dude. 8% of our DNA >> is viral indogenous DNA. 8% of our genome, approximately 98,000 annotated insertions are viruses that are like infiltrating that have infiltrated. >> Mhm. >> Dude, it's it's they're like they're like sleeper cells. Dude,
1:08:35>> I was this is when people say the aliens uh manu uh created us. But look, this is exactly what I'm talking about. The little viruses are there writing our stuff. >> It's crazy. It's crazy to think about. So So first of all, I was like I was like, how does this even get in? Why is this in my DNA, bro? Right. like what what's going on? Okay, so it's it's crazy. These things are called retroviruses. >> A retrovirus is a is a virus that has instead of using DNA as its genetic material, it uses RNA as it genetic material. And what it does is when it infects a cell, it uses something called um reverse transcriptise. Usually transcriptise goes from DNA to RNA. This is the reverse process. So it's taking
1:09:16RNA and it's making doublestranded DNA. So that's reverse transcriptise. And then what ends up happening is that reverse transcriptise goes inside the nucleus of our cells. Yes. >> And then there's something called integrace which is another viral protein that takes that DNA that bit of viral DNA and sticks it inside our chromosomeal DNA. Now if this happens to our skin cells, okay, we got like some viral DNA. But if it happens to our sperm and egg, now the next organism that gets that sperm and men egg, >> the enti all of the DNA has it >> is going to have it, right? These are called germline mutations. >> I was literally going to say it's kind of going back to our crisper story. It's the germ line. >> It's the germline mutations, right? So
1:09:57this is a germline insertion that happens. And then now the virus becomes something called a provirus, which is something that's just hanging out in our DNA. 8% of our DNA, >> it comes from this. >> Comes from this, dude. That's 1 in 12. That's like a lot. >> That's a lot. >> That's a lot. >> I had no I had no idea this was even a thing when we first put the store in the show notes. >> I was like, "This is fascinating." >> Yeah. Yeah. Yeah. So, all of all of that junk DNA 8% of that is is is viruses just hanging out. Okay. Now, most of these viruses, they get mutations over the years and they become inactive. Okay. But there's a specific um virus called the human endogenous virus K. >> Mhm. >> The Herve K virus. >> Herv K. It's a provirus now because it's
1:10:38within our DNA. But this thing is the most recent infiltrator. Okay? And it's because it's the because it's the most recent infiltrator, it has the fewest number of mutations, right? Which means it's still a problem. >> Okay? >> And it actually So in most um in most healthy cells, there's epigenetic silencing. Okay? Our our DNA has figured out I don't know who you are. Yeah, >> I'm going to I'm going to just put a bunch of like random stuff on you so that no one ever transcribes you into RNA and then you become a protein. Okay. So, our DNA is very good. If you're healthy, the cell is healthy. It find it's like I don't know what this is. >> It's like a bouncer at a club. >> Yeah. It's like you're already in here,
1:11:20but you're cut off. >> You know, it's like I don't know how you got in, but no more drinks. Okay. Every once in a while you get something like a cancer cell >> or you get um autoimmune disorders. >> Mhm. >> The cell is losing control and this virus can start acting up. Okay. So it's actually been detected this Herve K envelope the envelope protein that is the the the protein that encodes for the envelope of the virus. That's the thing that's snuck in, right? that has been known to be expressed in cancers like breast cancer, ovarian cancer, prostate cancer, melanoma and also in autoimmune disorders like lupus, um diabetes type
1:12:021, um SLE, these kinds of autoimmune disorders, you can actually see the cells that are affected express this Hervek protein, which means that it is actually a problem. Okay? Right? Which means it needs to be solved. Yes. Okay. And in biology, like half the battle is solving the structure because all of biology is lock and key, right? You solve the structure of the thing, then you can figure out what other structures can latch on and like mess with it and like >> inactivate it and things like that, right? So the first first battle is to actually solve the structure. >> Solving the structure for this thing was really hard. Okay. >> Okay. because it's this envelope protein
1:12:45of a, you know, it used to be back in its heyday, right, before it snuck in and now it's like just like an inf infiltrator. Um, back in its heyday, it was the envelope protein for a retrovirus, right? And these envelope proteins are incredibly finicky by design. You want your envelope protein to be finicky because at if imagine you're a virus, right, and you're getting to the outside of a cell that you want to infiltrate, you want the protein to first be able to infiltrate through the membrane and then when it's in the membrane change its confirmation >> to open up, >> right? So, you want this thing to have this sort of metastability is what it's called where you've got two states.
1:13:26There's this prefusion state >> and then a postfusion state. Right? Prefusion meaning like how do I get in? Post fusion how do I >> you you have the Trojan horse go to the gate in one state and then when it's inside the gate it's open >> open up yeah right so so you want this metastability >> now that becomes a real problem when you're trying to get structure >> yes >> right because you can imagine you're you're trying to image this thing but this this thing is in two different >> confirmations so like you don't know what you're looking at and it's just annoying right so that's that's the the big thing that this group >> solved Okay. What they did, the first thing they did was they they took the the protein itself and they put in um
1:14:09they they tweaked the protein in a certain way that they could like they created these things called dulfide bridges which are basically like staples on the protein. What you do is you create you put in cyine which is this particular amino acid that has sulfur atoms and those sulfur atoms can find each other and sort of bond. So you you you create a a more stable protein. >> Yes. >> That is still very much like the original protein. It it still preserves a lot of the structure but it prevents the protein but from doing this finicky stuff. >> And then what they do was they use uh a groundbreaking technology that won the 2017 Nobel Prize in chemistry >> called cryo electron microscopy.
1:14:51>> Okay. >> Okay. >> It used to be called blobology. >> Blobology. >> Yeah. From all the detractors, all the people who would make fun of these crym people. It was called blobology because back in the day what you do is you get a protein and you like image it with electron microscope. Yeah. >> But because of this problem of like you know the the proteins move around and and then they're not stable and all this other stuff. Um and >> you would get blobs giant blobs and you be like it kind of looks like this. So all of the X-ray crystalallographers and the NMR spectroscopy people they're like look at these look at these blobologists. Right? Because with X-ray crystalography and with NMR, I can get
1:15:32down to atomic resolution. I can get to two or three angstroms of resolution where I'm like that atom is there and it's there. >> The problem with X-ray crystalallography and NMR is it's really good for soluble proteins. So proteins that are found, you know, within the cell doing their thing, but for these transmembrane proteins, it's very hard to crystallize. It's very hard to make them behave properly. >> Cryom was a technique that probably could have been used for that. Along came the computing revolution >> and now all of a sudden what you could do is you could take thousands of images >> in cryoem what you do is you have a bunch of proteins that are sort of frozen in this state >> um using this thing called vitrius
1:16:14>> freezing >> where you're not like freezing it with ice because if you freeze it with ice the protein is going to like misfold right so you do this like weird like >> sort of vitrius freezing where the protein retains it structure you image it a bunch of times and And then you feed that thing to a computer. >> Yeah. >> What you're getting is 2D shadows, right? The proteins are in different orientations. You get a bunch of 2D shadows, but a computer now can take all of those 2D shadows and say, "What is the 3D thing that would create all of these 2D shadows?" >> Right? In 2012 was the big one when it came out. And there was finally a protein that Cryom had solved that no one else could solve with any other technique. And they solved it to three angstrom precision. And everyone was
1:16:55like, "Oh, oh, it's here." And then they won the Nobel Prize in chemistry. It was um three guys, Wim Frank, Yakis Dubos, and Richard Henderson. >> Um so blobology now became like a Nobel Prize winning technology. >> Ain't no ain't no bunch of blobs now. Where's your Nobel? Huh? >> I think they were I think they were very uh vindicated when when they actually got it right. So these guys they actually used the um cryeleron microscopy to get the data from this after having messed with the protein to create these staples and and make it sort of stable right and this was a very big deal because now you've got the 3D
1:17:35structure for this thing you can compare it with other retroviruses that have been solved like HIV like SIV and this one is very different because this the the the protein that they came out is like taller and skinnier than the HIV protein which >> is interesting in its own right because now we've got this difference. We can now start creating antibodies to actually target this thing. This >> lock and key thing you were just talking. >> Exactly. And that's what they did. They weren't done. They created monoconal antibodies to actually target this thing. And what they could do now is you can actually have diagnostics where >> you know in autoimmune disorders for example, right? you have these neutrfils which are these kinds of immune cells and what they do is they um they they're
1:18:17they're expressed in these cells and then in an autoimmune disorder now your immune cells think that oh this is a bad cell I'm going to attack my own cell right >> so maybe now that we know the structure >> we can actually like prevent that from happening >> right we can we can train the immune system or maybe cloud the these antibodies in such such a way that the immune system no longer attacks its own. >> On the other hand, we can also have ways to early diagnose certain cancers because cancerous cells express this protein >> specifically >> specifically, right? So if we get like a blood sample from somebody, we can have an early diagnostic where you have these
1:18:59monoconal antibodies that'll go and actually attach to these cancerous cells and you'll have a marker now be like, "Oh, I see this herve K protein that shouldn't be expressed." In a healthy cell, the epigenetics should totally silence it. >> And it's not. >> But the bouncer is not working, right? So now now I can I can I can start therapies earlier. >> They're they're still in the club getting too drunk. They haven't been cut off. So, let's go ahead and >> let's go ahead and and and try to figure out how to get these guys out. >> That's really It's the first time that we've done this. >> And the idea is now that we've done it once, but by confirming that this methodology is a means by which you can do so, this can likely be extended to
1:19:39other ones. This is the most recent and all these. >> Yeah. And this this is the one that's like most prevalent. But the the idea of like sort of changing a protein shape using these editing mechanisms where now I can have this like staple dulfide bridge that sort of >> stabilizes it such that I can now do cryolem. This is a this is a pretty interesting technique. The same group um actually had done it for other proteins and then they tackled this one because this one's hard, >> right? This one's like >> if you can do it with this one. >> Yeah. >> Then it's like, okay, now it's like a >> now we can >> um fascinate. This this >> it's a cool one. >> I I I always love our our like microbiology imunology stories because
1:20:20people don't understand how well we can uh look at and analyze and understand things that are really really really small. >> Yeah. Like we can we know exactly where to put in the cyine so that the sulfur staples to another sulfur but it doesn't really change the rest of the structure. That's like to to you know have like this thousands of atoms worth of protein and know exactly where to put this thing so that I'm just going to clip this part. >> Yes. >> Because that's the part that's like getting messed up. I would like our next Department of Health and Human Services Secretary to be able to describe in detail any number of these concepts.
1:21:00>> Yeah. >> Because that is usually a good prerequisite to say you're going to actually understand the import Yeah. of medicine for public health. >> Exactly. >> But but that that's a good I like that one. I like that one. And we we've touched on crisper a lot on this podcast. We've touched on a variety and it's again it's interesting again all of these innovations are happening simultaneously in these cross-domain areas that have not only independent value but also like collective value >> as we move into what we're seeing is going to be this like >> biotech revolution. >> It is it really is. We're here >> for whole AI applying the tools the fundamental hardware tools the
1:21:41creativity of how we're problem solving. Um, we're going to we're going to go to our last story, which is a lot of times like do from really really small now to like really >> now we're getting really big. >> Now we're getting really big in space. Uh, California again, California forever goodbye. Headline, brightest fast radio burst ever detected could help solve an enduring cosmic mystery. I love how people with headlines make it so unclear what you're talking about. Summary. Researchers at University of California, Santa Cruz, we're going to Northern California, use newly def uh newly developed chime out trigger telescopes and deep space imaging to challenge long-held assumptions about what causes
1:22:23these mysterious cosmic signals. I think we talked about one of these, if I'm not misremembering, the WOW signal was one of these uh like radio burst. >> It was a radio burst, right? we initially saw and everyone freaked out was like aliens. >> Yeah, >> it could have been. And that's not the we haven't characterized that as a fast radio burst. >> Fair because we don't really know what the hell that was. >> That's fair. That that's kind of like what was that? >> Yeah. What was that? >> Fair. No, that's fair. That's fair. But it seems like we're we're now using again the tool some of the tools we have. Also, this was in the astrophysical journal letters. Yes. Uh in terms of the publication, CNN has covered this. >> Uh UCSC also covered it in their own
1:23:03blog. Um it's a collaboration between UCSC, some Canadian institutions, Northwestern. Um it it was a pretty big collaboration. >> That's we again cuz we need it. Okay. So what what I don't like what are cuz you and you cuz I mischaracterized. What is like this fast radio burst idea? What did they do? Yeah. Why like how are they >> why is detecting a bright one relevant? >> Yeah, this one's this one's incredibly bright. Okay. this thing this thing within a fraction of a second output um as much energy as the sun does for like 4 days. Okay, but that's this isn't even the brightest. Okay, this is the brightest we've had because it's the closest one to us. But fast radio burst,
1:23:43the first one was ever discovered in um 2007. >> Mhm. >> It was called a Laurimmer burst. It was actually taken from archival data from the Parks Observatory, which is a giant 64 meter radio telescope in Australia. It's um been called the greatest scientific instrument that Australia has ever produced. >> Okay. >> The greatest scientific instrument that Australia has ever produced. >> Um and >> it's the same dish actually was used during the Apollo 11 um broadcast to like broadcast to the TVs around the world because um NASA had like a thing at Goldstone. Yes. and that they were using, but this one was way bigger and
1:24:24the TV signal that they were getting from this one was just better than the rest. And so NASA just used it for the whole 2 and a half hours, >> which is kind of cool, >> which is why the Five Eyes Ally, you know, >> structure. Yeah, Australia. Yeah, they got our back when we need it. So, you know, they were on the right side. They were facing the moon, so that was nice. Yep. Um, so this burst was discovered by Duncan Larmar from West Virginia University. Basically what he did was he assigned an undergrad to look at archival data from the parks observatory. Okay. And the Parks Observatory at the time had just released a bunch of data. It was a radio telescope that was just beaming up. And um this undergrad would come in every
1:25:05week and despite all of his classes and stuff, he would look at a bunch of data by hand and try to characterize it and then try to find something interesting. And he found something very interesting. There was a brief millisecond duration, 5 milliseconds, >> but it was ridiculously bright. On top of that, it was not only bright, it had this very good characterization called dispersion. >> Okay, dispersion is the idea that >> when light moves through a medium through stuff, different frequencies are going to propagate at different speeds. This is fundamentally why we get a rainbow. Okay, violet light actually propagates at a slower speed in water
1:25:48than red light does. Okay, and because of that, when light goes into a water bubble, the violet light is going to bend differently than red light, and that's what's going to cause the rainbow to come out. Okay? And then it gets like sort of focused, and we get a rainbow. But the prism is the same idea. When it goes through glass, violet light goes slower, and so it's going to bend differently. Dispersion is this idea that there's a frequency relation to how fast light moves through medium. And in interstellar background, right, in the interstellar medium of these ionized particles, right, where it's like atoms without electrons, electrons moving around freely, um you're going to have that opposite effect. You're going to have
1:26:29slower slower light, so slower frequencies moving slower than the faster frequencies. just has to do with the different physics that goes on between a glass and a plasma. But at the end of the day, >> what that means is if there's a transient burst of light, the faster stuff is going to arrive first and the slower frequencies are going to arrive later. And that's what's called a dispersion measure. >> Okay, >> this thing that they discovered in the parks observatory data, which is now called the Laurimmer burst, had this very specific dispersion measure which showed that it was of extragalactic origin. Okay, >> there was so much dispersion that meant that there was a lot of stuff that it had to get through
1:27:10>> to create >> to actually create that delay between the fast and the slow. And then when they back calculated how bright this thing must have been >> to be that far away, they were like, "Oh, this thing was incredibly bright." This was back in 2007. Since then, we've discovered multiple. There's been some that we've discovered where for that brief millisecond duration, this fast radio burst was brighter than the entire galaxy that it came from. >> Wow. Okay. >> Okay. >> So, >> it's been it's been it's been quite an insane sort of last few decades of trying to find these fast radio bursts, >> right? >> The problem is they're really shortlived,
1:27:51>> right? >> Okay. 5 milliseconds, >> unlike three Atlas, which we're watching for months. >> Yeah. Yeah. Which we know for months. we can like coordinate this thing, you know, it's just it's there and it's gone and and it just so happens, right? So, >> it's it's been it's been kind of challenging to actually find them. It's been kind of rare. Um, along came this detector called Chime. >> Mhm. >> In Canada, which is the >> Let me just get the thing right because I don't want any Canadians to get mad at me. It's called the Canadian Hydrogen Intensity Mapping Experiment. Chime. Um, it's a it's a massive radio telescope that doesn't look like most radio telescopes. So, you know, most radio telescopes, you've got a circular dish
1:28:32with a with a receiver and and and the light goes that way. This thing is a bunch of half pipes >> that are just laid out on the ground. >> Oh, interesting. >> Giant half pipes. Okay. 100 m that are laid out on the ground. Four of them in a valley in British Columbia. um as south as you can possibly get because what they're using they're using the earth's rotation to basically scan the sky okay >> in this radio frequency y and you know Canada's pretty far north so they want to get as south as possible so it's like right across the border from America um >> and it's this giant thing and it's made such that it's really sensitive it's got all these capabilities for as soon as a signal comes in it's kind of like the ver rubin in terms of they've got online
1:29:14capabilities to analyze the signal and it's also got a really good giant field of view. So, it's capturing a big part of the sky as it sort of goes around the Earth. And um very recently, so Chime has Chime has found thousands of fast radio bursts since 2018. >> Okay. >> Okay. It's found a bunch. This one is very very nice because usually when Chime found finds fast radio bursts, it can't localize where it came from because it's got this giant field of view. It just sees sort of a signal and it's like, "Okay, I saw a fast radio burst. Don't know where it came from. So what they did was in collaboration with America, they made more Chime stations. There's one in California,
1:29:56there's one in West Virginia, there's one also in Canada. And now what you can do is triangulate. >> My favorite, >> right? And what you can do is if you get a fast radio burst, you're going to get that signal all over the place. triangle where it came from it >> because you have multiple uh multiple receiving points at different places on the planet. So the angle and >> is going to be different and the timing is going to be different and you can back calculate and see where it came from. And what they could do is they could resolve it >> to a really tiny area in the sky right around the Big Dipper. Um the equivalent would be to resolve a quarter from 100 km away.
1:30:36>> Very tiny. very tiny tiny spot. Right? And >> that gives you the advantage because now if you know that it came from there, you've got all these other telescopes on standby >> that can point right there. >> Right. >> That's exactly what they did. They got the James Web. They called in the big guns. >> Yeah. They called in the big guns. >> They called in the big guns because this one was really bright. Okay. In terms of this is the brightest fast radio burst that we've ever seen because of its proximity to Earth. Not in terms of intrinsic brightness, but because of its proximity to Earth. Now it's really exciting, right? Because now we can point optical telescopes to it and we can actually see what part of this galaxy that it came from. It came from NGC 4141, which is this barred spiral
1:31:16galaxy. And >> what it does is and you can localize the neighborhood of that galaxy. Not just that it came from that galaxy, but it came from this corner of the galaxy. >> Okay. Um, and now you can point J James Webb Space Telescope to it. And James Webb was pointed to it. Yes, >> it found a faint signal in the infrared. >> Okay, right around that same spot. >> And that probably came from some massive stars like a red giant or something like that. Now, doesn't quite fit that a red giant or a big star would create a fast radio burst. Okay. >> Okay. Because those things are like slow, >> right?
1:31:56>> They're not 5 millisecond, >> right? >> Time scales, >> right? >> 5 millisecond time scales are the stuff of black holes, neutron stars. They revolve really fast, you know. So there's time scales that sort of correspond to astronomical objects. Yes. Right. And >> so so now it leaves us with a conundrum. It's like where did this thing come from? >> There's hypothesis. There's not good data because again this is the first time. I mean Chime and the the the Chime outrigger stations only came online like this year. >> Okay. So there's the first thing that it's found and it's very exciting because it's kind of a proof of concept that it's like looking and it can find
1:32:37it and then we can go off with with James Webb Space Telescope with KEK with Gemini and point it at that and then actually see a follow-up observation. Right? So we still don't know really where this thing came from. What we do know which is very interesting is this might be a one-off. >> Most of the fast radio bursts that we've seen, they seem to be repeating fast radio bursts, right? They've got this rhythmic sort of structure. The rhythm can be very long. It can be from days to months to years, but they've got this rhythmic thing where it's like, okay, you've got one really bright one, but then every once in a while, the same source should put off like sort of smaller bursts, >> which I think is why it matters that we
1:33:17have this this multi this multi-ensor data confirmation, multi-ensor collaboration to be able to isolate a smaller point in the sky. Because if we do find these rhythmic >> sources, we can point these things, these other tools there for longer periods of time to try to potentially catch what is this. It reminds me of the transients conversation we had the other day where it's like there's this rhythmic pattern of the planet, the exoplanet going in front of a star. And so you have to monitor it for certain periods of time to understand that it's not a one-off. >> It's not a one-off. Yeah. >> Um and so what's interesting here is like what we're potentially seeing with this specific really really bright one >> may have been a one-off. It may have been a I mean, we think it's a one-off because Chime was going around that same
1:34:00spot in the sky for the past like seven years. It's had hundreds of hours in that region of the sky. So, we've only seen it once, right? And it would have it would have found even the even smaller radio bursts, but it hasn't. >> And so, it's like what could be this oneoff thing? It could be they're thinking it might be a magnetar, which is this a magnetar is a >> not a Pokémon. No, sounds like one though. Um, a magnetar is sort of a newly born neutron star that's highly magnetized. So, it's got really powerful magnetic fields and it's in a sort of new stellar neighborhood that has magnetic material around it. So, it can
1:34:41create these fast radio bursts by sort of maybe it's like accumulating material and then it blows up or something. Um, maybe it's accumulating material from the red giants that the James Web Space Telescope saw. The James Webb saw some signal. They just don't know. It's like not good enough, right? And because it's transient, it only happened for a little bit and then and then and then it's gone. It's not like a star that I can just keep looking at and and getting data, right? Um, it could be a magnetar. It could also be a colliding neutron star. But if it was colliding, you know, sort of revolving colliding neutron stars, we would have seen LIGO. we would have seen gravitational waves, which we haven't in the hours preceding or since. So maybe the the collision is going to
1:35:23happen >> later and this is like maybe they're getting close and doing some weird dance and then that like released a giant fast radio burst. >> Um, but it's a new it's a new scale of astronomy, right? Where before we had like only a few stations that were relying on the Earth's rotation to like maybe catch something, right? and and now we've got a dedicated sort of instrument that is doing it on the northern hemisphere. You can imagine we can create a global celestial radio instrument that now does this. Actually, the VA also took a look at it because now that we can locate it here, the VA took a look at it for like several days afterwards trying to see if there's going to be a um a repeat. Yes. Didn't see one. So,
1:36:05this >> being the very large array. >> Yes. The very large array in New Mexico, which is a giant intererometer of a bunch of radio dishes on train tracks. >> For those who I think the movie was uh contact with uh uh Jodie Foster. Yeah. Was >> written by Carl Sean. >> Written by Carl Sean was at the the very large array uh class. But but again, this is this this goes back to I'm glad the outriggers were able to get out before funding got cut. Yeah. Um this is why things like you know Chime the Vera Rubin which have this very specific use case of sky surveys that are not uh that are just saying we're just going to get this >> this data set >> no >> because we don't know where to look.
1:36:46>> We don't know where to look everywhere. >> So we're going to create this map >> and then that'll help us know where to look >> and then everyone can write their proposals to then use these specific other tools to then look much more deeply. >> Yeah. And it's it's kind of it's I mean fast radio bursts are only 20 years old, you know, in terms of the grand scale of astronomy, right? That's a hundreds of years old science, right? Like only 20 years ago we found the first one. And these things are so ridiculously bright. >> And it's like what could possibly be making something that is as bright as a galaxy for a fraction of a second. >> Right. Right. >> You know, uh don't get the Dyson sphere people in on this like, "Oh, obviously
1:37:26it's a It's a It's a alien civilization that's harnessed the power of a planet and then when they recycle their generron it sends out this massive >> I'm being facicious. >> Yeah, we should have a we should have a an episode about Freeman Dyson though. He's one of my favorite. >> He's one of my favorite physicists of all time. >> Love Dyson. Um very clever, interesting, >> really funny too. >> Yeah. Yeah. >> Really funny guy. >> Brightest fast radio burst ever detected. >> Yeah. because of the some of the tools that we have. This is such a new area. >> Such a new area. >> Um and we haven't figured it all out yet. >> No, >> there are really >> no there are mysteries out there in the
1:38:07universe and and it we we are doing good work to try to narrow >> Yeah. >> the the path towards discovery around some of these things. >> Yeah. And it's like, you know, when the Vera Rubin, I was listening to the um the press conference for the Vera Rubin the other day and they were talking about they use Donald Rumsfeld's unknown unknown >> classic, >> but it it actually it actually made sense here because you know there are the known unknowns, >> which is like what is causing the expansion of the universe? >> What is dark energy? What is dark matter? What are these fast radio bursts? Yes, we know that they're there, but they're unknown in what they >> and in what they are. And then he said,
1:38:47"What I'm really excited about with the Vera Ruben is the unknown unknowns." Because before 2007, fast radio bursts were an unknown unknown, right? People couldn't even imagine that something like this would exist where in 5 milliseconds it dumps like a ridiculous amount of energy. >> Yes. >> You know, that time scale for that amount of energy is insane. And and who knows how many what number of unknown unknowns >> the Ver Rubin is going to find >> as we have these better tools. >> Yeah. And what the Chime is going to find too. Maybe it'll find like >> super fast Yes. >> radio burst, you know, that are like >> right >> at the microcond level. You never know. >> You never know. You never know. We we always cover a really fascinating array of stories each week. We started with a
1:39:30deep dive on deep seek, no pun intended, and the geopolitical power war that is currently happening between the US and China as leaders. Europe, you know, eat your heart out. Um, >> you know, Mistral is not really in the same category. >> Yeah. We went then to time crystals. The first time crystals that are room temperature and macroscopic >> that I can see >> that we can see out of uh University of Colorado Boulder implications for any number of use cases anti- uh like uh like security features technology devices. The third story was really fascinating about hidden viruses in our
1:40:11DNA >> could be big for medicine breakthroughs. um the fact that viruses are 8% >> of our DNA >> of our DNA uh and that these there's these indicators that drive cancer and autoimmune diseases and understanding the structure understanding of the lock now gives us the ability to build a key and then fast radio bursts still an enduring mystery. >> Yeah. um about where is all of this massive scale of light in such a short time scale. What cos cosmological >> event >> could create something like that >> could create something like that. >> Um another great week again the feedback
1:40:53we're still in the top charts >> on Apple for science podcasts. >> Keep telling your friends. >> Please keep sharing with your friends. The comments are hilarious. you all you are comedians. Some really really funny comments. I do talk. I don't just sit here and nod my head. Also, my hairline does is not that crazy. This is not Stephen A. Smith. >> And he's not the black guy from New Girl. >> I'm I'm not Lamour Morris, although I appreciate Lamourne. If you want to have us on the Lorning podcast, we're literally down the street. We'd love to talk to you about science. Uh my name is Lester Nar joined as always by my co-host and our resident PhD Krishna Chowdery. This is from first principles.
1:41:36We'll see y'all next week. Peace. [Music]
How Quantum Computing Actually Works (Part 1)
Part I of our quantum computing deep dive traces the field from Bell and Feynman to Deutsch and Shor—and explains what quantum computers actually do differently from classical machines.
What Claude Actually Did to the Riemann Hypothesis
Claude takes a real run at the Riemann Hypothesis, forcing us to ask what agentic AI can now do in mathematics, before we open the summer transfer window for America’s scientists.
The Amazon’s Hidden Civilization (One Year Anniversary)
For FFP’s first anniversary, we uncover the densely populated precolonial Amazon, imagine what our civilization will leave behind, and build the first shelves of the From First Principles library.
The Tech Elon Has Been Waiting For
A graphene-based memory device works at 1,300°F, opening new possibilities for extreme-environment electronics, in-memory AI, planetary exploration, and data centers in space.