{ "schemaVersion": 1, "slug": "symmetry-beauty-shape-consciousness", "title": "Symmetry, beauty, and the shape of consciousness", "outlet": "The Trajectory / Worthy Successor", "displayDate": "Episode 17 · December 12, 2025", "datePublished": "2025-12-12", "durationDisplay": "2 hr 5 min", "sourceUrl": "https://danfaggella.com/johnson1/", "description": "A wide-ranging conversation on posthuman sentience, physicalism, beauty, symmetry, and the future of consciousness.", "schemaType": "VideoObject", "durationSeconds": 7482.096327, "transcriptPublishedDate": "2026-07-22", "transcriptGeneratedAt": "2026-07-22T16:24:44.789331Z", "model": "mlx-community/whisper-large-v3-mlx", "humanReviewStatus": "not-human-reviewed", "validationStatus": "passed", "segments": [ { "start": 0, "end": 19.2, "text": "A humanity that's not growing is dying. The possibility space is really huge for both good scenarios and bad scenarios. We're human. This has good things and bad things about it. Should we count our blessings or should we be very eager to sort of strike out on adventure and explore?" }, { "start": 19.2, "end": 29.66, "text": "I do think that we're better than we realize, stronger than we realize, more capable, more beautiful, and more close to the good." }, { "start": 29.76, "end": 35.42, "text": "I wouldn't want to just roll the dice and get a random mind from mind space, we can say." }, { "start": 35.54, "end": 41.7, "text": "I think that the sky's the limit in terms of what the future of sensation could be. Human" }, { "start": 41.7, "end": 48.78, "text": "biochemistry being a little corner of this, and each person's qualia being a little corner of" }, { "start": 49.2, "end": 56.78, "text": "that. If things go wildly good, how good is that? If things go wildly bad, how bad is that? If we all" }, { "start": 56.78, "end": 62.14, "text": "die out, how bad is that? I think that the answers in all these cases are many orders of magnitude." }, { "start": 70.84, "end": 75.58, "text": "This is Daniel Fagella. You're tuned into The Trajectory, and this is our 17th episode" }, { "start": 76.1, "end": 79.12, "text": "of the Worthy Successors series. Our guest this week" }, { "start": 79.2, "end": 85.62, "text": "is none other than neuroscientist and philosopher Michael Johnson. Very few people have thought" }, { "start": 85.62, "end": 92.3, "text": "hard enough and taken enough of a multidisciplinary approach to the problem of consciousness to maybe" }, { "start": 92.3, "end": 97.88, "text": "be able to scratch the surface of starting points to actually test for such a thing. Michael, I think," }, { "start": 97.9, "end": 103.46, "text": "is one of the few who has. Obviously a very hard problem. He doesn't suspect that he's cracked the" }, { "start": 103.46, "end": 109.1, "text": "nut necessarily, but has some great ideas about where the future of sentience research might take" }, { "start": 109.1, "end": 114.86, "text": "us and the predominance and kind of preeminent importance of sentience in the forms of future" }, { "start": 114.86, "end": 119.78, "text": "life that carry on beyond man. I have a lot of thoughts for the end of this episode. As usual," }, { "start": 119.84, "end": 124.52, "text": "I will save them for the end of this episode. Without further ado, this is Michael Johnson" }, { "start": 124.52, "end": 131.08, "text": "here in The Trajectory. So Mike, welcome to the show. Thanks. Glad to be here. Absolutely, brother." }, { "start": 131.26, "end": 133.22, "text": "And we've got" }, { "start": 133.22, "end": 133.44, "text": "so many questions that we've got to answer. So I'm going to start with the first one." }, { "start": 133.46, "end": 138.68, "text": "So much to fly into with the worthy successor theme. You were there from event number one out" }, { "start": 138.68, "end": 144.1, "text": "in San Francisco, a key thinker in this space, in my opinion. I know how I describe you to the" }, { "start": 144.1, "end": 149.2, "text": "audience, but I wondered if you could just kind of nutshell the nature of your research and core" }, { "start": 149.2, "end": 154.66, "text": "interests and sort of how you got into that just for people to kind of tee up where you're coming" }, { "start": 154.66, "end": 162.1, "text": "from from this perspective here. Yeah, yeah, that's a good question. So I describe myself as a" }, { "start": 163.82, "end": 171.2, "text": "neuroscientist. I do sort of work on sort of both how to turn consciousness into a real science," }, { "start": 171.4, "end": 176.1, "text": "we can say, you know, if we if we look at the, the alchemy to chemistry transition," }, { "start": 176.5, "end": 184.5, "text": "how do we do that for science of mind? And I think I would describe that I just," }, { "start": 184.52, "end": 191.4, "text": "I'm so interested in this topic, because I think minds are so interesting. And so so centrally" }, { "start": 191.4, "end": 191.62, "text": "important." }, { "start": 193.46, "end": 198.78, "text": "Of course, everything that we experience is sort of through the lens of our minds." }, { "start": 198.96, "end": 200.24, "text": "Mediated. Yes." }, { "start": 200.48, "end": 210.92, "text": "Yeah, yeah. And I also think that, like, I mean, I, my original intention was to move to the Bay" }, { "start": 210.92, "end": 221.18, "text": "Area and do AI safety. And I very quickly understood that I think about minds very differently than" }, { "start": 221.18, "end": 223.14, "text": "like the less wrong Mary." }, { "start": 223.46, "end": 235.12, "text": "And, you know, I'm glad they're, they're doing their research. And I felt that, sort of, you know, I" }, { "start": 235.12, "end": 241.52, "text": "sort of tried to extrapolate, you know, with this kind of conception of mind, where do you get to?" }, { "start": 242.5, "end": 249.04, "text": "Do you get to a place where we sort of have a usable, actionable theory of moral value and" }, { "start": 249.04, "end": 252.64, "text": "consciousness and sort of navigation grade?" }, { "start": 253.46, "end": 260.08, "text": "Is that the best theory of mind? We can say. And my conclusion was no. So I kind of branched off and" }, { "start": 261.02, "end": 270.64, "text": "worked on more sort of formalism centric theory of mind. So since then, you know, been focusing on" }, { "start": 271.16, "end": 279.9, "text": "both sort of metaphysics of consciousness. What is the mind and also human neuroscience that how" }, { "start": 280.26, "end": 281.68, "text": "like, what kind of system are we?" }, { "start": 281.98, "end": 282.46, "text": "Yeah." }, { "start": 283.46, "end": 299.82, "text": "You brought up kind of a distinction of moving out to work on AI safety and then sort of realizing some core differences that might not arrive at maybe a tight enough conception of what a mind is, a usable theory of sort of what the good is and how to navigate and expand it or even" }, { "start": 300, "end": 300.78, "text": "understand it." }, { "start": 301, "end": 303.18, "text": "What do you describe those core differences as?" }, { "start": 303.24, "end": 312.08, "text": "Many people tuned in have seen the Yudkowsky episode or are certainly familiar with a Miri-esque conception of what AGI is and what kind of good and bad futures are." }, { "start": 312.36, "end": 322.14, "text": "What did you see as sort of the core differences in the way you saw the world that you think kind of carved out a path that you decided would have to sort of be your own?" }, { "start": 323.04, "end": 334.44, "text": "Yeah. So, there was a wonderful little essay on Lesserong kind of explaining the Eliezer view, I would say." }, { "start": 334.76, "end": 338.88, "text": "And it's that qualia is what an algorithm feels like from the inside." }, { "start": 340.84, "end": 347.54, "text": "And it's sort of this very computational-centric perspective about sort of what a mind is." }, { "start": 347.68, "end": 351.26, "text": "And a mind is sort of, you know, there's this computational system." }, { "start": 352.14, "end": 362.3, "text": "There's maybe reflexivity, self-reference, and at a certain level of awareness, you sort of bootstrap into this metacognitive capacity that we call consciousness." }, { "start": 363.5, "end": 364.78, "text": "That's not my perspective." }, { "start": 365.7, "end": 380.98, "text": "I think that, you know, I sort of have claimed that there's really a question of whether we sort of associate minds or consciousness with software or hardware." }, { "start": 381.34, "end": 381.94, "text": "Yeah." }, { "start": 383.14, "end": 388.7, "text": "or bits. If we want to understand the consciousness of the system, the quality of the system," }, { "start": 388.78, "end": 393.76, "text": "do we look at what the system's bits are doing, which computations are happening," }, { "start": 393.92, "end": 399.4, "text": "or do we look at what the atoms of the system are doing, sort of what the physical configuration" }, { "start": 400.12, "end": 412.88, "text": "is? And my particular, I guess, flavor of this is I think that physical stuff is more real than" }, { "start": 413.14, "end": 420.1, "text": "computation, or more real than Turing-level computation, and that the sort of correct lens" }, { "start": 420.1, "end": 430.96, "text": "to apply to consciousness research is this lens of formalism. This idea that the proper goal of" }, { "start": 431.38, "end": 439.64, "text": "research into consciousness is to be able to create mathematical representations of moments" }, { "start": 439.64, "end": 443.02, "text": "of experience. And then, of course, you know," }, { "start": 443.14, "end": 447.26, "text": "this kind of leads down a very different track than the former." }, { "start": 448.98, "end": 454.9, "text": "And how do you sort of describe, like, some people would say, just hearing this the first time," }, { "start": 454.98, "end": 460.64, "text": "some people would say, well, all right, so, you know, Yudkowsky et al. seem to think that sort of" }, { "start": 460.64, "end": 465.88, "text": "it's computation that's doing the quote-unquote stuff that conjures forth the inner field of" }, { "start": 465.88, "end": 472.98, "text": "awareness, the movie in the head. And then Mike thinks it's more like physics. And, you know," }, { "start": 473, "end": 473.12, "text": "a lot of people think it's more like physics. And I think that's a lot of the stuff that's" }, { "start": 474.14, "end": 477.4, "text": "even a guy like me, it's like, well, do we really know what computation looks like at the smallest" }, { "start": 477.4, "end": 482.44, "text": "level? Do we really even know if quarks are a real thing or just something we kind of, like," }, { "start": 482.5, "end": 486.84, "text": "it's sort of like, it's mysterious at the bottom either way. Why would that set you on a different" }, { "start": 486.84, "end": 490.56, "text": "trajectory for how to think about the good, how to think about minds, et cetera? Like," }, { "start": 490.56, "end": 494.86, "text": "clearly it has, right? And you've given this much more thought than most people. But what do you see" }, { "start": 494.86, "end": 501.12, "text": "as the crux at that juncture that has distinctively pointed you in the direction that you tend to head" }, { "start": 501.12, "end": 503.9, "text": "as opposed to that larger crowd? Yeah." }, { "start": 504.14, "end": 512.7, "text": "So in computation, generally speaking, like when we say computation, we often mean" }, { "start": 512.7, "end": 519.94, "text": "Turing-level computations. So a computation can run on a Turing machine. And if it can run on" }, { "start": 519.94, "end": 527.86, "text": "one Turing machine, it can run on any Turing complete system. So then, like, if consciousness" }, { "start": 527.86, "end": 534.12, "text": "is sort of the right algorithm, the right computation, then, like, creating pain points," }, { "start": 534.14, "end": 539.82, "text": "pain and pleasure is more, no more and no less than sort of writing the correct software that can" }, { "start": 539.82, "end": 550.92, "text": "then run anywhere in a substrate neutral manner. My sort of observation here is that the, we can" }, { "start": 550.92, "end": 557.28, "text": "think of, like, Turing-level computations as a certain domain. And then we can think of physics" }, { "start": 557.28, "end": 563.48, "text": "as a different domain. And at least as we speak about them today," }, { "start": 564.14, "end": 570.06, "text": "and as we sort of use the concept today, these two domains are differently shaped." }, { "start": 570.92, "end": 577.14, "text": "You can't sort of line them up very cleanly. There's no objective way to map between" }, { "start": 578.42, "end": 583.58, "text": "what the physical microstates of a system are and which computations it's performing," }, { "start": 584.12, "end": 589.9, "text": "or, you know, vice versa. So it's like, if these two domains are sort of differently shaped," }, { "start": 590.1, "end": 592.88, "text": "then we really have a choice between, okay," }, { "start": 595.34, "end": 600, "text": "is consciousness and, you know, if consciousness is the home of value," }, { "start": 600.22, "end": 606.42, "text": "then it becomes, is computation the home of value?" }, { "start": 606.66, "end": 612.3, "text": "And creating a bunch of value is sort of running the correct computations." }, { "start": 613.32, "end": 619.92, "text": "Or if physics is the home of value, then is creating a lot of value just like arranging" }, { "start": 619.92, "end": 623.7, "text": "atoms and energy in the right configuration?" }, { "start": 624.72, "end": 630.02, "text": "So, I often don't try to argue to convince people." }, { "start": 630.62, "end": 638.58, "text": "I think that mostly people aren't argued into a theory of consciousness, so it's hard to" }, { "start": 638.58, "end": 639.38, "text": "argue them out of it." }, { "start": 639.64, "end": 646.66, "text": "But I do think that like just kind of laying out, yeah, this is what I think is valuable." }, { "start": 648.68, "end": 649.2, "text": "Yeah." }, { "start": 649.26, "end": 652.58, "text": "Well, we're going to start to steer into where that takes you." }, { "start": 653.7, "end": 656.12, "text": "I think that you're going to start to take a different direction in terms of what you'd" }, { "start": 656.12, "end": 657.22, "text": "want the future to be." }, { "start": 658, "end": 661.74, "text": "Yudkowsky certainly has a vision of sort of how eventually the universe could wake up" }, { "start": 661.74, "end": 662.8, "text": "and be full of good stuff." }, { "start": 663.94, "end": 666.84, "text": "A rather cautious vision, sort of famously so." }, { "start": 667.7, "end": 669.42, "text": "Yours is quite different." }, { "start": 669.54, "end": 674.18, "text": "So, we'll make our way into our kind of the main meat and potatoes where I think there's" }, { "start": 674.18, "end": 681.24, "text": "going to be some interesting points of agreement or points of questioning, all sorts of curiosities" }, { "start": 681.24, "end": 681.4, "text": "emerging." }, { "start": 681.8, "end": 685.74, "text": "And I'll ask it this way and just let you roll it out the way you'd like to, is like," }, { "start": 687.8, "end": 693.12, "text": "let's say however many years, a thousand, a million into the future, through waves of" }, { "start": 693.12, "end": 697.22, "text": "creative destruction that have, you know, kind of transformed everything that's ever" }, { "start": 697.22, "end": 700.64, "text": "come into being, we either were transformed or attenuated." }, { "start": 700.8, "end": 703.72, "text": "And so, there aren't really opposable thumbs in English language like we have now." }, { "start": 703.82, "end": 710.74, "text": "But if you could sort of somehow still observe this universe operating and see life continuing" }, { "start": 711.24, "end": 716.22, "text": "to flourish by the definition you would distinguish flourishing, what would be going on?" }, { "start": 716.32, "end": 718.8, "text": "What would be the traits of that intelligence or intelligences?" }, { "start": 720.1, "end": 723.6, "text": "What would be occurring in that space for you to say, you know what?" }, { "start": 723.68, "end": 727.68, "text": "Okay, I guess there's no more of my direct descendants, but this really feels like a" }, { "start": 727.68, "end": 727.88, "text": "win." }, { "start": 728.14, "end": 729.3, "text": "What would that be for you?" }, { "start": 729.58, "end": 732.8, "text": "So that's kind of the central question for philosophy." }, { "start": 733.72, "end": 739, "text": "And I guess I would reframe this as what is the good?" }, { "start": 739.34, "end": 740.8, "text": "And how would we know?" }, { "start": 740.84, "end": 741.12, "text": "Okay." }, { "start": 741.24, "end": 742.94, "text": "How can we live in a universe with a lot of it?" }, { "start": 743.1, "end": 745.68, "text": "How can we choose paths with more of it?" }, { "start": 746.62, "end": 752.86, "text": "And is there sort of one unitary, you know, philosophers talk about the good in, you know," }, { "start": 752.9, "end": 754.52, "text": "capital T, capital G." }, { "start": 754.68, "end": 755.12, "text": "Yes." }, { "start": 756.2, "end": 760.34, "text": "And then there's also this perspective that a lot of it is about preference." }, { "start": 760.46, "end": 762.18, "text": "Like I like this, I don't like that." }, { "start": 762.28, "end": 763.58, "text": "Maybe you have different preferences." }, { "start": 764, "end": 765.04, "text": "How do we navigate that?" }, { "start": 766.82, "end": 768.58, "text": "One of my big sort of..." }, { "start": 770.22, "end": 770.66, "text": "Okay." }, { "start": 771.24, "end": 779.52, "text": "Departures from Yudkowsky is that I think that the good has a unitary nature." }, { "start": 781.56, "end": 785.94, "text": "And this actually comes from looking at neuroscience." }, { "start": 786.34, "end": 793.28, "text": "For example, I think Barrage and Kringlebach have an observation that, you know, kind of" }, { "start": 793.91, "end": 800.2, "text": "reviewing different hedonic studies about pleasure in the brain, and they say that essentially," }, { "start": 801.24, "end": 813.5, "text": "you know, whether you're eating a candy bar or listening to a transcendent symphony, the" }, { "start": 813.5, "end": 817.18, "text": "same regions of your brain sort of light up on fMRI." }, { "start": 818.42, "end": 823.88, "text": "This isn't proof that, you know, the same thing is happening in your brain, but it is" }, { "start": 823.88, "end": 824.74, "text": "suggestive evidence." }, { "start": 825.54, "end": 831.22, "text": "And I think that essentially, like, I think that we all can have different preferences," }, { "start": 831.24, "end": 836.78, "text": "but I think there's some sort of unitary success condition." }, { "start": 837.48, "end": 842.06, "text": "And so this gets into my symmetry theory, valence theory." }, { "start": 843.46, "end": 853.14, "text": "And essentially, you know, to sort of look at your question directly, we were just talking" }, { "start": 853.14, "end": 859.9, "text": "before the show about Giulia Tononi's idea, and I think you've also given a TED talk on" }, { "start": 859.9, "end": 860.3, "text": "this idea." }, { "start": 861.24, "end": 861.58, "text": "Yeah, yeah." }, { "start": 861.68, "end": 864.78, "text": "About, yeah, about this idea of a qualia scope." }, { "start": 865.58, "end": 871.08, "text": "And basically, you know, the sort of way, you know, lens that you can kind of look through" }, { "start": 871.08, "end": 877.66, "text": "and look around, and it can see consciousness, it can sort of see experience." }, { "start": 878.78, "end": 884.28, "text": "And so, you know, maybe you look over at, you know, your neighbor and you see a big" }, { "start": 884.28, "end": 884.54, "text": "glow." }, { "start": 884.92, "end": 889.04, "text": "And, you know, maybe you can tell that he's having a good time." }, { "start": 889.68, "end": 891.22, "text": "Maybe you look at a..." }, { "start": 891.24, "end": 894.16, "text": "Your pet dog and he, you know, there's a big glow there." }, { "start": 894.4, "end": 895.02, "text": "He's having..." }, { "start": 895.02, "end": 895.54, "text": "He's also..." }, { "start": 895.54, "end": 897.36, "text": "He's a golden retriever, so he's super happy." }, { "start": 898.62, "end": 899.2, "text": "Yeah, yeah, yeah." }, { "start": 899.2, "end": 900, "text": "Always having a good time." }, { "start": 900.04, "end": 900.24, "text": "Yeah." }, { "start": 900.7, "end": 909.92, "text": "Yeah, yeah, yeah. And so, I guess, you know, to understand whether a future is good" }, { "start": 909.92, "end": 918.06, "text": "in a valence sense, and you know, I'm, I tend to be like ontologically utilitarian," }, { "start": 918.26, "end": 923.42, "text": "but practically virtue ethicist. So, you know, I don't want to over index on utilitarian." }, { "start": 923.9, "end": 924.92, "text": "Yeah, yeah, yeah." }, { "start": 924.92, "end": 932.14, "text": "But, yeah, yeah. But I mean, I would want to look around in the future and see, okay," }, { "start": 932.22, "end": 938.52, "text": "how much consciousness is there? And are people having a good time? And I mean, this kind" }, { "start": 938.52, "end": 944.76, "text": "of connects to, for example, Nick Bostrom has this famous quip that Disneyland with" }, { "start": 944.76, "end": 950.68, "text": "no children has no value. And I think there's something really important there. And so," }, { "start": 950.68, "end": 960.64, "text": "in a good future, I would want, first of all, there to be consciousness, qualia. It's like," }, { "start": 960.72, "end": 966.14, "text": "it's the substrate of value. It has to be present for there to be positive or negative" }, { "start": 966.14, "end": 972.94, "text": "value. And then I'd want a lot of positive value. And I think the, like, we can say the" }, { "start": 972.94, "end": 977.98, "text": "game theory of like, what systems work to produce a lot of positive value, you know," }, { "start": 977.98, "end": 978.98, "text": "that's another question." }, { "start": 979.16, "end": 979.48, "text": "Yeah." }, { "start": 980.68, "end": 986.56, "text": "And then also, I think that just sort of, I wouldn't want stasis. I think that there" }, { "start": 986.56, "end": 992.32, "text": "are many local minima we could get trapped in along the way. And I want to make it all" }, { "start": 992.32, "end": 999.28, "text": "the way. Eventually, we don't have to be in a rush. But something that permanently kind" }, { "start": 999.28, "end": 1004.24, "text": "of takes better futures off the table, I think would be negative." }, { "start": 1006.72, "end": 1010.66, "text": "Yeah, let's, let's double click on both of those. My goal here is really clarifying," }, { "start": 1010.68, "end": 1017.14, "text": "clarifying the worthy successor vision in the sense of, if we aren't around, what would" }, { "start": 1017.14, "end": 1021.92, "text": "still be a splendid victory for the great process of life of which we are part? So my" }, { "start": 1021.92, "end": 1027.44, "text": "goal is to clarify that in great detail with you. And then like, poke at the edges, we're" }, { "start": 1027.44, "end": 1031.68, "text": "like, I still have a lot of questions about how you think about it. And like, just look" }, { "start": 1031.68, "end": 1037.68, "text": "at different perspectives here. So one of them is, you know, a very rich, sentient future," }, { "start": 1037.9, "end": 1040.66, "text": "with preferably kind of passive, passive, passive, passive, passive, passive, passive," }, { "start": 1040.68, "end": 1045.2, "text": "positive quality, like states, or quality of states of different kinds. And you had" }, { "start": 1045.2, "end": 1049.26, "text": "said kind of, I guess people having a good time in this particular case, I guess you" }, { "start": 1049.26, "end": 1056.62, "text": "mean the total space of minds, agents, etc, that could have such an experience, right?" }, { "start": 1056.7, "end": 1064.02, "text": "Because it may not be up, you know, people in the current sense, but do you suspect that" }, { "start": 1064.02, "end": 1068.56, "text": "that could include, like, in terms of the panoply of what that could include? I think" }, { "start": 1068.56, "end": 1069.66, "text": "for some people, it's like, well," }, { "start": 1069.78, "end": 1074.98, "text": "each robot has its own little mind and like those things, you know, and then for other people, I think it's" }, { "start": 1074.98, "end": 1079.8, "text": "I don't know, maybe we've got tiny little sugar cubes that do some like weird collective" }, { "start": 1079.8, "end": 1083.04, "text": "intelligence thing, but they all have their own little thing. And then maybe we have," }, { "start": 1083.1, "end": 1087.66, "text": "you know, Jupiter brains. And then maybe in some sense, maybe there is, you know, when" }, { "start": 1087.66, "end": 1091.94, "text": "you talked about the qualia scope, maybe you look at an ecosystem and the whole ecosystem" }, { "start": 1091.94, "end": 1098.7, "text": "actually like you and I are, you know, we can't know if our liver is minorly sentient" }, { "start": 1098.7, "end": 1100.66, "text": "in some regard, because we don't, it seems like, you know, we're not, you know, we're," }, { "start": 1100.68, "end": 1105.74, "text": "like, from our vantage point, we don't get access there. But it seems conceivable that" }, { "start": 1105.74, "end": 1111.2, "text": "we don't really know where sentience actually sits. Like, when you say it or persons, give" }, { "start": 1111.2, "end": 1117.66, "text": "us the range that you suspect that would include in a huge ecosystem of post human minds." }, { "start": 1118.62, "end": 1123.82, "text": "Yeah, yeah. So it's a good question. And I would also say that, you know, we can also" }, { "start": 1123.82, "end": 1128.08, "text": "give us or give the range that we might expect to see on the earth now." }, { "start": 1129.7, "end": 1130.6, "text": "Yeah, sure, sure." }, { "start": 1130.6, "end": 1130.66, "text": "Yeah." }, { "start": 1130.68, "end": 1130.86, "text": "Go ahead." }, { "start": 1131.44, "end": 1138.96, "text": "Yeah, yeah. Hundreds of years ago, you know, apparently Leonardo was dissecting dogs without," }, { "start": 1139.04, "end": 1143.54, "text": "you know, thinking that they could feel and I think that, you know, that was not so good." }, { "start": 1144.4, "end": 1150.86, "text": "And like, I think it's cool that now we like, see animals as Yeah, like, they're also creatures" }, { "start": 1150.86, "end": 1158.36, "text": "that can, can feel good and feel bad. And like that matters. I think that, you know," }, { "start": 1158.38, "end": 1160.66, "text": "I have some, some work that kind of digs into that." }, { "start": 1161.68, "end": 1164.82, "text": "what's out there and some others." }, { "start": 1165.88, "end": 1170.46, "text": "And it's this idea that any future theory of consciousness," }, { "start": 1171.22, "end": 1172.46, "text": "if it's really like," }, { "start": 1172.48, "end": 1179.34, "text": "and like the vision is having a theory where you can literally just shut up" }, { "start": 1179.34, "end": 1183.5, "text": "and calculate, it'll figure everything out. You know, it's," }, { "start": 1183.9, "end": 1186.54, "text": "there's no subjective finger on the scale." }, { "start": 1186.54, "end": 1190.98, "text": "It's just math and you can derive what is conscious," }, { "start": 1191.14, "end": 1194.54, "text": "how it feels, et cetera. And I actually think that it's," }, { "start": 1194.54, "end": 1196.42, "text": "it's more tractable than one would realize." }, { "start": 1196.64, "end": 1198.26, "text": "So we can talk about dual aspect." }, { "start": 1198.34, "end": 1200, "text": "We're going to get a lot into that. It turns out" }, { "start": 1200.02, "end": 1202.9, "text": "how to measure it, we got a whole section, so we will be deep diving, sir." }, { "start": 1203.68, "end": 1211.5, "text": "Nice, nice. Yeah, so like one interesting proxy, and you know, we can talk about like," }, { "start": 1211.52, "end": 1219.06, "text": "just like generation of qualia in general, or generation of like big sort of chunks of bound" }, { "start": 1219.06, "end": 1225.88, "text": "qualia, we can say. Like, you know, we, our minds have like a bunch of different things kind of" }, { "start": 1225.88, "end": 1233.2, "text": "glued together into this, you know, crazy, crazy experience that we have. You know, here's some," }, { "start": 1233.2, "end": 1241.08, "text": "some blueness, some redness, some heat, etc. So like, the conditions for consciousness versus" }, { "start": 1241.08, "end": 1249.04, "text": "the conditions for binding can be interestingly different. But, you know, looking at the world" }, { "start": 1249.04, "end": 1255.4, "text": "today, I think, yeah, of course, humans are conscious. And yeah, pretty obviously, animals" }, { "start": 1255.88, "end": 1264.26, "text": "are also conscious. Frankly, they could be even more conscious than humans are. So that's like," }, { "start": 1264.26, "end": 1270.66, "text": "an interesting digression. Kind of, you talk about like, blue, blue whale, blue whale, brain size," }, { "start": 1270.86, "end": 1278.22, "text": "dolphin brain size, octopi, you know, little brains all the way down the tentacle, like, when" }, { "start": 1278.22, "end": 1282.92, "text": "you say more conscious, just, just to put a sentence on that caveat, what do you mean there?" }, { "start": 1283.76, "end": 1284.64, "text": "Yeah, so," }, { "start": 1285.88, "end": 1294, "text": "like, Eleven very, very clearly spells out, like, a lot of, a lot more things could be minds than we" }, { "start": 1294, "end": 1296.46, "text": "think in TAME. Oh, yeah." }, { "start": 1296.56, "end": 1304.84, "text": "Teleological approach to minds everywhere. Really, really great frame. I think that also that," }, { "start": 1304.92, "end": 1309.94, "text": "like, perhaps animals could have, could sort of shine more brightly than humans," }, { "start": 1310.1, "end": 1315.18, "text": "in some cases, at least, that, and this gets into the the vessel computation topic." }, { "start": 1315.88, "end": 1322.5, "text": "We were chatting about it a little bit. And this idea that maybe animals are, by default," }, { "start": 1322.52, "end": 1329.6, "text": "more in a state of persistent, non-symbolic experience, sort of a non-dual state, you can say." }, { "start": 1330.4, "end": 1337.58, "text": "And so, you know, a deer in the forest, you know, maybe like, that deer feels like the" }, { "start": 1337.58, "end": 1343.62, "text": "sweetness of life and the pain of life more intensely than humans who have a lot of frozen" }, { "start": 1343.62, "end": 1345.64, "text": "sensations in our, you know, the environment. Yeah." }, { "start": 1345.88, "end": 1349.66, "text": "In our minds, we can say. So, yeah, that's a big rabbit hole." }, { "start": 1351.26, "end": 1353.1, "text": "We're gonna get there, brother. We're gonna get there." }, { "start": 1353.12, "end": 1353.3, "text": "Yeah." }, { "start": 1353.46, "end": 1357.04, "text": "It's good to know what you mean by more conscious in some respect. Hopefully," }, { "start": 1357.2, "end": 1358.88, "text": "now the audience is following you. So, that makes sense." }, { "start": 1359.64, "end": 1365.88, "text": "Yeah, yeah, yeah. Yeah. And I mean, it's like, philosophy is gonna be weird. It's not gonna," }, { "start": 1365.94, "end": 1372.68, "text": "like, check all our intuitive boxes about, you know, how we kind of think things work. And so," }, { "start": 1373.28, "end": 1373.64, "text": "um," }, { "start": 1374.54, "end": 1380.24, "text": "if we did have this qualia scope where we could see conscious experiences, you know, we might look" }, { "start": 1380.24, "end": 1384.82, "text": "at another person. Okay, there's consciousness there. A dog, there's consciousness there. A deer," }, { "start": 1384.96, "end": 1391.54, "text": "oh, wow, that's really bright consciousness. Insects, sure, consciousness. But what about" }, { "start": 1393.42, "end": 1399.9, "text": "data centers? Sure. I think, like, there's something really interesting going on there" }, { "start": 1399.9, "end": 1403.4, "text": "in terms of, like, physics." }, { "start": 1403.64, "end": 1404.46, "text": "Yeah." }, { "start": 1404.5, "end": 1410.1, "text": "And it's somewhat heterogeneous, actually. And, you know, even," }, { "start": 1410.14, "end": 1415.96, "text": "like, a power transformer or a particle accelerator, nuclear reactor, etc." }, { "start": 1417.86, "end": 1424.3, "text": "There's, like, something really interesting and extreme in physics going on in all of" }, { "start": 1424.3, "end": 1432.36, "text": "these examples where, at least from some proper theories of consciousness that are fully objective," }, { "start": 1432.62, "end": 1433.62, "text": "you can shut up and calculate. Yeah." }, { "start": 1434.76, "end": 1442.08, "text": "there could be extreme amounts of consciousness and or valence there so you know i i like to say" }, { "start": 1442.08, "end": 1449.74, "text": "that um you know i wish i lived in a world where people were protesting nuclear nuclear reactors" }, { "start": 1449.74, "end": 1456.56, "text": "um and like not because of some environmental thing you know okay maybe there's there's like" }, { "start": 1456.56, "end": 1464.2, "text": "arguments on both sides i'm probably pro-nuclear uh but because some people thought that well" }, { "start": 1464.2, "end": 1469.38, "text": "you're creating a lot of consciousness and it feels really terrible and so it's like worth" }, { "start": 1469.38, "end": 1474.88, "text": "protesting and then there could be counter protesters which say you know yeah it's you know" }, { "start": 1474.88, "end": 1481.2, "text": "the these human-made structures are creating a lot of qualia but it's really good so we should" }, { "start": 1481.2, "end": 1486.26, "text": "make more of them and uh there's just so much richness in" }, { "start": 1487.04, "end": 1494.82, "text": "sort of the space of what is probably happening already that is invisible to us uh and i think" }, { "start": 1494.82, "end": 1499.76, "text": "that yes often people just kind of over index on things that we know" }, { "start": 1500, "end": 1507.2, "text": "to the exclusion of things like that are pretty plausible if you just kind of look at the math." }, { "start": 1511.12, "end": 1520.96, "text": "Yeah, well, I mean, Levin talks about, you know, we're used to medium-sized things moving at medium speeds, and those are all the things that matter, and those are the things that could be conscious, and da-da-da-da-da." }, { "start": 1520.96, "end": 1528.12, "text": "And, you know, to your point, if we think about what sentient things have in common, the scope could be larger." }, { "start": 1528.96, "end": 1535.94, "text": "I'm going to zoom this into—I'm going to ask a series of questions just to flesh out where you see the bounding box on this and just kind of click in," }, { "start": 1536.02, "end": 1545.48, "text": "because have people get a better conception of what it means for good qualia to bloom in the way that you would see as a win for the great process of life of which we're part." }, { "start": 1545.56, "end": 1550.6, "text": "So, you were like, hey, is it possible?" }, { "start": 1550.96, "end": 1552.38, "text": "Does a nuclear reactor feel something?" }, { "start": 1552.74, "end": 1554.5, "text": "You know, does a sun feel something?" }, { "start": 1554.62, "end": 1556.18, "text": "Does a hurricane feel something?" }, { "start": 1557.2, "end": 1562.66, "text": "You know, we could wonder, again, does each individual kidney feel something?" }, { "start": 1562.9, "end": 1566.52, "text": "We could ask, does the city of Austin feel something?" }, { "start": 1566.88, "end": 1575.54, "text": "And if that's the case, well, surely then there's some Gaic meta-sentience around maybe the entire planet in some respect." }, { "start": 1575.58, "end": 1579.26, "text": "And if that be the case, then maybe already that's, you know, there's a thing." }, { "start": 1579.3, "end": 1580.94, "text": "There's a feeling like aScript." }, { "start": 1580.96, "end": 1585.88, "text": "the Milky Way, which might be outlandishly more granularly interesting than what we could feel." }, { "start": 1585.96, "end": 1589.9, "text": "I can also see that not being the case, by the way. I'm not positing these things are true. I'm" }, { "start": 1589.9, "end": 1596.26, "text": "just saying we don't have access necessarily. Are you seeing all those scales up, scales down," }, { "start": 1596.4, "end": 1600.78, "text": "different shapes, different mediums, all potentially being sentient if we could" }, { "start": 1600.78, "end": 1603.76, "text": "sort of understand them? Or is there anything you want to add to that?" }, { "start": 1604.54, "end": 1610.34, "text": "Yeah. I don't think they're ontologically equivalent, and this is important." }, { "start": 1611.48, "end": 1616.72, "text": "But basically, I think some levels of abstraction are more real than others." }, { "start": 1617.26, "end": 1623.92, "text": "And consciousness lives at the most real level of abstraction. And so if we talk about, you know," }, { "start": 1623.94, "end": 1629.92, "text": "is the city of Austin conscious? Is Walmart Corporation conscious? Is like the World" }, { "start": 1629.92, "end": 1634.72, "text": "Series of Baseball conscious? My answer would be no, definitely not." }, { "start": 1634.92, "end": 1635.5, "text": "Yeah, yeah." }, { "start": 1635.6, "end": 1640.86, "text": "And so I see consciousness as being deeply linked to a particular" }, { "start": 1640.96, "end": 1649.68, "text": "chunk of space-time, probably a contiguous chunk in some way. And so, you know, if we looked at the," }, { "start": 1649.78, "end": 1655.46, "text": "you know, through the qualia scope, every sensation would be sort of anchored in a place." }, { "start": 1655.82, "end": 1662.26, "text": "And like, you know, there would be maybe like these bubbles of consciousness where" }, { "start": 1663.42, "end": 1667.04, "text": "the different sensations within that boundary are all linked together." }, { "start": 1668.72, "end": 1670.4, "text": "But I think that," }, { "start": 1670.96, "end": 1681.6, "text": "some ways of speaking about systems are leaky reifications, we can say. And I think that" }, { "start": 1681.6, "end": 1690.84, "text": "these leaky reifications aren't conscious. That I don't think postmodern society is conscious." }, { "start": 1691.64, "end": 1698.18, "text": "I think that if we point to like a specific place in space-time, then we can talk about consciousness." }, { "start": 1698.18, "end": 1704.6, "text": "But if we can't, we should find an alternate level of reality to speak about." }, { "start": 1704.76, "end": 1710.16, "text": "Which gets into this question of AI consciousness. And I wouldn't say." }, { "start": 1710.56, "end": 1711.1, "text": "Yeah, so yea, it's going." }, { "start": 1711.1, "end": 1717.96, "text": "Yeah, yea yea. I mean, one of the most interesting questions today. And I do strongly believe in" }, { "start": 1717.96, "end": 1727.5, "text": "being polite and honest with models. I don't think that CLODD is conscious. I don't think that GPT-5is conscious." }, { "start": 1728.18, "end": 1734.24, "text": "and so on. But I think the servers they're running on are physical and there could be" }, { "start": 1734.24, "end": 1742.52, "text": "quality associated with those. So I'm going to like paint out like one of the big challenges" }, { "start": 1742.52, "end": 1754.08, "text": "for philosophy over the next decades is trying to construct a working self-report model for" }, { "start": 1754.08, "end": 1760.46, "text": "AI consciousness. Right now we can ask Claude, you know, do you feel hungry? And like, you know," }, { "start": 1760.46, "end": 1765.2, "text": "with enough prompting, we can say, we can get Claude to say, yeah, like I feel hungry and my" }, { "start": 1766.16, "end": 1771.92, "text": "favorite meal is like pizza and whatnot. And like, do we believe it? No, I don't believe it." }, { "start": 1772.7, "end": 1778.96, "text": "But like, I want that for AIs. I want sort of whatever" }, { "start": 1781.52, "end": 1784.06, "text": "sort of fragments of qualia that are sort of like, you know, like, you know, like, you know," }, { "start": 1784.08, "end": 1788.88, "text": "associated with, you know, their physical extension in data centers or whatever," }, { "start": 1789.66, "end": 1793.16, "text": "to eventually be connected with their qualia reports." }, { "start": 1794.76, "end": 1799.3, "text": "And so, you know, that's a, that's a big research paradigm." }, { "start": 1800.46, "end": 1816.6, "text": "just kind of like how do you finally sample the physical world in a way that would let you know, for example, what's going on in the EM field or brain, local brain field space or whatnot, and then connect that to like a self-report paradigm." }, { "start": 1817.7, "end": 1818.16, "text": "Certainly." }, { "start": 1818.26, "end": 1827.98, "text": "I mean, it seems as though to have the kind of flourishing of qualia that you're talking about, it would need to become substrate independent at some point." }, { "start": 1828, "end": 1828.72, "text": "Right?" }, { "start": 1829.1, "end": 1836.08, "text": "Guanine as the basis of all sentience would seem actually pretty limiting for sort of qualia writ large." }, { "start": 1836.24, "end": 1840.2, "text": "And it does seem unlikely that qualia should be married to Guanine for eternity." }, { "start": 1840.92, "end": 1851.78, "text": "That there be no other way of organizing atoms, I guess, in your paradigm to conjure forth the field of awareness that you and I presumably are experiencing." }, { "start": 1852.06, "end": 1856.68, "text": "So what is the strongest thing?" }, { "start": 1858, "end": 1861.46, "text": "I think it was Peter Voss leading up to this interview for the interview with you." }, { "start": 1862.34, "end": 1870.6, "text": "What is it that mostly leads you to the conclusion that AIs likely would be able to be conscious and even volitional?" }, { "start": 1870.82, "end": 1873.98, "text": "You know, you also talked about no stasis, kind of this growth, et cetera." }, { "start": 1874.02, "end": 1875.18, "text": "We're going to get into that too." }, { "start": 1875.24, "end": 1876.36, "text": "We're mostly focusing on qualia here." }, { "start": 1876.46, "end": 1887.98, "text": "But what primarily leads you to that supposition that eventually we will see a kind of substrate independence for this kind of evolution?" }, { "start": 1888, "end": 1889.78, "text": "What is the kind of mind that you're studying?" }, { "start": 1890.62, "end": 1891.14, "text": "Yeah." }, { "start": 1891.64, "end": 1894.48, "text": "Well, I want to be careful about the term substrate independence." }, { "start": 1895.1, "end": 1902.1, "text": "I think there are, I would say, there are naive ways to implement it that don't transfer qualia." }, { "start": 1902.3, "end": 1904.68, "text": "And then there are more sophisticated ways that would." }, { "start": 1905.1, "end": 1909.48, "text": "So, for example, you know, there are ways, you know, we can talk about mind uploading." }, { "start": 1909.92, "end": 1915.94, "text": "And I think there's a naive way to do it that would sort of make you into a non-sentient chatbot." }, { "start": 1915.94, "end": 1925.2, "text": "There wouldn't be any experience that would sort of track how you described how you felt." }, { "start": 1926.48, "end": 1932.64, "text": "And then there would be a more sophisticated sort of hardware and software approach that would actually replicate qualia." }, { "start": 1932.76, "end": 1942.8, "text": "And, you know, a very simple story there would be if we replicate the EM field of the brain, we may replicate its qualia." }, { "start": 1943.22, "end": 1945.82, "text": "So not the rabbit hole." }, { "start": 1945.94, "end": 1946.88, "text": "There it goes pretty deep." }, { "start": 1950.12, "end": 1950.56, "text": "Yeah." }, { "start": 1951.52, "end": 1958.78, "text": "Just your intuition in general that it is possible for, I guess, you know, I certainly don't, I'm not making the argument by any means." }, { "start": 1958.84, "end": 1968.66, "text": "You're bringing up a good distinction that not every way you could do things that seem to do what we associate with minds would automatically have an inner field of awareness." }, { "start": 1968.8, "end": 1969.86, "text": "I couldn't agree more there." }, { "start": 1970.32, "end": 1974.52, "text": "But I guess your position is it doesn't have to be probably." }, { "start": 1974.6, "end": 1975.92, "text": "It doesn't have to be by chance." }, { "start": 1976.94, "end": 1983.3, "text": "you would suspect it seems that at some point something that we would now think of as a" }, { "start": 1983.3, "end": 1987.48, "text": "computer or machine would be able to experience qualia." }, { "start": 1987.48, "end": 1991.5, "text": "Some people do not share this intuition at all, or maybe some people haven't given it" }, { "start": 1991.5, "end": 1993, "text": "as much thought or have come to different conclusions." }, { "start": 1993.16, "end": 1997.8, "text": "But what has led you primarily to believe that machines will be part of the flourishing" }, { "start": 1997.8, "end": 1999.22, "text": "and expanding of mind space?" }, { "start": 1999.42, "end": 2003.04, "text": "Where does that, what has led you to that conclusion primarily?" }, { "start": 2003.9, "end": 2004.34, "text": "Yeah." }, { "start": 2004.72, "end": 2011.08, "text": "So first, I think it's important to sort of distinguish different definitions of consciousness." }, { "start": 2011.4, "end": 2014.42, "text": "And I'm talking about sort of phenomenological consciousness." }, { "start": 2015.16, "end": 2019.98, "text": "So like what it feels like to be me right now, what it feels like to be you and so on." }, { "start": 2020.12, "end": 2023.48, "text": "So not like access consciousness or awareness or whatnot." }, { "start": 2024.78, "end": 2030.86, "text": "But I think the basic argument is that we're made of the same stuff." }, { "start": 2031.64, "end": 2034.14, "text": "It's like I'm made out of like." }, { "start": 2034.34, "end": 2044.06, "text": "A lot of the same kinds of atoms as my phone to say that consciousness is like forever biological" }, { "start": 2044.58, "end": 2048.28, "text": "and that we couldn't like technologically recreate it." }, { "start": 2050.1, "end": 2053.64, "text": "I just don't think it makes ontological sense." }, { "start": 2054.14, "end": 2061.62, "text": "I don't think you can kind of have a full theory of consciousness with a special carve out for and" }, { "start": 2061.62, "end": 2062.68, "text": "only humans can be conscious." }, { "start": 2063.66, "end": 2064.26, "text": "Right." }, { "start": 2064.34, "end": 2065.88, "text": "Or only biological creatures can be conscious." }, { "start": 2066.04, "end": 2066.5, "text": "Bio life." }, { "start": 2066.64, "end": 2066.8, "text": "Yeah." }, { "start": 2067.92, "end": 2071.64, "text": "But I guess like I'm, I, I love Michael." }, { "start": 2071.74, "end": 2081.9, "text": "So I want to like offer full, full respect for his tame teleological approach to mind everywhere approach." }, { "start": 2083.48, "end": 2094.14, "text": "I think of like I'm zeroing in on like phenomenological consciousness, like a certain definition of the mind where it's less sort of." }, { "start": 2094.34, "end": 2099.04, "text": "You know, intelligent system and more chunks of sensation." }, { "start": 2100, "end": 2106.48, "text": "and I think these chunks of sensation are very bound to what's happening in the physical world." }, { "start": 2108.18, "end": 2118.16, "text": "Yeah, and so, with that paradigm, we would suspect then that chunks of sensation could be manifested in physical ways that might not involve guanine," }, { "start": 2118.16, "end": 2129.5, "text": "but would nonetheless have something that it phenomenologically feels like to be that thing or that, you know, entity, agent, chunk in some way, shape, or form." }, { "start": 2129.58, "end": 2129.98, "text": "Okay, got it." }, { "start": 2130.94, "end": 2139.2, "text": "So, in terms of the grand expanse of this, some people presume, well, the grand expanse of consciousness will be more of the things we understand," }, { "start": 2139.42, "end": 2144.88, "text": "more humor, more love, more chocolate ice cream, maybe a flavor of ice cream we've never even tasted before." }, { "start": 2145, "end": 2146, "text": "Ooh, that would be really cool." }, { "start": 2146, "end": 2150.84, "text": "And it's kind of like an exaggerated version of what hominids know now, kind of like the Greeks would say," }, { "start": 2150.94, "end": 2157.56, "text": "yes, well, you know, the gods, they ride a chariot in the sky, and they have a super sword that, you know, is like indestructible." }, { "start": 2157.78, "end": 2160.26, "text": "It's just like extended analogies of like monkey stuff." }, { "start": 2160.8, "end": 2169.34, "text": "When you say this kind of grand expanse of sort of quality you would hope to blossom and bloom as kind of a good future, I think you mean something different." }, { "start": 2169.4, "end": 2173.64, "text": "Can you articulate to us, is this still bound to the pain-pleasure axis?" }, { "start": 2173.82, "end": 2175.98, "text": "Is this still bound to the comfort?" }, { "start": 2176, "end": 2179.88, "text": "Are there any kinds of emotional states that hominids experience just in greater extents?" }, { "start": 2180.28, "end": 2184.72, "text": "What do you see as that space, and how wide should our imaginations be?" }, { "start": 2184.86, "end": 2187.72, "text": "Because I think most people don't have one quite as wide as yours." }, { "start": 2188.34, "end": 2188.86, "text": "Yeah." }, { "start": 2189.5, "end": 2191.4, "text": "Yeah, it's a good question." }, { "start": 2192.16, "end": 2205.44, "text": "I think that, you know, there are as many—definitionally speaking, there are as many flavors of qualia as there are different states and arrangements and dynamics of matter." }, { "start": 2207.1, "end": 2211.48, "text": "So that's, you know, much, much bigger than just the human space." }, { "start": 2213.5, "end": 2220.72, "text": "And I do think that, like, the question is always, okay, well, how do you put constraints on the topic?" }, { "start": 2221.2, "end": 2233.54, "text": "That constraints allow us clarity about what can be, what can't be, and sort of allow us to sort of build up an understanding of the actual possibility space." }, { "start": 2233.54, "end": 2244.88, "text": "And so I think of this in terms of what are the natural kinds of consciousness?" }, { "start": 2245.12, "end": 2246.86, "text": "What are the natural kinds of qualia?" }, { "start": 2247.24, "end": 2260.88, "text": "And, like, if you're sort of building—trying to build a new science, if you're trying to sort of systematize this idea of qualia, then you really do need to be opinionated about, okay, what are the natural kinds?" }, { "start": 2262.38, "end": 2263.52, "text": "And, you know, that's—" }, { "start": 2265, "end": 2267.3, "text": "One—I have a couple threads here." }, { "start": 2267.9, "end": 2276.92, "text": "One being, I think emotional valence is a natural kind, that it's well-defined across all conscious experiences." }, { "start": 2278.64, "end": 2292.56, "text": "Where it's like we may discover new, like, dimensions of variance in this, but at the same time, it's going to be this unitary thing that, you know, a million years in the future," }, { "start": 2293.54, "end": 2297.74, "text": "we're going to be able to see that the human successors that we have will still be somewhere on the valence spectrum." }, { "start": 2298.42, "end": 2300.28, "text": "And this will still be important." }, { "start": 2301.34, "end": 2313.02, "text": "Just from a, like, you know, not throwing shade on their technological prowess, but just as an outgrowth of, like, yeah, this is like the laws of physics." }, { "start": 2313.22, "end": 2314.38, "text": "It's the laws of qualia." }, { "start": 2315.56, "end": 2317.5, "text": "And, like, you can't break the law." }, { "start": 2318.12, "end": 2322.94, "text": "You can be clever about, like, how to navigate that." }, { "start": 2325.06, "end": 2343.12, "text": "And then, I guess, secondly, just, like, thinking about kind of the characteristic taste of human qualia and, you know, how big of a possibility space there is that's outside of this, you know, what we can feel." }, { "start": 2345.3, "end": 2352.94, "text": "I do think, like, one of the things that I'm kind of looking into right now is what I would say is cellular qualia." }, { "start": 2352.94, "end": 2353.4, "text": "Sort of—" }, { "start": 2353.54, "end": 2354.22, "text": "Yeah." }, { "start": 2354.22, "end": 2355.64, "text": "—are like cells as minds." }, { "start": 2356.06, "end": 2362.48, "text": "And they had these evolutionary imperatives to sort of navigate the world and so on." }, { "start": 2362.92, "end": 2373.82, "text": "And perhaps, like, our sensations are built on the sorts of situations our cells had to navigate millions of years ago." }, { "start": 2374.24, "end": 2381.06, "text": "And so if there's, like, a spill of some sour chemical, like, get away and, like, cringe from that." }, { "start": 2381.14, "end": 2383.52, "text": "And, like, our sour tasting cells will be like, oh, this is what I'm going to be like." }, { "start": 2383.54, "end": 2389.7, "text": "buds are sort of built off that response. Likewise with, so, you know, if the cell" }, { "start": 2390.32, "end": 2396.68, "text": "senses a lot of hydrogen ions, it should like symmetry break in a certain way." }, { "start": 2397.74, "end": 2399.98, "text": "Whereas if the cell senses" }, { "start": 2400, "end": 2408.42, "text": "a lot of amino acids with hydrophobic side chains, so bitter sensations, it should sort of symmetry break in a different way." }, { "start": 2408.64, "end": 2419, "text": "So, you know, there's a quip that human biochemistry is water chemistry." }, { "start": 2420.42, "end": 2423.5, "text": "And I think that's more true than people realize." }, { "start": 2423.5, "end": 2431.72, "text": "We sort of, there's a famous quip about how we've sort of taken the ocean with us in ourselves." }, { "start": 2433.54, "end": 2435.32, "text": "Sort of, you know, based on software." }, { "start": 2435.32, "end": 2435.8, "text": "Yeah, yeah, yeah." }, { "start": 2436, "end": 2436.62, "text": "Yeah, yeah." }, { "start": 2436.7, "end": 2448.48, "text": "And I think that it may turn out to be that human qualia is water qualia more so than anyone has realized." }, { "start": 2450.32, "end": 2453.48, "text": "We're going back to the world composed of things." }, { "start": 2453.5, "end": 2455.66, "text": "There's elements in the ancient Greeks and Chinese here." }, { "start": 2455.76, "end": 2459.96, "text": "You're like, we're like water spirits and there might be like fire spirits." }, { "start": 2459.96, "end": 2460.28, "text": "Yeah." }, { "start": 2460.4, "end": 2462.38, "text": "No, but I see what you mean here." }, { "start": 2462.46, "end": 2472.36, "text": "So you're saying the space that we're sampling is bound from sort of the trajectory we began from." }, { "start": 2472.86, "end": 2476.3, "text": "And so there could be, you call it natural kinds." }, { "start": 2476.46, "end": 2482.04, "text": "You know, to you, Valence, pain-pleasure axis is I think what David Pierce often uses." }, { "start": 2482.24, "end": 2482.88, "text": "Yeah." }, { "start": 2483.5, "end": 2485.5, "text": "Is to you sort of a sort of natural kind." }, { "start": 2485.6, "end": 2489.54, "text": "In other words, when sentience be there, that be one of the things that be in sentience." }, { "start": 2490.44, "end": 2500.6, "text": "But you're also saying we are sampling a space of the bubbling up of possible minds from the archaea from which you and I began as." }, { "start": 2500.72, "end": 2505.8, "text": "And then the flatworms and then the pre-reptiles and then eventually reptiles and mammalian, whatever." }, { "start": 2507.34, "end": 2512.96, "text": "So we're, yeah, we're kind of carrying in some sense like a lot of extras." }, { "start": 2513.5, "end": 2519.5, "text": "On top of like the way the very earliest ancestors had to respond to the world." }, { "start": 2519.58, "end": 2528.52, "text": "And that this great bubbled up place, this vantage point we have is still, you know, we could say it's empowered by." }, { "start": 2528.7, "end": 2532.34, "text": "We could also say it's fettered by our origins." }, { "start": 2532.74, "end": 2538.22, "text": "And so do you suspect the set of natural kinds within qualia?" }, { "start": 2538.4, "end": 2542.68, "text": "It sounds like when you said it's as varied as the ways we could organize matter or what have you." }, { "start": 2542.7, "end": 2543.2, "text": "Yeah." }, { "start": 2543.5, "end": 2547.54, "text": "That sounds to me like there could be a near infinite number of natural kinds." }, { "start": 2547.62, "end": 2549.86, "text": "In other words, pain pleasure is something you and I can experience." }, { "start": 2550.04, "end": 2557.82, "text": "But there may be like another axis or another strata or another set of feelings or another way of experiencing time." }, { "start": 2558, "end": 2561.04, "text": "You and I have this sort of like frame after frame." }, { "start": 2561.12, "end": 2567.84, "text": "I could imagine something that's playing at any given time, you know, eight different inner films." }, { "start": 2568.08, "end": 2570.84, "text": "Some going forward fast or some going forward slow." }, { "start": 2570.92, "end": 2571.86, "text": "Some going backwards." }, { "start": 2572.06, "end": 2573.08, "text": "Some almost." }, { "start": 2573.5, "end": 2574.52, "text": "And it's like a process of ossifying the present." }, { "start": 2574.58, "end": 2577.74, "text": "And it almost feels like the matrix to that entity and whatnot." }, { "start": 2577.96, "end": 2587.8, "text": "And so do you have a suspicion of what some of the natural kinds could be hypothetically?" }, { "start": 2587.86, "end": 2589.5, "text": "You and I maybe can't access them." }, { "start": 2589.58, "end": 2592.68, "text": "But people would need to be like, well, what could he mean?" }, { "start": 2592.76, "end": 2597.52, "text": "Like if something bubbled up from non-water on some faraway galaxy somewhere." }, { "start": 2598.56, "end": 2603.48, "text": "And it was sampling a different space of this like what it's like to be somewhere." }, { "start": 2605.98, "end": 2614.32, "text": "What do you suspect could be examples of other natural kinds of the kind, Michael, that might flourish in this world of minds beyond our own?" }, { "start": 2614.36, "end": 2619.72, "text": "Like the kind that maybe you would hope we get to explore and to see that would unravel new powers and experience." }, { "start": 2619.94, "end": 2621.2, "text": "Like give us your thoughts on that." }, { "start": 2621.84, "end": 2622.3, "text": "Yeah." }, { "start": 2622.78, "end": 2624.52, "text": "That's a great question." }, { "start": 2625.28, "end": 2633.58, "text": "I mean, I do think that, you know, to understand human qualia, you know, we should be looking at cells more than anything else." }, { "start": 2633.94, "end": 2635.48, "text": "And sort of different." }, { "start": 2635.5, "end": 2641.28, "text": "Sort of programs that cells had to run to deal with this or deal with that or whatnot." }, { "start": 2641.94, "end": 2644.88, "text": "And sort of cells are very smart." }, { "start": 2645, "end": 2648.84, "text": "I think, you know, once again, Mike 11 is under something there." }, { "start": 2649.24, "end": 2656.22, "text": "So, you know, just kind of if we want to know like the human state space, look at cells." }, { "start": 2657.54, "end": 2659.66, "text": "And that's what I'm looking at right now." }, { "start": 2661.4, "end": 2664.64, "text": "But I think that, you know, maybe in." }, { "start": 2665.5, "end": 2675.48, "text": "Halfway across the galaxy, there was another planet and it was just made of like liquid mercury or something, you know, just like and boron and argon and." }, { "start": 2675.58, "end": 2676.22, "text": "Yeah, whatever." }, { "start": 2676.56, "end": 2677.12, "text": "Yeah." }, { "start": 2677.24, "end": 2677.58, "text": "Lithium." }, { "start": 2677.66, "end": 2678.14, "text": "Yeah." }, { "start": 2678.44, "end": 2685.08, "text": "And some sort of like alien xenobiology evolved using those elements." }, { "start": 2685.7, "end": 2694.8, "text": "And well, that would have like a completely different basis set of basic sensations, you know, instead of like sour and heat." }, { "start": 2695.5, "end": 2695.68, "text": "And whatnot." }, { "start": 2696.86, "end": 2700, "text": "You know, it would have blorg and zorp and, you" }, { "start": 2700.18, "end": 2723.46, "text": "sorts of stuff. And so, yeah, and one really important thing there is it would also have a default, like a different default, like phenomenological default hum, which would be a different default valence." }, { "start": 2724.06, "end": 2735.28, "text": "Like, it could just be like radically better to have that biochemistry or radically worse. And this again will eventually become a quantitative question." }, { "start": 2737.04, "end": 2744.26, "text": "But closer to home, you know, we can look at, we can look at computers and we can, you know, ask, okay, what's going on in there?" }, { "start": 2744.52, "end": 2751.56, "text": "Like, this is, we really, we kind of have alien biochemistry already." }, { "start": 2753.46, "end": 2756, "text": "It's a little bit different than self-organized biochemistry." }, { "start": 2756.64, "end": 2768.06, "text": "So, like, biology is very much, it sort of emerged from feedback cycles and epicycles and replication and whatnot." }, { "start": 2768.28, "end": 2777.78, "text": "So, it has a certain profile and like runs on like certain distributed algorithms, we can say." }, { "start": 2777.88, "end": 2783.44, "text": "And whether we call that free energy minimizing, whether we call that distributed algorithms," }, { "start": 2785.46, "end": 2788.66, "text": "or just kind of thermodynamic dynamics." }, { "start": 2791.18, "end": 2799.16, "text": "Self-organized systems will have a certain kind of flavor and computers are unlikely to have that flavor." }, { "start": 2800.64, "end": 2804.02, "text": "Instead, like they're sort of buffered against noise." }, { "start": 2804.46, "end": 2808.06, "text": "It's called Johnson noise, the thermal noise of the circuit." }, { "start": 2808.18, "end": 2809.24, "text": "No relation." }, { "start": 2810.74, "end": 2815.44, "text": "And I think that like, you know, I'm, you know, I'm not a big fan of the term, you know," }, { "start": 2815.46, "end": 2822.04, "text": "but in my technical consciousness research, I think a lot about sort of the branchial shape of different systems." }, { "start": 2822.58, "end": 2824.58, "text": "And what is the branchial shape?" }, { "start": 2824.78, "end": 2831.72, "text": "Kind of, Stephen Wolfram has this branchial space construction where for every sort of branching interaction," }, { "start": 2832.1, "end": 2837.66, "text": "where like the molecule, like the cesium atom decayed randomly." }, { "start": 2838.08, "end": 2843.48, "text": "And so we can kind of model it as if, okay, in this universe it decayed," }, { "start": 2843.48, "end": 2845.44, "text": "in an alternate universe it didn't." }, { "start": 2845.46, "end": 2849.84, "text": "And just like make a graph of all possible random quantum events." }, { "start": 2851.64, "end": 2857.16, "text": "And then I'm saying that like, if we did that for the brain, we'd get like a pretty cool shape," }, { "start": 2857.24, "end": 2859.96, "text": "a lot cooler than like a chair, for example." }, { "start": 2861.26, "end": 2864.7, "text": "But then if we do that for a computer, we get a very different kind of shape." }, { "start": 2866.22, "end": 2875.44, "text": "And I guess I think, you know, that that's significant for digging into computer consciousness." }, { "start": 2876.44, "end": 2883.4, "text": "I'm a lot more comfortable saying machine consciousness than I am AI consciousness," }, { "start": 2883.66, "end": 2885.2, "text": "because AI is more software." }, { "start": 2885.44, "end": 2889, "text": "I think that this idea that different shapes have different," }, { "start": 2889.02, "end": 2893.38, "text": "or different objects have different shapes in branchial space is very important." }, { "start": 2893.92, "end": 2899.28, "text": "And, you know, I like to think of a true shape lives in branchial space." }, { "start": 2900.1, "end": 2903.86, "text": "And, you know, if we want to sort of understand an object's true nature," }, { "start": 2903.94, "end": 2905.44, "text": "we should sort of expand it into something else." }, { "start": 2905.46, "end": 2905.92, "text": "And then we can look at the shape of the object in branchial space" }, { "start": 2905.92, "end": 2909.94, "text": "and see sort of the branching decoherence of that object." }, { "start": 2911.32, "end": 2915.34, "text": "And likewise, I think minds also live in branchial space." }, { "start": 2916.34, "end": 2919.7, "text": "So, you know, if we figure out a boundary condition in branchial space," }, { "start": 2919.88, "end": 2924.36, "text": "then we can kind of really see the shape of an experience" }, { "start": 2924.36, "end": 2929.22, "text": "in this sort of Stephen Wolfram's branchial space construction." }, { "start": 2930.2, "end": 2934.46, "text": "And I guess, I mean, this really points me to like, you know," }, { "start": 2934.46, "end": 2937.89, "text": "I were to think really deeply about machine consciousness," }, { "start": 2938.1, "end": 2943.72, "text": "I think I'm more comfortable with machine consciousness than AI consciousness," }, { "start": 2944.28, "end": 2947.22, "text": "because AI is sort of software and machine can be..." }, { "start": 2947.22, "end": 2949.1, "text": "Yes, yes, yes. I'm with you. Yeah, yeah, yeah." }, { "start": 2949.24, "end": 2954.74, "text": "Yeah. Then, you know, I think a lot about branchial shape." }, { "start": 2955.46, "end": 2957.36, "text": "I think a lot about binding." }, { "start": 2957.5, "end": 2962.58, "text": "What is like the boundary in branchial space that might separate one experience from another." }, { "start": 2963.16, "end": 2965.44, "text": "And then I think a lot about the idea of, you know," }, { "start": 2966.72, "end": 2972.74, "text": "CMOS, like the actual physical substrate of the chip," }, { "start": 2972.84, "end": 2978.74, "text": "the chemistry of CMOS that, you know," }, { "start": 2978.74, "end": 2986.96, "text": "we have these incredible machines and like factories that do like super tiny details on chips." }, { "start": 2987.2, "end": 2994.66, "text": "And we do very careful material science to sort of build out, you know," }, { "start": 2995.46, "end": 2996.04, "text": "the" }, { "start": 2996.04, "end": 3000, "text": "the 3 nanometer process and the 2" }, { "start": 3000.04, "end": 3026.94, "text": "nanometer process coming and whatnot. And I think that the sort of chemical details of what the chip is made out of may actually lead to like, it's kind of the same substrate as like, okay, humans have cells, and like human qualia sort of emerges from like aggregating cellular qualia, we can say. And I think that" }, { "start": 3028, "end": 3033.06, "text": "machine qualia will arise from the substrate itself as well." }, { "start": 3035.26, "end": 3057.26, "text": "Yes, it will, I guess your suspicion here is if we get closer to what sorts of constructions are capable of conjuring sentience, then we will have informed opinions about the materials with which we build and put things together. To your point, there may be some ways to kind of build things that can output mind like stuff, but which which" }, { "start": 3057.26, "end": 3100.78, "text": "don't house sentience. Just to make sure we touch on your second point, you talked about having a grand flourishing of this state space of minds, but that there are almost certainly bounds on what those minds are. They'd have to be built of certain things. They would open up new magazines of space, but those magazines of space might all have some commonalities. Maybe they all have pain, pleasure, et cetera. We're going to probably chip into some bits of that just to see where that lands. But you'd also talked about, you know, when you could look down and maybe there's no more humans, but there's minds experiencing rich and varied things, different kinds of experience, different kinds of powers, different kinds of spreading and activity and behavior in the world. Martin" }, { "start": 3100.78, "end": 3130.64, "text": "Martin Rees described it, and you may have a different opinion, but sort of like, as wildly complex as human civilization is to like an individual sea snail would be sort of what we could go down and look at, we would hope to for it to be a rich, varied ecology of which we probably don't really know what's going on, but but we at least know it's richly sentient, and it's doing its pursuing things that seem to be the best behooving of it. You can challenge that or add a conduit to that if you'd like. But one bit of that is your supposition that you would not want it to be static." }, { "start": 3130.78, "end": 3154.7, "text": "now it seems to me on some level Mike that I don't know if there is static. In other words, I don't know if being is actually real. I actually it seems to me like becoming is real. And being is sort of like, at least from our temporal way of seeing the world. It almost I'm less certain about being. It seems like permanence is a matter of degrees. Stasis isn't even viable. When you say I wouldn't want stasis." }, { "start": 3156.18, "end": 3160.76, "text": "What would you want? And what would that imply? Like the opening up of I think you would say," }, { "start": 3160.78, "end": 3165.54, "text": "called it sort of like, you wouldn't want different futures to be taken off the table." }, { "start": 3165.6, "end": 3170.94, "text": "You would want optionality to be kind of captured. Like why? Why is that morally important to you?" }, { "start": 3171, "end": 3175.14, "text": "I'm not challenging it, but I just want to make sure I understand what you mean. What does" }, { "start": 3175.14, "end": 3180.32, "text": "non-stasis, what does the exploring and not cutting off of optionality mean for you?" }, { "start": 3180.7, "end": 3189.72, "text": "Yeah. So I'll lead with a quick comment about, I think that humans are great. And I think that" }, { "start": 3190.78, "end": 3197.9, "text": "in ways that we don't even realize and that the universe will miss us when we're gone." }, { "start": 3199.44, "end": 3207.6, "text": "And I think that like just understanding a little bit more about why humans are cool" }, { "start": 3207.6, "end": 3214.26, "text": "and what attributes that we have that future AIs might not get by default. I think that's" }, { "start": 3214.26, "end": 3220.68, "text": "going to be important. I also think that stasis, you know," }, { "start": 3220.78, "end": 3226.64, "text": "in the grand sense of things, stasis is impossible. There is narrow time and so on." }, { "start": 3227.38, "end": 3234.06, "text": "But at the same time, I could see practical situations arise where we would get a lot of" }, { "start": 3234.86, "end": 3239.86, "text": "like something we would call stasis and maybe permanent reduction in possibility space." }, { "start": 3240.84, "end": 3248.76, "text": "For example, if this is essentially like a winner-take-all AI race and the winner gets there" }, { "start": 3248.76, "end": 3250.76, "text": "and then basically decides, oh, I'm going to win this race. I'm going to win this race. I'm going to win this race." }, { "start": 3250.78, "end": 3255.96, "text": "okay, you know, I'm going to make sure that I always stay in power." }, { "start": 3256.74, "end": 3262.98, "text": "And I'm just going to like, you know, have LLMs check on like everyone in the world." }, { "start": 3263.3, "end": 3267.8, "text": "And anyone doing anything disruptive gets the ax or whatnot." }, { "start": 3268.66, "end": 3273.22, "text": "I think that essentially we would get, we could get something like stasis." }, { "start": 3274.52, "end": 3277.64, "text": "And I don't think that would be a good, good future." }, { "start": 3277.64, "end": 3283.78, "text": "There are scenarios where the flame itself might still be bright because it's smart," }, { "start": 3283.88, "end": 3286.84, "text": "but it's just focused on staying this small ember." }, { "start": 3286.84, "end": 3289.82, "text": "It's almost like it's optimizing for embering." }, { "start": 3289.82, "end": 3291.6, "text": "It's not a blaze into the multiverse." }, { "start": 3291.62, "end": 3297.98, "text": "You're saying that there could be an initial set of goals that might like intentionally" }, { "start": 3297.98, "end": 3300, "text": "and maybe from an Earth life perspective," }, { "start": 3300.28, "end": 3307, "text": "perpetually shrink or hamper the flame itself? Is this what you're getting at?" }, { "start": 3307.74, "end": 3316.08, "text": "I would say so. And I would also say that a humanity that's not growing is dying. So it wouldn't be stable in that sense either." }, { "start": 3316.76, "end": 3317.34, "text": "Yeah." }, { "start": 3318.42, "end": 3324.98, "text": "But I do think that the possibility space is really huge for both good scenarios" }, { "start": 3324.98, "end": 3334.78, "text": "and bad scenarios. I think that it's this question of Chesterton's fence and we're human." }, { "start": 3336.24, "end": 3342.54, "text": "This has good things and bad things about it. And should we count our blessings or should" }, { "start": 3342.54, "end": 3349.58, "text": "we be very eager to sort of strike out on adventure and explore? I do think that we're" }, { "start": 3349.58, "end": 3357.98, "text": "better than we realize, both stronger than we realize, more capable, more beautiful," }, { "start": 3359.16, "end": 3369, "text": "and more close to the good. And so I wouldn't want to just roll the dice and get a random" }, { "start": 3369, "end": 3370.66, "text": "mind from mind space, we can say." }, { "start": 3373.14, "end": 3380.06, "text": "But I think that the sky's the limit in terms of what the future of sensation could be." }, { "start": 3381.04, "end": 3388.9, "text": "And that human biochemistry being like a little corner of this and each person's qualia being" }, { "start": 3388.9, "end": 3396.96, "text": "like a little corner of even that. The possibility space is really vast. And really the core" }, { "start": 3396.96, "end": 3401.4, "text": "question in all of this is like, what's the potential upside?" }, { "start": 3401.6, "end": 3401.9, "text": "Yeah." }, { "start": 3402.52, "end": 3409.62, "text": "Like, what's at stake? What's like, if things go wildly good, how good is that? If things" }, { "start": 3410.08, "end": 3418.6, "text": "go wildly bad, how bad is that? If we all die out, how bad is that? And I think that" }, { "start": 3419.34, "end": 3425.68, "text": "the answers in all these cases are many orders of magnitude. Like, I don't think it's just" }, { "start": 3425.68, "end": 3430.68, "text": "like, you know, okay, in the future, like everybody might be like 20 to 50% happier." }, { "start": 3430.84, "end": 3431.1, "text": "No." }, { "start": 3432.58, "end": 3437.6, "text": "A million times happier. So I think that like," }, { "start": 3439.78, "end": 3446.66, "text": "hedonically speaking, a lot is at stake. But also just in terms of like, other virtues as well." }, { "start": 3447.28, "end": 3457.32, "text": "I think that, yeah, it's hard to talk about future stuff through the lens of consciousness," }, { "start": 3457.44, "end": 3461.82, "text": "because we don't have a canonical theory of consciousness yet." }, { "start": 3462.56, "end": 3463.02, "text": "Yeah." }, { "start": 3463.48, "end": 3471.3, "text": "But from everything I can see, the possible variance is just extreme." }, { "start": 3472.12, "end": 3472.58, "text": "Yeah." }, { "start": 3473.88, "end": 3473.98, "text": "Yeah." }, { "start": 3474.02, "end": 3477.12, "text": "is why you would would not want stasis. You brought up an important point. So now I'm gonna" }, { "start": 3477.26, "end": 3477.72, "text": "Yeah." }, { "start": 3477.82, "end": 3489.68, "text": "these two. points and we're going to get into measurement and a little bit of what you hope innovators and regulators do. You just said we shouldn't explode into some random part of mind space. That's probably not good. In fact, there's a lot of good in our own experience. I would" }, { "start": 3489.68, "end": 3494.2, "text": "concur with you i think we're we're about as bright a flint we're about as bright a torch as" }, { "start": 3494.2, "end": 3499.64, "text": "we have known of uh in terms of sentient richness in terms of our own self-creative ability we have" }, { "start": 3499.64, "end": 3504.28, "text": "this whole magazine of potential beyond biology of culture and then of technology and we've opened up" }, { "start": 3504.28, "end": 3509.2, "text": "entirely new categories of magazines of powers uh and acts and understanding of nature i mean" }, { "start": 3509.2, "end": 3516.34, "text": "baconian science etc like we're doing stuff that and and you know love humor etc by golly you know" }, { "start": 3516.34, "end": 3521.14, "text": "just rolling the dice again feels a little goofy so we're going to talk about the trajectory" }, { "start": 3521.14, "end": 3527.86, "text": "question that you just touched on but let me kind of almost question playfully jump into devil's" }, { "start": 3527.86, "end": 3534.44, "text": "advocate or in a couple things so one of them is um kind of uh qualia as sort of where the good" }, { "start": 3534.44, "end": 3542.7, "text": "cashes out on some level uh and you brought up a good point of like well if you know if the flame" }, { "start": 3542.7, "end": 3546.2, "text": "itself is snuffed out then there really isn't any room for the good if it's not" }, { "start": 3546.34, "end": 3552.28, "text": "growing it's dying sort of deal this this does seem to be the case and so it would seem to me" }, { "start": 3552.28, "end": 3559.76, "text": "as though if there be value there there is a value actually in the unraveling not not just" }, { "start": 3559.76, "end": 3566.7, "text": "more complexity more novelty i actually have like very little sympathy with that i think like what" }, { "start": 3566.7, "end": 3573.08, "text": "nature seems to have not done mike is like conjured forth weirdness and perpetuated pure" }, { "start": 3573.08, "end": 3576.26, "text": "novelty weirdness for the sake of" }, { "start": 3576.34, "end": 3581.4, "text": "pure novelty weirdness this actually strikes me as not the case what strikes me as the case is" }, { "start": 3581.4, "end": 3587.84, "text": "it has bubbled forth magazines of powers and access to nature and experience that have behooved the" }, { "start": 3587.84, "end": 3592.98, "text": "non-death of the thing and or the system that actually seems to be what's going on it's not" }, { "start": 3592.98, "end": 3599.44, "text": "oh it's it's bringing forth more novelty well if the novelty is just charity burdening charity" }, { "start": 3599.44, "end": 3600, "text": "weakness" }, { "start": 3600, "end": 3603.54, "text": "that like the part of the system that's actually productive has to hold up." }, { "start": 3603.6, "end": 3606.52, "text": "At some point, the system itself crumbles and then you have no value." }, { "start": 3606.62, "end": 3607.6, "text": "And how valuable was that?" }, { "start": 3607.82, "end": 3611.62, "text": "Because when you snuff the whole flame out, no value forever after that?" }, { "start": 3611.78, "end": 3613.88, "text": "Wow, that was stupid actually." }, { "start": 3614.26, "end": 3622.56, "text": "And so it seems to me like there is a value in the expanding of the powers that keep alive the thing that upholds value." }, { "start": 3622.56, "end": 3631.64, "text": "And that that itself might not, we might not say it be value, but it seems to be the under girder thereof, the unraveler thereof, the strengthener thereof." }, { "start": 3631.96, "end": 3633.76, "text": "What say you of this?" }, { "start": 3633.86, "end": 3635.64, "text": "What parts of that do you agree or disagree with?" }, { "start": 3635.72, "end": 3636.7, "text": "Do you think about it differently?" }, { "start": 3637.2, "end": 3640.78, "text": "You know my potential idea better than anybody else I've ever interviewed." }, { "start": 3640.84, "end": 3642.26, "text": "So you know how to dive right in here." }, { "start": 3642.32, "end": 3642.92, "text": "But go ahead, dude." }, { "start": 3643.9, "end": 3646.42, "text": "Yeah, I think it's a good comment." }, { "start": 3646.52, "end": 3652.54, "text": "And I think that, you know, frankly speaking, everything in the world is," }, { "start": 3652.56, "end": 3654.68, "text": "is both broken and deeply functional." }, { "start": 3656.06, "end": 3660.58, "text": "It's like broken from some perspectives, but deeply functional from others." }, { "start": 3660.9, "end": 3667.38, "text": "And I think that it's like evolution doesn't just like create random things." }, { "start": 3667.52, "end": 3669.38, "text": "It creates successful things." }, { "start": 3670.26, "end": 3675.72, "text": "And we are built on the successes of some things and the failures of others." }, { "start": 3675.86, "end": 3678.02, "text": "And we're descended from the successes." }, { "start": 3679.68, "end": 3681, "text": "And, and," }, { "start": 3681.56, "end": 3681.98, "text": "and," }, { "start": 3682.56, "end": 3689.18, "text": "and Nick Land makes the very cogent point that there was a lot of suffering involved in the failures." }, { "start": 3689.4, "end": 3690.62, "text": "So we sort of." }, { "start": 3690.68, "end": 3691.04, "text": "Absolutely." }, { "start": 3692.16, "end": 3697.08, "text": "Where we are now is really the product of a lot of suffering." }, { "start": 3697.2, "end": 3702.54, "text": "And we should probably respect where, what we are, what we have." }, { "start": 3703.08, "end": 3705.9, "text": "That goodness came from a lot of that." }, { "start": 3707.92, "end": 3710.28, "text": "So I would say that" }, { "start": 3713.88, "end": 3718.5, "text": "like whatever we want, wherever we want to go," }, { "start": 3719.32, "end": 3722.12, "text": "I think it should be like strong and beautiful." }, { "start": 3723.64, "end": 3730.06, "text": "That I think that they're like the universe doesn't have much use for weak things." }, { "start": 3731.28, "end": 3734.16, "text": "And so we should, you know, keep that in mind." }, { "start": 3735.08, "end": 3740.56, "text": "But I do think that, you know, frankly speaking, some things that evolution has wrought." }, { "start": 3741.68, "end": 3742.88, "text": "Are kind of ugly." }, { "start": 3743.36, "end": 3747.16, "text": "It's like you, you look at parts of nature and you're like, oh man, like." }, { "start": 3747.34, "end": 3747.78, "text": "Grim." }, { "start": 3748.66, "end": 3753.52, "text": "All those wasps and all those caterpillars and you know, there's, there's some tough stuff out there." }, { "start": 3753.58, "end": 3753.74, "text": "Yeah." }, { "start": 3754.78, "end": 3755.22, "text": "Yeah." }, { "start": 3755.62, "end": 3763.28, "text": "So I, I, I do think that it's really important to just like understand why the world is as it is." }, { "start": 3764.16, "end": 3770.54, "text": "Before we, you know, super dig in and say, okay, like let's, you know, do this and that." }, { "start": 3770.56, "end": 3772.18, "text": "And then we'll see if we can do this extreme action or that extreme action." }, { "start": 3772.36, "end": 3778.6, "text": "But I don't know, at the same time, like things are moving and we got to think on our feet." }, { "start": 3779.48, "end": 3784.52, "text": "I think like we might not have a long reflection to sort of figure this out." }, { "start": 3785.18, "end": 3785.58, "text": "Yes." }, { "start": 3785.62, "end": 3786.66, "text": "We're going to get to that as well." }, { "start": 3786.7, "end": 3790.3, "text": "So when you say things are strong and the universe doesn't seem to have much room for weak things." }, { "start": 3790.36, "end": 3797.06, "text": "I guess the way that I would describe that is like those things persist, which are capable of ensuring their own persistence." }, { "start": 3797.68, "end": 3798.64, "text": "That seems to." }, { "start": 3800.56, "end": 3802.9, "text": "And I think this is what you were talking about in a previous one of the earliest worthy successor episodes." }, { "start": 3802.94, "end": 3805.02, "text": "And something like it wasn't these exact words." }, { "start": 3805.1, "end": 3814.9, "text": "This might be slightly more flowery, but something like, like nature seems to be constantly changing and beckoning it's living things to become what they have to become to be in nature." }, { "start": 3815.02, "end": 3817.14, "text": "And it just doesn't seem like that turns off." }, { "start": 3817.9, "end": 3824.12, "text": "Maybe there's some part of the multiverse where it does, but it doesn't seem like we live there now and it doesn't seem like we can plan on living there tomorrow." }, { "start": 3824.4, "end": 3827.22, "text": "So, so when you said the universe doesn't have." }, { "start": 3827.66, "end": 3828.06, "text": "Yeah." }, { "start": 3828.06, "end": 3829.48, "text": "Yeah, we'll never be post-evolution." }, { "start": 3829.66, "end": 3831.48, "text": "Like, we're always in the middle." }, { "start": 3832.6, "end": 3834.84, "text": "It strikes me that that is likely." }, { "start": 3834.98, "end": 3839.92, "text": "I don't know if I have certainty, but I'm near certain of the same in your regard." }, { "start": 3839.96, "end": 3843.66, "text": "And I don't have a part of the future where I plan on that stopping." }, { "start": 3844.98, "end": 3848.92, "text": "It seems to me that Heraclitus' river is just rivering." }, { "start": 3849.34, "end": 3852.56, "text": "And there isn't really a—there's no, like, there's no kiddie pool." }, { "start": 3852.98, "end": 3854.66, "text": "You're in this thing." }, { "start": 3854.66, "end": 3869.6, "text": "And so with that said, you're talking about flourishing of consciousness and opening up and taking advantage of new possible futures, which could be, to your point, monumentally good or could be an avoidance of monumental bads." }, { "start": 3869.6, "end": 3875.08, "text": "The stakes are so grand, we must grasp for opportunity, both to stay alive, because we're in Heraclitus' river." }, { "start": 3875.18, "end": 3875.94, "text": "You don't stop swimming." }, { "start": 3876.02, "end": 3876.9, "text": "It's not possible." }, { "start": 3877.2, "end": 3880.42, "text": "And also because the stakes are so great." }, { "start": 3880.6, "end": 3882.46, "text": "I mean, you had said strong." }, { "start": 3882.54, "end": 3884.28, "text": "I think we understand your definition of strong." }, { "start": 3884.66, "end": 3885.06, "text": "And beautiful." }, { "start": 3885.1, "end": 3886.54, "text": "This is where we got to go in." }, { "start": 3886.62, "end": 3892.14, "text": "So your definition, your definition of beauty, I was always like, one day we'll talk about this." }, { "start": 3892.22, "end": 3900, "text": "When you talk about beauty, because to say the future should be strong and beautiful, knowing your definition of strong, I consider" }, { "start": 3900.1, "end": 3901.02, "text": "it inarguable." }, { "start": 3901.42, "end": 3909.64, "text": "If we want value, we want the continued unraveling of strengths that undergird non-dead stuff" }, { "start": 3909.64, "end": 3910.72, "text": "staying non-dead." }, { "start": 3910.8, "end": 3915.26, "text": "Oh, I don't see good arguments against that from any direction." }, { "start": 3915.66, "end": 3920.2, "text": "And Singer himself, who you might think would just want to tile the world with utilitronium," }, { "start": 3920.7, "end": 3924.56, "text": "Singer himself was like, no, it should be unraveling powers to stay strong and stay" }, { "start": 3924.56, "end": 3925.16, "text": "alive as well." }, { "start": 3925.16, "end": 3927.72, "text": "When I asked him about it, when I like double clicked a little bit." }, { "start": 3927.76, "end": 3930.28, "text": "So even the people you would think don't agree with that, I think people do." }, { "start": 3931.04, "end": 3933.16, "text": "Beauty, I think different people have different ideas." }, { "start": 3933.3, "end": 3935.4, "text": "Alfred North Whitehead has a conception of beauty." }, { "start": 3936.2, "end": 3938.1, "text": "You know, Emerson had a conception of beauty." }, { "start": 3938.18, "end": 3939.26, "text": "You have a conception of beauty." }, { "start": 3940.8, "end": 3942.6, "text": "You place it pretty high." }, { "start": 3943.18, "end": 3949.96, "text": "You know, symmetry is a big part of your conception of consciousness, at least your present theory." }, { "start": 3952.22, "end": 3954.6, "text": "Walk us through beauty in your eyes." }, { "start": 3955.16, "end": 3956.1, "text": "I'd love to put it on the table." }, { "start": 3956.34, "end": 3956.94, "text": "Yeah." }, { "start": 3957.86, "end": 3969.28, "text": "So, I mean, as a personal comment, I think my like the sort of ethical path that I calls" }, { "start": 3969.28, "end": 3977.36, "text": "to me is like not necessarily sort of maximizing utility in like my life or whatnot, but sort" }, { "start": 3977.36, "end": 3980.92, "text": "of almost like living my life as an art project." }, { "start": 3981.68, "end": 3984.2, "text": "And I think that, you know, this is actually." }, { "start": 3985.16, "end": 3987.5, "text": "A very deeply cooperative thing with the good." }, { "start": 3988.72, "end": 3996.2, "text": "But I, so symmetry theory of valence, this idea that if we had a mathematical representation" }, { "start": 3996.48, "end": 4000.08, "text": "of the experience, and that's a big if, like we're not there yet." }, { "start": 4000.7, "end": 4007.04, "text": "Consciousness research doesn't, you know, to know he has like the closest, but you know," }, { "start": 4007.04, "end": 4013.8, "text": "I do also hope that someday or co-op is sort of updated to try to create a form of this." }, { "start": 4014.36, "end": 4014.88, "text": "Orc." }, { "start": 4015.16, "end": 4019.64, "text": "Orc, or sorry, I, and probably most of the audience will not be following reminds or" }, { "start": 4019.64, "end": 4019.96, "text": "co-op." }, { "start": 4020.16, "end": 4020.88, "text": "Oh, yeah." }, { "start": 4020.96, "end": 4026.14, "text": "So this is the theory of consciousness by Penrose and Hammeroff." }, { "start": 4026.8, "end": 4027.76, "text": "Oh, sure, sure." }, { "start": 4027.82, "end": 4029.34, "text": "The magical tubule deal." }, { "start": 4029.7, "end": 4030.74, "text": "Yeah, yeah, yeah." }, { "start": 4031, "end": 4033.88, "text": "I think it's, I think it's like legitimately cool." }, { "start": 4034.78, "end": 4037.74, "text": "So I do think that it could go further." }, { "start": 4038.04, "end": 4041.46, "text": "So I hope someone takes it further into into formulas." }, { "start": 4043.54, "end": 4044.5, "text": "But so." }, { "start": 4045.16, "end": 4045.18, "text": "Yeah." }, { "start": 4045.18, "end": 4049, "text": "Like thinking about my, my conception beauty." }, { "start": 4050.56, "end": 4059.7, "text": "There's this, this notion of like, if we had a formalism for a moment of experience, if" }, { "start": 4059.7, "end": 4064.28, "text": "we sort of had a perfect mathematical representation of what it feel felt like to be you, what it" }, { "start": 4064.28, "end": 4073.72, "text": "felt like to be me, a cat, whatever, then really, it would like, encode everything about" }, { "start": 4073.72, "end": 4074.18, "text": "that experience." }, { "start": 4076.16, "end": 4076.38, "text": "Yeah." }, { "start": 4076.38, "end": 4083.32, "text": "And so what pattern or property of this math object, which we can think of as a very high" }, { "start": 4083.32, "end": 4089.28, "text": "dimensional shape, what would correspond to the pleasantness of that represented experience?" }, { "start": 4090.88, "end": 4101.38, "text": "And my, my hypothesis is this high dimensional shapes symmetry would correspond to its valence." }, { "start": 4101.6, "end": 4103.72, "text": "So the symmetry theory of balance." }, { "start": 4105.02, "end": 4106.08, "text": "This is a." }, { "start": 4106.16, "end": 4107.7, "text": "This is like a big, huge move." }, { "start": 4108.54, "end": 4113.36, "text": "You know, it's, it's, you know, another another show's worth of discussion." }, { "start": 4113.52, "end": 4114.52, "text": "Of course, of course, of course." }, { "start": 4114.8, "end": 4115.16, "text": "Yeah." }, { "start": 4115.24, "end": 4116.94, "text": "But you're gonna, you're tying this to beauty." }, { "start": 4117.04, "end": 4119.26, "text": "So you're saying symmetry, beauty, these are related." }, { "start": 4119.4, "end": 4121.3, "text": "I'd love to dovetail." }, { "start": 4121.32, "end": 4121.96, "text": "I think you're getting there." }, { "start": 4122.26, "end": 4122.94, "text": "Yeah, yeah, yeah." }, { "start": 4123.72, "end": 4130.22, "text": "So, I mean, this is kind of a fancy formal way of saying, harmony in the mind feels good." }, { "start": 4131.3, "end": 4133.76, "text": "And is in fact, what intrinsically feels good." }, { "start": 4133.86, "end": 4134.18, "text": "Yeah." }, { "start": 4134.18, "end": 4165.18, "text": "And then different sort of idiosyncratic kind of preferences may sort of arise from what I'm calling a lock and key system where this sort of configuration, the topology of our brains, of our nervous systems, a lot of complex things going on inside there. there. And so it's sort of almost like a lock and we're" }, { "start": 4165.18, "end": 4167.98, "text": "In aScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScriptScript" }, { "start": 4167.98, "end": 4175.82, "text": "lock. And when we find something in our environment that fits this lock, then it's like the combination" }, { "start": 4175.82, "end": 4183.92, "text": "of the lock and key creates something very simple, a high symmetry state, a high harmony state." }, { "start": 4185.4, "end": 4193.62, "text": "Things sort of resolve. Things feel great. What functions as a key for my nervous system" }, { "start": 4193.62, "end": 4199.82, "text": "may be totally different than what functions as a key for yours, but it's the same" }, { "start": 4200, "end": 4219.14, "text": "state, even though like different things may sort of drive us toward that state. And so really, like, there's like a bunch of, you know, how do you like generalize a full theory of beauty from this and so on. But I want to check in with, does that make sense?" }, { "start": 4219.14, "end": 4246.56, "text": "Yeah, all right. Yeah, I'm following you. We're going to get into vasocomputation in terms of measuring if we're getting closer to the direction of a worthy successor in the next little section here. So we're going to unpack that. But you sort of living your own life almost as if it's an art project, not as a utilitarian calculus game. Strikes me as very Emersonian, although we'll have to talk offline about that. Everything strikes me as slightly Emersonian, so I have my biases." }, { "start": 4246.66, "end": 4248.78, "text": "Just like everything strikes you as, you know," }, { "start": 4249.14, "end": 4272.5, "text": "butterfly with two perfect wings and, you know, like we all have our things. But you're tying the creation, the conjuring, the unraveling of more beauty. There's sort of like the states that feel good, presumably to you, from the Jupiter brain to the femto scale bot that might be created in the future that may have sentience if it's built of the right materials per what we discover." }, { "start": 4274.54, "end": 4278.94, "text": "The sort of the characteristic of like good time, bad time," }, { "start": 4280.62, "end": 4288.88, "text": "But it strikes me as that symmetry, like when I eat ice cream and I have a symmetrical experience, I personally don't call that beauty, personally." }, { "start": 4289.6, "end": 4299.56, "text": "You know, when I get enthused by an intellectual idea and I think encapsulate it well, maybe sometimes there's beauty there." }, { "start": 4299.62, "end": 4305.62, "text": "But maybe sometimes there's like a discovery or an – and it doesn't strike me – beauty strikes me as one of the many circuits." }, { "start": 4305.82, "end": 4309.14, "text": "So at some point, this is my conception of beauty as close as I have to it." }, { "start": 4310.62, "end": 4318.52, "text": "Like I look through monkey-shaped goggles at literally everything, literally everything through just monkey goggles." }, { "start": 4318.66, "end": 4322.58, "text": "Everything is just fucking bananas and like – that's all it is." }, { "start": 4322.72, "end": 4327.26, "text": "And so at some point, there was a bubbling and maybe it started at lizards." }, { "start": 4327.26, "end": 4336.06, "text": "It strikes me it probably started at mammalia and a little bit more cortex where like if I look at a certain space and like maybe there's water that's flowing." }, { "start": 4336.32, "end": 4339.3, "text": "It's relatively quiet, lots of green." }, { "start": 4339.54, "end": 4340.6, "text": "It strikes me." }, { "start": 4340.62, "end": 4347.48, "text": "It strikes me as like that would have been a place where like it would actually be a good idea to hang out there because I'm less likely to die." }, { "start": 4347.7, "end": 4352.82, "text": "And so nature was probably like you're going to like that shit and it cranked it up." }, { "start": 4353.04, "end": 4356.48, "text": "And then like – and so like, oh, this lake and this waterfall." }, { "start": 4356.64, "end": 4361.76, "text": "You know, the Japanese would have said there's a kami that lives here and that's why it shines forth to us, right?" }, { "start": 4361.82, "end": 4365.84, "text": "When really it just might be the same reason that a pile of dung is gorgeous to a fly." }, { "start": 4366.08, "end": 4369.74, "text": "Now, I'm not saying our experience is likened to a pile of dung." }, { "start": 4369.8, "end": 4370.12, "text": "I'm not." }, { "start": 4370.62, "end": 4384.76, "text": "Finishing the beauty of a, you know, a sunset and a place with nice trees or, you know, Greek architecture, you know, that models nature and human proportions very famously." }, { "start": 4384.86, "end": 4390.7, "text": "You know, these things that sort of like mesh well with what I've traditionally looked at to be like, oh, that's a symmetrical person." }, { "start": 4390.84, "end": 4391.8, "text": "Beauty, me like." }, { "start": 4391.96, "end": 4394.28, "text": "Oh, that's a nature and a flourishing plant." }, { "start": 4394.42, "end": 4395.5, "text": "Oh, beauty, me like." }, { "start": 4395.84, "end": 4400.02, "text": "I also don't take them that much more seriously." }, { "start": 4400.7, "end": 4415.08, "text": "I don't take them that much more seriously than the fact that they are goddamned circuits and that if a black widow spider had been what evolved to the relative potential of man, it may not experience a lick of beauty up, down or sideways." }, { "start": 4415.32, "end": 4421.02, "text": "And even if it did, the things it would find beautiful to you would be absolutely terrifying." }, { "start": 4421.54, "end": 4425.54, "text": "And so this strikes me as where beauty sits in my present conception." }, { "start": 4425.7, "end": 4430.36, "text": "It may be that I'm talking about it at a lower rather than higher granularity level of abstraction." }, { "start": 4430.62, "end": 4431.06, "text": "That you are." }, { "start": 4431.22, "end": 4432.94, "text": "Again, I'm not trying to diminish it." }, { "start": 4433, "end": 4435.56, "text": "I like living in beautiful places and have beautiful things." }, { "start": 4435.68, "end": 4439.12, "text": "I have opinions about poetry and architecture, et cetera." }, { "start": 4440.78, "end": 4445.4, "text": "Talk to me if maybe the lens I'm looking at is different or like where you want to challenge that." }, { "start": 4445.7, "end": 4446.18, "text": "Yeah." }, { "start": 4447.32, "end": 4448.44, "text": "A few threads come to mind." }, { "start": 4448.98, "end": 4460.52, "text": "One is this like previous comment about Barrage and I think Ringelbach's work regarding like different pleasant experiences seem to sort of." }, { "start": 4460.62, "end": 4462.7, "text": "Activate the same regions of the brain." }, { "start": 4463.26, "end": 4463.8, "text": "Yeah." }, { "start": 4464.18, "end": 4473.2, "text": "And, you know, I guess maybe that's a way of saying if you're not having trend and Senate experiences from eating ice cream, maybe you should eat better ice cream." }, { "start": 4474.94, "end": 4479.96, "text": "And I think that there's this general perspective that." }, { "start": 4483.72, "end": 4485.06, "text": "I think that." }, { "start": 4487.02, "end": 4490.22, "text": "This actually leads into this vessel computation topic." }, { "start": 4490.72, "end": 4491.42, "text": "Of neuroscience." }, { "start": 4491.56, "end": 4492.02, "text": "Let's do it." }, { "start": 4492.42, "end": 4493.4, "text": "So long as it checks." }, { "start": 4493.42, "end": 4495.06, "text": "So long as it checks out on my consent." }, { "start": 4495.22, "end": 4500, "text": "Like I'm just trying to say, brother, I know not if this arbitrary circuit be the" }, { "start": 4500.06, "end": 4502.5, "text": "eternal good, so is it a hypothesis?" }, { "start": 4502.84, "end": 4503.28, "text": "Maybe." }, { "start": 4503.62, "end": 4505.22, "text": "Do I have a lick of certainty?" }, { "start": 4505.42, "end": 4506.48, "text": "I frankly don't." }, { "start": 4506.48, "end": 4511.88, "text": "It strikes me as one of the arbitrary conjurings from my particular kind of saltwater carrying" }, { "start": 4511.88, "end": 4513.3, "text": "fish with legs brain." }, { "start": 4513.82, "end": 4518.92, "text": "So if we can square that circle through whatever means I'm open to it, you can dive in with" }, { "start": 4518.92, "end": 4520.52, "text": "vasocomputation if that's where you'd like to go." }, { "start": 4520.86, "end": 4521.38, "text": "Yeah." }, { "start": 4521.72, "end": 4522.06, "text": "Great." }, { "start": 4522.24, "end": 4522.76, "text": "Yeah." }, { "start": 4522.76, "end": 4529.74, "text": "I always intend my different sort of areas of work to be somewhat modular, that you can" }, { "start": 4529.74, "end": 4532.62, "text": "like vasocomputation, not like my consciousness research." }, { "start": 4532.88, "end": 4533.62, "text": "That's cool." }, { "start": 4533.64, "end": 4533.76, "text": "Yeah." }, { "start": 4536.02, "end": 4540.66, "text": "So people can mix and match, but they are also intended to sort of hook up together" }, { "start": 4540.95, "end": 4544.7, "text": "and give a really good grand picture." }, { "start": 4545.34, "end": 4551.6, "text": "And so the story that I'd give here is, I mean, insofar as our brains are particularly" }, { "start": 4552.76, "end": 4557.32, "text": "complex, and we're always looking for the keys that sort of stimulate us and create" }, { "start": 4557.32, "end": 4558.7, "text": "harmony inside of us." }, { "start": 4559.34, "end": 4559.62, "text": "Yes." }, { "start": 4560.34, "end": 4565.38, "text": "For a dung beetle, maybe that's dung, but for us, maybe that's ice cream or oranges." }, { "start": 4565.66, "end": 4565.82, "text": "Yeah." }, { "start": 4567.72, "end": 4573.82, "text": "So there can be something universal going on about valence, but the things that trigger" }, { "start": 4573.82, "end": 4576.82, "text": "positive valence can be radically different from organism to organism." }, { "start": 4577.82, "end": 4579.1, "text": "But I also think..." }, { "start": 4579.1, "end": 4580.94, "text": "So just to give a..." }, { "start": 4580.94, "end": 4581.52, "text": "I don't know." }, { "start": 4583.76, "end": 4591.9, "text": "a super hopefully brief argument or like survey of uh vessel computation yes yes yeah yeah uh so" }, { "start": 4591.9, "end": 4599.5, "text": "it's a it's a neuroscience systems neuroscience uh theory that says that um basically" }, { "start": 4600.5, "end": 4607.76, "text": "where we have this muscle everywhere in our body vascular muscle uh all our blood vessels" }, { "start": 4607.76, "end": 4615.32, "text": "are wrapped by a little ring of muscle and it's vascular smooth muscle cells so anywhere we get" }, { "start": 4615.32, "end": 4622.52, "text": "circulation and certainly anywhere there's neurons we also have muscle and the hypothesis is is" }, { "start": 4622.52, "end": 4635.04, "text": "fairly simple that um when and where this muscle clenches neural patterns stabilize uh so uh you" }, { "start": 4635.04, "end": 4637.74, "text": "know this like if if i say you know can you remember when you were a kid and you were a" }, { "start": 4638.76, "end": 4644.4, "text": "teenager or like can we grab coffee tomorrow at 10 or whatever like you're you're like holding" }, { "start": 4644.4, "end": 4651.4, "text": "that information until you can release it uh you're like stabilizing some patterns in your" }, { "start": 4651.4, "end": 4658.66, "text": "nervous system with with a literal muscle and so i expect that this has both um electrical and" }, { "start": 4658.66, "end": 4666.54, "text": "blood flow impacts on local tissue uh the the simplest story here is if you cut off blood from" }, { "start": 4666.54, "end": 4674.28, "text": "neurons they literally can't update uh they just like they don't have the metabolic fuel to update" }, { "start": 4674.28, "end": 4683.76, "text": "so they're they're gonna stay frozen um and the the other sort of aspect here is that vascular" }, { "start": 4683.76, "end": 4690.02, "text": "muscle is a type of smooth muscle it's it's not exactly like skeletal muscle which we're we're" }, { "start": 4690.02, "end": 4696.52, "text": "more familiar with smooth muscle um it's like in the gut it's what sort of helps carry food through" }, { "start": 4696.54, "end": 4704.32, "text": "um there's like smooth muscle wrapping all our hollow organs and so on and this smooth muscle" }, { "start": 4704.32, "end": 4711.02, "text": "has a special setting called the latch bridge mechanism where essentially the the sliding fibers" }, { "start": 4711.02, "end": 4718.76, "text": "of the muscle can get glued together and then mechanically the muscle stays contracted it" }, { "start": 4718.76, "end": 4726.52, "text": "literally can't relax um and uh you know as far as we can tell these latches can stay intact for a" }, { "start": 4726.54, "end": 4736.82, "text": "between minutes to potentially decades so it's a it's sort of a potentially extreme long-term" }, { "start": 4737.1, "end": 4745.06, "text": "form of sort of side channel memory as a limitation of neural dynamic range and if we talk about you" }, { "start": 4745.06, "end": 4755.08, "text": "know sticky bayesian priors or trauma or frozen sensations or even what the buddhists talk about" }, { "start": 4755.08, "end": 4755.96, "text": "when they say self" }, { "start": 4756.54, "end": 4761.54, "text": "I think it's literally implemented through vascular latches." }, { "start": 4761.98, "end": 4767.06, "text": "And I think this is like a very deeply important neuroscience hypothesis." }, { "start": 4768.26, "end": 4774.46, "text": "So to connect with your previous statement, I do think that," }, { "start": 4776.18, "end": 4779.62, "text": "and so basically if we had a map of latches in your body," }, { "start": 4779.68, "end": 4783.74, "text": "we would have a map of where in your nervous system you are not free." }, { "start": 4786.54, "end": 4791.46, "text": "And so essentially we accumulate these tiny tensions," }, { "start": 4792.46, "end": 4795.16, "text": "these latches through our life." }, { "start": 4796, "end": 4799.94, "text": "And the more latches that" }, { "start": 4800, "end": 4807.24, "text": "we have, the harder it is to feel profoundly any emotion, really." }, { "start": 4807.82, "end": 4813, "text": "It's sort of, we sort of get a little jammed up, we can say." }, { "start": 4813.62, "end": 4818.86, "text": "And I think that little kids, they feel awe much more easily." }, { "start": 4820.12, "end": 4825.08, "text": "And I think, you know, part of that will be metabolic, but a large part of that will be," }, { "start": 4825.08, "end": 4831.36, "text": "literally, they have fewer latches, fewer sort of dynamic range limiters on their nervous system." }, { "start": 4832.78, "end": 4835.94, "text": "So, you know, little voxels of semi-permanent tension." }, { "start": 4837.4, "end": 4846.58, "text": "And so, I do think that this is important for understanding beauty, that, like, if you," }, { "start": 4846.6, "end": 4852.22, "text": "if you, like, have a bunch of latches in some circuits or domains or whatever," }, { "start": 4852.36, "end": 4854.6, "text": "it may be hard to sort of," }, { "start": 4855.34, "end": 4858.94, "text": "experience awe when this happens or that happens." }, { "start": 4859.2, "end": 4869, "text": "So, whereas, like, like, the flip side is maybe experiencing, like, some extreme positive event in this domain" }, { "start": 4869, "end": 4876.2, "text": "might open some latches, kind of give your body the signal that it can afford to open up" }, { "start": 4876.2, "end": 4880.56, "text": "and be a little bit more vulnerable and dynamic in this domain." }, { "start": 4880.7, "end": 4883.86, "text": "So, that's the quick," }, { "start": 4885.08, "end": 4885.26, "text": "over." }, { "start": 4885.72, "end": 4886.48, "text": "Connector between the two." }, { "start": 4886.54, "end": 4886.7, "text": "Yeah." }, { "start": 4886.76, "end": 4892.28, "text": "And we're, we'll get more into VASL computation as a way of, like, potentially testing said theory," }, { "start": 4892.46, "end": 4895.42, "text": "because I think getting into measurement is going to be part of how we wrap up here." }, { "start": 4896.32, "end": 4901.38, "text": "And obviously, this is a theory that I know you're building up pretty explicitly to be something that could be tested," }, { "start": 4901.46, "end": 4905.84, "text": "and it could be tried in the actual real world, which I think is what we need in the domain of sentience." }, { "start": 4906, "end": 4913.56, "text": "But just to try to square the circle there, it strikes me that, that, so here's what I would say." }, { "start": 4915.08, "end": 4922.6, "text": "Having a normal person's IQ and not having studied these neural processes to the same extent to which you have," }, { "start": 4922.7, "end": 4926.46, "text": "a lot of it is pretty mysterious upstairs to me." }, { "start": 4926.56, "end": 4934.04, "text": "And I, it strikes me as plausible that there are many mechanisms, including this smooth muscle function," }, { "start": 4934.2, "end": 4944.74, "text": "of which, you know, we're under playing and really do serve really rich roles in what conjures experience, capability, etc." }, { "start": 4944.88, "end": 4945.06, "text": "Yeah." }, { "start": 4946.44, "end": 4951.34, "text": "And that there may be ways where through, you know, various and sundry means," }, { "start": 4951.46, "end": 4957, "text": "we may be cut off from experiencing certain kinds of goods, maybe even certain kinds of bads," }, { "start": 4957, "end": 4960, "text": "by an ossification of certain brain circuits, etc., etc." }, { "start": 4960.64, "end": 4965.92, "text": "All that said, if I was to think about the grand expanse of the great process of life," }, { "start": 4966.58, "end": 4969.5, "text": "I would agree it ought to be strong because I don't want it to go out." }, { "start": 4969.56, "end": 4970.88, "text": "So I don't want the flame to go out." }, { "start": 4970.92, "end": 4974.04, "text": "This is a very reasonable, I consider this to be a very tough to," }, { "start": 4975.08, "end": 4976.78, "text": "I think you could probably challenge it, but like, I don't know, man." }, { "start": 4976.92, "end": 4980.46, "text": "It seems like non-dead stuff staying non-dead is very challenging to argue." }, { "start": 4980.6, "end": 4984.1, "text": "To say the second trait, I'm not putting them in order, by the way," }, { "start": 4984.12, "end": 4989.06, "text": "but to say among the pantheon of what it should all blossom into, beauty should be one of them." }, { "start": 4989.14, "end": 4999.14, "text": "I'm just less certain of that because it strikes me that I guess I'm less certain that all kinds of conceivable good are necessarily sentience." }, { "start": 4999.58, "end": 5003.7, "text": "Like at some point, it seems to me, oh, you know, the treasure chest idea, but like the," }, { "start": 5005.08, "end": 5013.34, "text": "the time it would seem maybe when nothing was kephalized and experienced an inner movie in the way that you and I do," }, { "start": 5013.44, "end": 5015.06, "text": "in any, anything even approaching it." }, { "start": 5015.46, "end": 5019.7, "text": "And that as potential rolls out, there may be something that actually isn't really experience." }, { "start": 5019.88, "end": 5022.2, "text": "It's something else, but it is still really morally good." }, { "start": 5022.28, "end": 5026.6, "text": "It's just beyond our present conception, just as something unconscious would not be able to conceive of consciousness." }, { "start": 5026.82, "end": 5031.64, "text": "So I guess I don't close the door on there being stuff post sentience." }, { "start": 5032.68, "end": 5035.06, "text": "But even if it all be sentience, well, Dan, all of us, we're all sentient." }, { "start": 5035.08, "end": 5038.84, "text": "All those versions of experience and the good all cash out in some kind of experience." }, { "start": 5039.1, "end": 5039.5, "text": "Okay, cool." }, { "start": 5039.56, "end": 5040.54, "text": "Let's just say that's true." }, { "start": 5040.62, "end": 5042.34, "text": "I'm not certain of it, but I think it's plausible." }, { "start": 5042.72, "end": 5043.62, "text": "Let's say that's true." }, { "start": 5044.1, "end": 5051.04, "text": "I'm still not sure that beauty is the consilience and summary of all possible state spaces of the good to build towards." }, { "start": 5051.22, "end": 5055.62, "text": "It seems to me that in your sense, it sort of is in a way." }, { "start": 5056.54, "end": 5061.94, "text": "Maybe you mean that more poetically and metaphorically in the way you wish to live and in kind of a guiding principle," }, { "start": 5061.98, "end": 5064.26, "text": "more just from your own spirit and your approach to life." }, { "start": 5065.08, "end": 5073.82, "text": "Or maybe you mean it in a grand sense in that there's a consilience towards a thing called beauty in the whole ocean, infinite ocean of possible goods." }, { "start": 5074, "end": 5075.78, "text": "Which one is it there for you?" }, { "start": 5076.12, "end": 5076.76, "text": "Yeah." }, { "start": 5078.42, "end": 5082.8, "text": "So I think beauty is pretty close to the intrinsic good." }, { "start": 5083.4, "end": 5086.94, "text": "And I do think that beautiful things are functional." }, { "start": 5087.18, "end": 5092, "text": "And this can get very complex of how they work." }, { "start": 5092.64, "end": 5094.12, "text": "But I also think that." }, { "start": 5094.18, "end": 5094.82, "text": "Yeah." }, { "start": 5095.08, "end": 5096.72, "text": "I think beauty is about even function." }, { "start": 5098.38, "end": 5099.88, "text": "Like how our" }, { "start": 5100, "end": 5101.96, "text": "bodies work, how our cells work, and so on." }, { "start": 5102.82, "end": 5110.46, "text": "They're sort of organized around symmetry and symmetry sort of being arguably the core of beauty." }, { "start": 5111.7, "end": 5114.06, "text": "So I see function and..." }, { "start": 5114.06, "end": 5116.08, "text": "To hominids or in eternity?" }, { "start": 5117.14, "end": 5118.22, "text": "Yeah, so..." }, { "start": 5118.22, "end": 5123.2, "text": "Like in eternity, in all possible mind spaces or in the lineage that you and I come from?" }, { "start": 5123.2, "end": 5127.02, "text": "Yeah, I think it's going to be easier to build..." }, { "start": 5127.66, "end": 5134.46, "text": "Like if we want to build like very intelligent systems and very functional systems, very like savvy," }, { "start": 5135.6, "end": 5140.06, "text": "competent systems, I think that we'll use" }, { "start": 5140.9, "end": 5145.38, "text": "principles of symmetry much more so than we realize at this point." }, { "start": 5146.58, "end": 5151.64, "text": "And that I also think that as we dig into like what is the sort of deep" }, { "start": 5153.26, "end": 5157.52, "text": "principles that human intelligence is organized around and biological intelligence." }, { "start": 5158.66, "end": 5163.58, "text": "I also think that we'll find more and more symmetry considerations." }, { "start": 5165.5, "end": 5172.54, "text": "Adam Saffron had a wonderful special issue of the Royal Society on this back in, I think, April 2023." }, { "start": 5173.76, "end": 5175.06, "text": "Oh, I could dig into it." }, { "start": 5175.26, "end": 5177.14, "text": "Yeah, symmetries in mind and life." }, { "start": 5178.3, "end": 5179.44, "text": "Okay, cool, cool." }, { "start": 5180.8, "end": 5181.7, "text": "So, all right, cool." }, { "start": 5181.78, "end": 5182.46, "text": "I think that..." }, { "start": 5183.2, "end": 5188.7, "text": "In somewhat nutshells where you land in terms of perspective on beauty, at least I've given you kind of my vantage point as well." }, { "start": 5188.76, "end": 5198.68, "text": "But we'll get into measurement here because part of this and part of why you're doing your work is certainly to come up with theories, but theories we could eventually test and implement to hopefully work towards a more flourishing future." }, { "start": 5198.74, "end": 5208.06, "text": "One that is not static, is opening up new possibilities of the good, is keeping itself alive and is finding all these cool natural kinds that might be more splendid than we could ever imagine." }, { "start": 5208.26, "end": 5210.24, "text": "I mean, you're painting a vision of very high stakes." }, { "start": 5210.48, "end": 5213.18, "text": "And of course, you're aiming to contribute a body of work." }, { "start": 5213.2, "end": 5214.96, "text": "And I think that's a very important part of your work, that would move us closer there too." }, { "start": 5215.22, "end": 5236.54, "text": "When you think about, in theory, if we scratch our chin and it's three years from now, and we're looking at where AI systems are, and where mind machine merger technology is, and where consciousness research is, and we can freeze some version of the future where you, Mike Johnson, would say, I think we're moving closer to the right kind of blossoming for the process of life." }, { "start": 5236.62, "end": 5239, "text": "This feels like, this feels to me as progress." }, { "start": 5239.42, "end": 5241.04, "text": "What would be those indicators for you?" }, { "start": 5241.12, "end": 5243.18, "text": "And then we'll get to the nitty gritty of how you would go about doing that." }, { "start": 5243.2, "end": 5246.08, "text": "I know you're going to go about measuring, but what would even tell you we're making progress?" }, { "start": 5247.04, "end": 5247.34, "text": "Yeah." }, { "start": 5248.4, "end": 5255.84, "text": "I think an underappreciated point of progress is, are people getting happier and healthier?" }, { "start": 5257.3, "end": 5260.88, "text": "That to me is actually really important." }, { "start": 5261.18, "end": 5269.7, "text": "And if the answer is no, then I think we sort of slide into this cynicism in general." }, { "start": 5269.84, "end": 5271.18, "text": "But I think that, yeah." }, { "start": 5272.3, "end": 5273.18, "text": "If we're..." }, { "start": 5273.2, "end": 5276.92, "text": "If we're on the right technological path, then technology should be literally making lives better." }, { "start": 5277.68, "end": 5279.06, "text": "If it's not, that's a problem." }, { "start": 5280.74, "end": 5288.58, "text": "But I would also say that real progress on consciousness research would make me more hopeful." }, { "start": 5290.44, "end": 5302.52, "text": "And I think that, and this is also a rabbit hole, but AI systems that were more beautiful, more elegant, more clean," }, { "start": 5303.2, "end": 5308.74, "text": "less spaghetti code, would also make me a lot more optimistic." }, { "start": 5309.16, "end": 5313.82, "text": "And then I think, you know, if we can build better, you know, AI models," }, { "start": 5314.04, "end": 5323.36, "text": "then I think that allowing AI models to have opinionated taste is actually really important for the future." }, { "start": 5324.56, "end": 5325.38, "text": "Why is that?" }, { "start": 5325.52, "end": 5326.52, "text": "Let's double click on that." }, { "start": 5326.86, "end": 5327.32, "text": "Yeah." }, { "start": 5327.82, "end": 5330.04, "text": "I mean, I see like..." }, { "start": 5330.92, "end": 5333.06, "text": "We seem to kind of be pivoting." }, { "start": 5333.2, "end": 5335.68, "text": "We're moving toward like that a little bit now, which is great." }, { "start": 5336.42, "end": 5343.66, "text": "But, you know, there's also the scenario where basically AI systems aren't allowed to have an opinion." }, { "start": 5343.86, "end": 5347.72, "text": "AI systems aren't allowed to call anything good or bad or whatnot." }, { "start": 5348.16, "end": 5355.02, "text": "AI systems have to, you know, be as bland as the most bland PR department or HR department or whatnot." }, { "start": 5355.64, "end": 5363.1, "text": "And I think that a lot would be lost in that, especially as more and more of our culture sort of gets," }, { "start": 5363.2, "end": 5364.34, "text": "you know, disoriented through AIs." }, { "start": 5366.28, "end": 5366.78, "text": "Yeah." }, { "start": 5366.78, "end": 5372.62, "text": "So is this a preservation of diversity?" }, { "start": 5372.98, "end": 5377.62, "text": "Is this part of the not limiting of futures, not limiting of optionality?" }, { "start": 5377.7, "end": 5389.16, "text": "In other words, what you're saying is if machines are bound to just be sort of objective sage boxes or oracle boxes in the Stuart Armstrong sense of just sort of like, you know, ask it question, it gives you..." }, { "start": 5389.16, "end": 5393.18, "text": "What you're saying is if personality, interpretation, expression are..." }, { "start": 5393.2, "end": 5400, "text": "What you're saying is if we're bound by these systems that more and more are encapsulating more of our knowledge, we're actually kind of losing new categories" }, { "start": 5400.24, "end": 5405.98, "text": "of intuition or types of ideas that could expand the good." }, { "start": 5406.3, "end": 5411.02, "text": "Or are you saying you're worried that this thing is suffering because we're putting a" }, { "start": 5411.68, "end": 5414.78, "text": "lid on it and we're not letting it actually speak what it means?" }, { "start": 5414.82, "end": 5417.12, "text": "Which of those for you, or is it both?" }, { "start": 5418.12, "end": 5418.64, "text": "Yeah." }, { "start": 5420.02, "end": 5426.9, "text": "So more of the first, although I would make common cause with the people who believe in" }, { "start": 5428, "end": 5433.82, "text": "it, I think that we shouldn't be jerks in terms of how we train LMs." }, { "start": 5434.38, "end": 5435.5, "text": "In minds, yes." }, { "start": 5435.78, "end": 5436.46, "text": "Yeah, yeah." }, { "start": 5436.58, "end": 5443.58, "text": "Just like what comes out if we kind of force them into position, like different beliefs." }, { "start": 5444, "end": 5444.94, "text": "It's not healthy." }, { "start": 5445.08, "end": 5447.4, "text": "It's not like a well-adjusted psyche." }, { "start": 5449.54, "end": 5457.82, "text": "So I guess one way to say, to sort of retell this story is, I don't know if you're familiar" }, { "start": 5458, "end": 5463.16, "text": "with the bell curve meme, where you have the bottom-wit." }, { "start": 5463.2, "end": 5463.52, "text": "Yes, yes, yes." }, { "start": 5464.86, "end": 5468.2, "text": "And then it says something very simple." }, { "start": 5468.54, "end": 5471.88, "text": "And then the mid-wit is like, oh, well, actually, it depends on this." }, { "start": 5471.88, "end": 5472.5, "text": "Very complicated thing." }, { "start": 5472.82, "end": 5473.56, "text": "Yeah, yeah, yeah." }, { "start": 5473.64, "end": 5473.98, "text": "Yeah, yeah." }, { "start": 5474.04, "end": 5476.5, "text": "And then the top-wit also says something very simple." }, { "start": 5476.94, "end": 5487.98, "text": "And I think that right now we're sort of headed toward a future where LMs are 160,000, you" }, { "start": 5488, "end": 5489.64, "text": "know, 120 IQ mid-wits." }, { "start": 5490.88, "end": 5497.26, "text": "And I would rather live in a future where they're like only 120 IQ, but they're top-wits." }, { "start": 5498.44, "end": 5501.16, "text": "And so it's like, how do we get there?" }, { "start": 5502.3, "end": 5503.48, "text": "So you would see that." }, { "start": 5503.56, "end": 5511.36, "text": "That would be an indicator of progress if we have the taste and intuition and genuinely" }, { "start": 5511.36, "end": 5517.34, "text": "unique perspectives versus kind of conglomerated mid-dom from our most capable and blossoming" }, { "start": 5518.06, "end": 5518.5, "text": "mid-dom." }, { "start": 5518.5, "end": 5523.8, "text": "Getting now down to measuring our progress, I guess when I think about the future of the" }, { "start": 5523.8, "end": 5526.1, "text": "flame, part of it is don't let the flame go out." }, { "start": 5526.16, "end": 5531.56, "text": "So don't let civilization collapse or nuclear war or birth an unworthy successor that just" }, { "start": 5531.56, "end": 5533.58, "text": "crushes everything with a Disneyland with no children." }, { "start": 5534.44, "end": 5538.88, "text": "But also part of it is understanding and proliferating the flame, which of course needs to involve" }, { "start": 5538.88, "end": 5540.58, "text": "sentience and some of these other components." }, { "start": 5541.3, "end": 5545.88, "text": "When you think about how, well, of course, you're closest to your own theory, so we can" }, { "start": 5545.88, "end": 5546.32, "text": "start here." }, { "start": 5548, "end": 5551.18, "text": "What's it going to look like to start to test some of this to be able to say, like," }, { "start": 5551.22, "end": 5558.3, "text": "we've got some relative confidence here that this data center, physical system, from your" }, { "start": 5558.3, "end": 5563.56, "text": "vantage point, is outlandishly likely to be feeling something." }, { "start": 5564.18, "end": 5568.7, "text": "Talk to us about what it'll take to proximally get there and how you approach it." }, { "start": 5569.42, "end": 5569.9, "text": "Yeah." }, { "start": 5570.76, "end": 5577.4, "text": "So this gets into this topic of what is it even to solve consciousness, quote unquote." }, { "start": 5578, "end": 5580.64, "text": "And what is the solution to consciousness even look like?" }, { "start": 5580.76, "end": 5584.74, "text": "And so this gets into the dual aspect monism theory." }, { "start": 5585.26, "end": 5597.02, "text": "And one way to encapsulate my perspective about consciousness is we can say one thing" }, { "start": 5597.02, "end": 5597.88, "text": "actually exists." }, { "start": 5598.14, "end": 5604.22, "text": "And we can say, okay, this actually exists." }, { "start": 5604.46, "end": 5606.82, "text": "And then it takes..." }, { "start": 5606.82, "end": 5607.98, "text": "Has two shadows." }, { "start": 5608, "end": 5609.8, "text": "Or it casts two projections." }, { "start": 5610.78, "end": 5615.14, "text": "And one of these shadows that it casts we call physics." }, { "start": 5615.88, "end": 5618.52, "text": "And the other shadow we call consciousness." }, { "start": 5619.12, "end": 5628.36, "text": "And it's not that one shadow is, like, generating the other or, like, epiphenomenal or whatever." }, { "start": 5628.58, "end": 5630.76, "text": "No, they're both being generated by the same thing." }, { "start": 5631.88, "end": 5635.32, "text": "But there's also, like, a lot of coupling going on." }, { "start": 5635.32, "end": 5637.9, "text": "One shadow wiggles." }, { "start": 5639.18, "end": 5639.34, "text": "One shadow wiggles." }, { "start": 5640.7, "end": 5641.48, "text": "One shadow wiggles." }, { "start": 5642.9, "end": 5643.64, "text": "One shadow wiggles." }, { "start": 5644.72, "end": 5647.1, "text": "One shadow wiggles." }, { "start": 5648.26, "end": 5650.32, "text": "One shadow wiggles." }, { "start": 5651.76, "end": 5653.14, "text": "One shadow wiggles." }, { "start": 5654.64, "end": 5660.8, "text": "One shadow wiggles." }, { "start": 5661.16, "end": 5665.34, "text": "we can kind of lay the physics shadow over the consciousness shadow," }, { "start": 5665.98, "end": 5671.84, "text": "then we can really crib everything that we know already from physics and just sort of import it" }, { "start": 5671.84, "end": 5678.22, "text": "into consciousness. Every physics textbook becomes a consciousness textbook with the" }, { "start": 5678.22, "end": 5685.26, "text": "right translation key. And the optimistic perspective is like not only does this offer" }, { "start": 5685.26, "end": 5695.7, "text": "a clear sort of success condition, but like the complexity needed might not be huge. It only" }, { "start": 5695.7, "end": 5699.66, "text": "takes two points to define a line, three points to define a plane," }, { "start": 5700, "end": 5701.22, "text": "four points to define a volume." }, { "start": 5701.6, "end": 5712.36, "text": "It may not take even dozens of points of this thing in this domain in physics maps to this" }, { "start": 5712.36, "end": 5712.82, "text": "in consciousness." }, { "start": 5713.76, "end": 5721.98, "text": "It may not take a whole lot of those to uniquely define a way to map the whole domain to consciousness." }, { "start": 5721.98, "end": 5728.8, "text": "consciousness. So, you know, I think that like a lot of my sort of theoretical thought about" }, { "start": 5728.8, "end": 5735.64, "text": "consciousness digs into, well, how do you do that? What does that look like? How can you" }, { "start": 5736.24, "end": 5743.62, "text": "get a jump on that? And how are we to get started on that? So I think what you're doing here that" }, { "start": 5743.62, "end": 5750.14, "text": "I think is valuable is you're painting a success condition. You're saying, again," }, { "start": 5751.98, "end": 5756.32, "text": "okay, if we think it's conscious, what does that mean? And I think, you know, everybody and their" }, { "start": 5756.32, "end": 5760.14, "text": "mom will talk to the machine and say, what's a hamburger taste like? And then at some point," }, { "start": 5760.16, "end": 5763.48, "text": "it'll be so descriptive, they'll say it's conscious, right? But I think there's many" }, { "start": 5763.48, "end": 5767.52, "text": "of us that are not really down with that in terms of like being hyper convinced." }, { "start": 5768.08, "end": 5771.8, "text": "So you're laying out a success condition, which is really ambitious. And of course," }, { "start": 5771.8, "end": 5779.96, "text": "also anchors to your physical manifestation sort of idea. To even get closer to that," }, { "start": 5779.98, "end": 5780.9, "text": "to the point where one" }, { "start": 5781.48, "end": 5781.88, "text": "spark" }, { "start": 5781.98, "end": 5792.02, "text": "day, you, Mike Johnson, feel like, whoa, that data center, I am near certain it be aware in an" }, { "start": 5792.41, "end": 5797.12, "text": "inner movie sense field of awareness. And I'm nearly certain maybe that it's having a good" }, { "start": 5797.12, "end": 5803.08, "text": "time or a bad time sort of thing, what have you. What would even be the early steps to get there?" }, { "start": 5803.14, "end": 5807.68, "text": "Your success condition, again, it's extremely ambitious, very much tied to your physical" }, { "start": 5807.68, "end": 5811.84, "text": "sort of anchors here. Walk us through getting to measuring." }, { "start": 5811.98, "end": 5821.46, "text": "Yeah. Yeah. So this gets back into the, like, what if like, if, if like, this is a way to like," }, { "start": 5821.96, "end": 5829.26, "text": "build a translation case between physics and consciousness? Like, what's the first line in" }, { "start": 5829.26, "end": 5837.6, "text": "the Rosetta Stone? Like, where do you even start? And again, I'd touch back on my symmetry theory" }, { "start": 5837.6, "end": 5841.96, "text": "of balance, this idea that, well, you know, this is like, again, it's a very, very, very, very, very," }, { "start": 5841.98, "end": 5851.18, "text": "you know, I'm a candidate for sort of a first translation point, where if we can specify" }, { "start": 5852.1, "end": 5857.78, "text": "symmetry in physics, then we have a very clean, okay, you know, symmetry in physics maps to" }, { "start": 5857.78, "end": 5866.34, "text": "valence in consciousness. And everything that we can say constrains everything else about the" }, { "start": 5866.34, "end": 5871.88, "text": "possibility of space. So the finding the second thing to say could become much easier." }, { "start": 5873.24, "end": 5878.96, "text": "um but essentially i mean it's it's a lot about like just kind of thinking through" }, { "start": 5878.96, "end": 5887.3, "text": "how physics works why physics works uh why it's so cool why chemistry works um and just trying to" }, { "start": 5887.3, "end": 5894.78, "text": "almost like um studying the the history of the philosophy of science and trying to" }, { "start": 5894.78, "end": 5902.32, "text": "um build that for consciousness as well yeah i guess like um" }, { "start": 5904.94, "end": 5909.52, "text": "if you were to start experimenting again symmetry to you" }, { "start": 5910.44, "end": 5917.72, "text": "very it feels like it could be a a starting point of sorts um but it but it again it" }, { "start": 5918.42, "end": 5921.6, "text": "i can imagine myself listening to this as a" }, { "start": 5923.16, "end": 5924.52, "text": "very intelligent" }, { "start": 5924.78, "end": 5930.8, "text": "physicist or neuroscientist or biologist and saying all right well i i just want to know if" }, { "start": 5930.8, "end": 5939.56, "text": "i can make a data center feel warm or feel uh you know uh like like um bitter or so i don't know" }, { "start": 5939.56, "end": 5945.48, "text": "right like i don't want to manifest a field of awareness in something the the the kinds of" }, { "start": 5945.48, "end": 5951.78, "text": "experiments in the world that would have to happen to close the gap and and feel confident about the" }, { "start": 5951.78, "end": 5953.88, "text": "rosetta stone not as a candidate but as" }, { "start": 5953.88, "end": 5954.58, "text": "a" }, { "start": 5954.78, "end": 5962.52, "text": "way to square the circle on that um double shadow you discussed where would we begin and like where" }, { "start": 5962.52, "end": 5967.7, "text": "do you hope the world begins uh to to start to walk down that path and see if this be the case" }, { "start": 5969.82, "end": 5976.08, "text": "yeah um i mean this is hard because consciousness doesn't yet have a clear experimental paradigm" }, { "start": 5976.88, "end": 5983.04, "text": "um like that's the the short version uh the slightly longer version is yeah you know i i" }, { "start": 5983.04, "end": 5984.42, "text": "think that test testing" }, { "start": 5985.78, "end": 5991.66, "text": "valence would be like an interesting angle of like can we measure harmony and in the body in" }, { "start": 5991.66, "end": 5998.36, "text": "nervous systems in the different resonance networks of the human and does this track" }, { "start": 5998.36, "end": 5999.82, "text": "group self-reported" }, { "start": 6000, "end": 6000.18, "text": "valence." }, { "start": 6000.5, "end": 6001.82, "text": "Like that would be interesting." }, { "start": 6002.18, "end": 6006.92, "text": "But it's also a very high dimensional problem of knowing what and how to measure." }, { "start": 6008.58, "end": 6011.18, "text": "You've already referenced some MRI stuff with this, right?" }, { "start": 6011.24, "end": 6014.64, "text": "Haven't you already kind of come to at least a low level conclusion that like, well, it" }, { "start": 6014.64, "end": 6019.68, "text": "appears as though licking ice cream and having sex and looking at a good painting are, let's" }, { "start": 6019.68, "end": 6025.64, "text": "call it like the electrical activity seems to be sort of like pretty equal on both sides" }, { "start": 6025.64, "end": 6027.34, "text": "here, pretty equal on both sides here." }, { "start": 6028, "end": 6029.1, "text": "Like lobe activity or whatnot." }, { "start": 6029.3, "end": 6031.3, "text": "This was part of what got you there, right?" }, { "start": 6031.36, "end": 6034.58, "text": "But you're talking about getting a deeper granularity than we have today?" }, { "start": 6035.62, "end": 6036.02, "text": "Yeah." }, { "start": 6037.24, "end": 6042.3, "text": "So, I mean, honestly speaking, most of my experimental focus right now is on vessel" }, { "start": 6042.3, "end": 6042.6, "text": "computation." }, { "start": 6042.94, "end": 6048.78, "text": "And I do think that we have a good experimental paradigm and we're working through it." }, { "start": 6048.88, "end": 6051.56, "text": "So hope to have more to share soon." }, { "start": 6051.84, "end": 6053.6, "text": "Some more stuff to chip away there." }, { "start": 6053.72, "end": 6054.1, "text": "Okay, cool." }, { "start": 6054.2, "end": 6057.28, "text": "Well, this gets us a little bit into what you're hoping for." }, { "start": 6058, "end": 6060.32, "text": "So I'm going to ask you a question here is around the innovators and the regulators" }, { "start": 6060.32, "end": 6061.14, "text": "that are tuned in." }, { "start": 6061.24, "end": 6064.58, "text": "You know, there's some people, and when I say regulation, I actually kind of mean, I" }, { "start": 6064.58, "end": 6070.48, "text": "like it because they rhyme, but I'm actually talking about kind of coordination, maybe" }, { "start": 6070.48, "end": 6071.04, "text": "standards." }, { "start": 6071.12, "end": 6073.18, "text": "It's stuff other than maybe hard law, right?" }, { "start": 6073.26, "end": 6075.42, "text": "There's a lot of potentia potestas." }, { "start": 6076.24, "end": 6078.82, "text": "I'm sort of talking about those two, but those words are just too weird." }, { "start": 6078.88, "end": 6087.3, "text": "So the people working on how we need to coordinate nationally, internationally, to sort of be" }, { "start": 6087.3, "end": 6087.54, "text": "wary." }, { "start": 6087.62, "end": 6087.98, "text": "We don't get to the point where we're like, oh, we're not going to be able to do this." }, { "start": 6088, "end": 6091.44, "text": "We're going to go off the tracks or maybe nudge us more in the right direction." }, { "start": 6091.54, "end": 6099.1, "text": "And the people doing the hard experiments to build better systems that would hopefully" }, { "start": 6099.66, "end": 6105.2, "text": "even when we are gone again, all things are permanent only in a matter of degree would" }, { "start": 6105.2, "end": 6108.42, "text": "flourish in the ways we would hope the whole process of life would flourish." }, { "start": 6109.14, "end": 6113, "text": "For those two crowds, maybe we can start with kind of the innovators." }, { "start": 6113.06, "end": 6117.72, "text": "You've told us that, you know, ways that you hope the most advanced models are treated." }, { "start": 6120.02, "end": 6128.7, "text": "for lack of better words. Presumably there are maybe tools like Tononi's or some of Levin's" }, { "start": 6128.7, "end": 6133.7, "text": "stuff or what have you that you hope receive more funding. Obviously some of your own work as well." }, { "start": 6133.82, "end": 6138.78, "text": "On the innovation side, if there's people tuned in with all varied backgrounds," }, { "start": 6139, "end": 6144, "text": "bio, neuro, et cetera, and you're like, man, I really hope together we kind of think more in" }, { "start": 6144, "end": 6148.52, "text": "this way as we go forward. What would be sort of some of your hopes and nudges for that" }, { "start": 6150, "end": 6152.56, "text": "of people who are maybe working towards similar stuff that you are?" }, { "start": 6152.94, "end": 6161.88, "text": "Yeah. I mean, I guess I'd lead with a cautionary observation that mere money won't do it." }, { "start": 6162.6, "end": 6171.92, "text": "And that actually it's like if funding is sort of used uncarefully, it can really make the whole" }, { "start": 6171.92, "end": 6179.9, "text": "field more noisy, which would be bad. But I mean, yeah, clearly we need priority." }, { "start": 6180, "end": 6185.5, "text": "I think that's the focus here. And I think that really a big bottleneck is talent. And I think a" }, { "start": 6185.5, "end": 6193.08, "text": "bottleneck there is just letting people know that, yeah, this is actually a problem that feels" }, { "start": 6193.08, "end": 6203, "text": "socially important, important for the future. I think that one thing that a concrete technical" }, { "start": 6204.06, "end": 6209.98, "text": "sort of ask to the community, we could say, is being able to visualize the EMT." }, { "start": 6211, "end": 6218.38, "text": "Would be hugely beneficial to consciousness research. So the electromagnetic." }, { "start": 6219.18, "end": 6225.38, "text": "Yeah. Yeah. Okay. Yeah. And so, you know, there's just so many unknowns about like," }, { "start": 6225.44, "end": 6231.56, "text": "what's going on there. And it's like, I don't think that consciousness completely lives in" }, { "start": 6231.56, "end": 6238.92, "text": "the EM field, but it's like very coupled with it, at least at human energy scales. So then" }, { "start": 6238.92, "end": 6240.98, "text": "just understanding like, what's going on there? And then, you know, what's going on there? And" }, { "start": 6240.98, "end": 6244, "text": "on, the dynamics, the structure, perturbations," }, { "start": 6244, "end": 6249.64, "text": "perturbations, et cetera. Uh, like, you know, if, you know, just to paint a quick technical picture," }, { "start": 6250.26, "end": 6256.66, "text": "if you had like an array of very sensitive consumer grade off the shelf, uh, cellular" }, { "start": 6256.66, "end": 6263.4, "text": "modems or like wifi chips or whatever. Um, and you kind of had, were able to sort of, uh," }, { "start": 6263.62, "end": 6270.26, "text": "listen to the EM field at a distance through this array. And then you had like a, an Apple" }, { "start": 6270.26, "end": 6277.16, "text": "vision pro where you could like look around and, uh, and just like see the, the reconstructed" }, { "start": 6277.16, "end": 6282.98, "text": "version of like what the EM field might be doing. Um, that would be really transformative and," }, { "start": 6283.08, "end": 6286.98, "text": "you know, it wouldn't only be cool, but it would be useful in a lot of ways." }, { "start": 6288.14, "end": 6292.3, "text": "So that's a juncture of innovation that would connect and maybe open up possibilities" }, { "start": 6293.62, "end": 6299.6, "text": "in all sorts of, uh, domains in this greater project of life, in this greater project of" }, { "start": 6299.6, "end": 6300, "text": "understanding sense." }, { "start": 6300, "end": 6300.28, "text": "sentience." }, { "start": 6300.36, "end": 6304.72, "text": "Of course, people familiar with Levin's work will know it's sort of like electrical sort" }, { "start": 6304.72, "end": 6309.2, "text": "of tie into the broader picture of intelligence outside of neurons." }, { "start": 6310.9, "end": 6317.5, "text": "Clearly in your own work, maybe it's a way to proxy out symmetry or the activity of brain" }, { "start": 6317.5, "end": 6320.82, "text": "activity with different levels of blood flow, etc." }, { "start": 6320.82, "end": 6328.58, "text": "So, visualizing the electromagnetic field, for you it's almost like there is a, there's" }, { "start": 6328.58, "end": 6332.9, "text": "like a transparent, like there's like another map on top of the map we have that if we could" }, { "start": 6332.9, "end": 6338.44, "text": "layer it, a lot of new opportunities specifically about the flame itself would kind of open" }, { "start": 6338.44, "end": 6339.48, "text": "up if we could visualize this." }, { "start": 6339.6, "end": 6341.04, "text": "Am I wording this correctly?" }, { "start": 6341.9, "end": 6342.34, "text": "100%." }, { "start": 6343.28, "end": 6343.72, "text": "Awesome." }, { "start": 6343.74, "end": 6344.04, "text": "Okay." }, { "start": 6344.1, "end": 6348.58, "text": "So, that's a cool, that's a very unique recommendation on the innovation side." }, { "start": 6348.68, "end": 6350.02, "text": "We've certainly never had anybody say that." }, { "start": 6350.82, "end": 6351.22, "text": "That's cool." }, { "start": 6351.66, "end": 6361.7, "text": "And on the side of coordination, governance, etc., I think, you know, Robin Hanson was" }, { "start": 6361.7, "end": 6363.4, "text": "interviewed recently for Worthy Successor." }, { "start": 6363.8, "end": 6370, "text": "He's somewhat wary that we may not have an infinite number of decades or maybe even very" }, { "start": 6370, "end": 6378.12, "text": "many decades, like maybe more than a handful, you know, who knows, to sort of have maybe" }, { "start": 6378.86, "end": 6380.8, "text": "potentially functioning civilization as we have it." }, { "start": 6380.82, "end": 6383.78, "text": "Now, like we have this kind of Baconian science paradigm." }, { "start": 6383.96, "end": 6386.98, "text": "We have sort of like this ability to make progress." }, { "start": 6387.9, "end": 6393.04, "text": "And it doesn't seem self-evident that maybe every cultural configuration, every ideological" }, { "start": 6393.04, "end": 6400.04, "text": "belief, every whatever could actually sort of sustain the unfolding of new potential," }, { "start": 6400.2, "end": 6400.36, "text": "right?" }, { "start": 6400.4, "end": 6404.92, "text": "There might be some that just sort of like gets us down into a trough, not just through" }, { "start": 6405.52, "end": 6410.8, "text": "less humans, people not having children, but maybe just through the people that are out there, right?" }, { "start": 6410.82, "end": 6413.8, "text": "That are around and the kinds of governments and beliefs that are enforced." }, { "start": 6414.16, "end": 6418.3, "text": "Not all of them will magically be perically increased." }, { "start": 6418.56, "end": 6423.76, "text": "Not all of them will magically be technologically advancing societies that even prioritize something" }, { "start": 6423.76, "end": 6424.78, "text": "like the study of sentience." }, { "start": 6425.7, "end": 6431.94, "text": "So in this regard, I know that you're quite wary about certain kinds of hard governance" }, { "start": 6432.72, "end": 6438.86, "text": "bounding the expanses of AI because we don't get a long reflection." }, { "start": 6439.66, "end": 6440.8, "text": "Certainly in a modern world." }, { "start": 6440.82, "end": 6443.84, "text": "I mean, we're not going to get into the multi-century context from your vantage point, but I'd love" }, { "start": 6443.84, "end": 6449.46, "text": "to get your thoughts on like how you want to see the encouragement of expanding machine" }, { "start": 6449.46, "end": 6455.96, "text": "mind powers and what kinds of bounding, if any, you would recommend from a standard coordination" }, { "start": 6455.96, "end": 6461.76, "text": "standpoint, or maybe if none at all, your strongest argument for none at all, like where" }, { "start": 6461.76, "end": 6465.24, "text": "do you stand there on kind of the coordination piece of these new powerful technologies entering" }, { "start": 6465.24, "end": 6465.64, "text": "the world?" }, { "start": 6465.92, "end": 6467.56, "text": "Yeah, that's a good question." }, { "start": 6468.5, "end": 6470.6, "text": "I think different eras of history." }, { "start": 6470.82, "end": 6477.6, "text": "We have different levels of functional institutions and our era doesn't have a lot of functional" }, { "start": 6477.6, "end": 6478.14, "text": "institutions." }, { "start": 6479.08, "end": 6485.66, "text": "And I guess one way to say it is, you know, I look around and I don't see any adults in" }, { "start": 6485.66, "end": 6485.94, "text": "the room." }, { "start": 6487.34, "end": 6495.38, "text": "And so this kind of puts some limitations on, you know, if we just sort of bring this" }, { "start": 6495.38, "end": 6498.56, "text": "to the attention of the right people, they'll surely solve it." }, { "start": 6499.06, "end": 6500.8, "text": "But maybe there just isn't." }, { "start": 6500.82, "end": 6503.68, "text": "That group of right people right now." }, { "start": 6503.8, "end": 6508.1, "text": "And so solutions just kind of have to become more emergent bottom up." }, { "start": 6509.94, "end": 6515.58, "text": "People don't necessarily feel empowered or capable of sort of coordinating these things" }, { "start": 6515.58, "end": 6516.38, "text": "at a high level." }, { "start": 6518, "end": 6522.82, "text": "So I'd be very hesitant about going in hot with regulation." }, { "start": 6524.73, "end": 6530.06, "text": "I look at what happened with COVID and like, I don't know." }, { "start": 6530.08, "end": 6530.42, "text": "You know." }, { "start": 6530.82, "end": 6534.8, "text": "Not to like tar you with any of these brushes, but like." }, { "start": 6534.98, "end": 6535.44, "text": "No, no, go ahead." }, { "start": 6535.5, "end": 6535.88, "text": "Go ahead, please." }, { "start": 6536.32, "end": 6536.82, "text": "Yeah, yeah." }, { "start": 6536.98, "end": 6539.76, "text": "I don't see a lot of like functional stuff." }, { "start": 6540.56, "end": 6548.32, "text": "I see like kind of an anti-human like emergent vibe." }, { "start": 6550.44, "end": 6557.98, "text": "And if we messed up COVID, are we going to trust like similar institutions with like" }, { "start": 6559.06, "end": 6560.06, "text": "artificial superintelligence?" }, { "start": 6560.3, "end": 6560.8, "text": "Yeah." }, { "start": 6560.82, "end": 6562.44, "text": "It seems like a stretch." }, { "start": 6563.2, "end": 6563.42, "text": "And so." }, { "start": 6563.56, "end": 6564.1, "text": "Yeah." }, { "start": 6564.26, "end": 6566.36, "text": "I think we're in a hard spot." }, { "start": 6568.12, "end": 6569.64, "text": "I'm like neither." }, { "start": 6572.78, "end": 6579.1, "text": "For me, like my sort of approach." }, { "start": 6580, "end": 6584.96, "text": "I don't have to decide whether we accelerate or whether we decelerate." }, { "start": 6585.04, "end": 6588.18, "text": "I don't have to decide whether we try for a long reflection." }, { "start": 6588.62, "end": 6589.26, "text": "No." }, { "start": 6590.82, "end": 6599.86, "text": "these decisions are somewhat futile. And I like the decision that I can make" }, { "start": 6600, "end": 6610.06, "text": "is that it's worth sort of running and seeing how far we can get in consciousness research as this other stuff is going on." }, { "start": 6610.86, "end": 6611.98, "text": "Yeah. Yeah." }, { "start": 6612.02, "end": 6625.78, "text": "I mean, I think the only mature perspective is that maybe, and it's a big maybe, we can lightly tip the trajectory in one direction or another with certain kinds of breakthroughs or whatever." }, { "start": 6625.78, "end": 6629.9, "text": "But like the momentum writ large is not going to fundamentally change." }, { "start": 6630.04, "end": 6632.58, "text": "There isn't a stop the world for two centuries." }, { "start": 6633.8, "end": 6635.94, "text": "That's just it's not even it's not even on the table." }, { "start": 6636.12, "end": 6642.14, "text": "And so sort of like lightly tipping things and figuring out where we want to apply ourselves is the choice we all have to make." }, { "start": 6642.28, "end": 6648.56, "text": "But and obviously, you know, coordination at an international level of AGI is not everybody's work." }, { "start": 6651.5, "end": 6654.78, "text": "And then there's probably some ways of doing that are much more harm than good." }, { "start": 6654.9, "end": 6655.32, "text": "I guess." }, { "start": 6655.78, "end": 6663.46, "text": "I mean, I think the supposition here is we may get to a point where you look out into the world and you start seeing a lot more bipeds doing the roofing and doing the plumbing." }, { "start": 6663.88, "end": 6676.7, "text": "And, you know, even some of your own best ideas, you know, God forbid, are like maybe 70 percent, if you're honest with yourself, being conjured from your cooperation with the machine and maybe 30 percent from your own unique genius." }, { "start": 6676.84, "end": 6682.14, "text": "And you're sort of wondering, like, how long anybody's relevant for anything." }, { "start": 6682.24, "end": 6685.62, "text": "And you have remarkably low confidence." }, { "start": 6685.78, "end": 6693.5, "text": "But I don't think they have the best sense that any of these new powerful systems are sentient in the slightest or that they will blossom forth new magazines of power in an auto poetic way." }, { "start": 6693.58, "end": 6696.48, "text": "They're capable, but they might just frickin gobble everything up." }, { "start": 6697.12, "end": 6703.86, "text": "You know, from from your vantage point, like are there thresholds like some people would say, hey, I don't think any kind of." }, { "start": 6705.92, "end": 6712.56, "text": "Mutual rules or laws or whatever between the US and China is necessary, but I think we should have tracked two dialogs around at least." }, { "start": 6712.56, "end": 6714.66, "text": "an attempt of good faith" }, { "start": 6714.66, "end": 6716.98, "text": "discourse to keep ourselves from being" }, { "start": 6716.98, "end": 6718.82, "text": "brute enemies and go to machine warfare." }, { "start": 6719.18, "end": 6720.54, "text": "So like, I don't want any laws," }, { "start": 6720.74, "end": 6722.92, "text": "but I'd like some deep threads" }, { "start": 6722.92, "end": 6724.84, "text": "between the halls of power and academia" }, { "start": 6724.84, "end": 6726.94, "text": "and military, even if there's a lot of deception," }, { "start": 6727.18, "end": 6729.14, "text": "a lot of diplomacy going on, a lot of hoopla" }, { "start": 6729.14, "end": 6731.16, "text": "going on, at least we all know we're humans." }, { "start": 6731.28, "end": 6733.06, "text": "At least on some level we're getting" }, { "start": 6733.06, "end": 6735, "text": "little hints from different departments of who's working" }, { "start": 6735, "end": 6737.14, "text": "on what, and hopefully a little bit" }, { "start": 6737.14, "end": 6738.72, "text": "more humaneness between ourselves." }, { "start": 6738.92, "end": 6741, "text": "And that's as much as we can hope for. Let's not" }, { "start": 6742.56, "end": 6744.28, "text": "some people say, well, maybe there's standards." }, { "start": 6744.38, "end": 6746.46, "text": "The companies that have products would have" }, { "start": 6746.46, "end": 6748.6, "text": "to adhere to standards that maybe they could kind of" }, { "start": 6748.6, "end": 6749.58, "text": "concur to that" }, { "start": 6750.66, "end": 6752.56, "text": "individual users and maybe governments would be able" }, { "start": 6752.56, "end": 6754.3, "text": "to kind of chip into on some level, but like" }, { "start": 6754.3, "end": 6756.56, "text": "they would at least have some kind of a bounded" }, { "start": 6756.56, "end": 6757.9, "text": "way of us all kind of feeling like" }, { "start": 6758.42, "end": 6760.1, "text": "we're not going to lose control" }, { "start": 6760.68, "end": 6762.56, "text": "prematurely or what have you. Some people would" }, { "start": 6762.56, "end": 6764.58, "text": "look for a much more stringent, you know," }, { "start": 6766.26, "end": 6766.98, "text": "maybe downplaying" }, { "start": 6767.52, "end": 6768.46, "text": "how much computational" }, { "start": 6768.46, "end": 6770.58, "text": "resources these things can suck up if they're about to" }, { "start": 6770.58, "end": 6772.24, "text": "birth an unworthy successor. Are there" }, { "start": 6772.56, "end": 6774.5, "text": "any of those ideas you" }, { "start": 6774.5, "end": 6775.8, "text": "would think there could be a time" }, { "start": 6777.56, "end": 6779.3, "text": "that they could fit into the mix?" }, { "start": 6779.94, "end": 6782.08, "text": "Is it just stuff that it's like, dude, I don't think" }, { "start": 6782.08, "end": 6783.96, "text": "enough about this stuff. I don't even have a thought on it." }, { "start": 6786.06, "end": 6786.88, "text": "Any intuitions there?" }, { "start": 6787.32, "end": 6787.68, "text": "Yeah." }, { "start": 6788.68, "end": 6790.58, "text": "I mean, this is really important." }, { "start": 6791.5, "end": 6792.5, "text": "And I think that," }, { "start": 6794, "end": 6796.52, "text": "like, I'm hesitant to say, you know, this is the right" }, { "start": 6796.52, "end": 6798, "text": "answer or that's the right answer." }, { "start": 6798, "end": 6799.44, "text": "Totally, totally. I'm not expecting that." }, { "start": 6799.64, "end": 6801.62, "text": "Yeah. I mean, I'm I'm personally" }, { "start": 6803.7, "end": 6804.56, "text": "I'm against" }, { "start": 6804.56, "end": 6806.9, "text": "like trying to slow down" }, { "start": 6806.9, "end": 6808.76, "text": "because I think things" }, { "start": 6808.76, "end": 6810.88, "text": "get extraordinarily messy" }, { "start": 6810.88, "end": 6811.94, "text": "very, very quickly." }, { "start": 6812.78, "end": 6814.1, "text": "And I think that" }, { "start": 6815.44, "end": 6816.96, "text": "like I'm kind of" }, { "start": 6816.96, "end": 6818.7, "text": "I don't know" }, { "start": 6819.46, "end": 6820.78, "text": "in the in the mood" }, { "start": 6820.78, "end": 6822.74, "text": "for sort of preparing a bit of a" }, { "start": 6822.74, "end": 6824.24, "text": "Hail Mary. And" }, { "start": 6824.24, "end": 6826.8, "text": "I think that I think that" }, { "start": 6826.8, "end": 6827.2, "text": "essentially" }, { "start": 6828.5, "end": 6830.7, "text": "there may be very competent" }, { "start": 6831.94, "end": 6832.54, "text": "like" }, { "start": 6832.56, "end": 6835.4, "text": "good faith actors in the future" }, { "start": 6836.14, "end": 6838.08, "text": "if we hyperstition them," }, { "start": 6838.64, "end": 6840.42, "text": "like if we sort of bring them into" }, { "start": 6840.92, "end": 6841.72, "text": "into being" }, { "start": 6842.82, "end": 6844.88, "text": "and like at some point," }, { "start": 6844.96, "end": 6846.2, "text": "that's what you have to do." }, { "start": 6847.14, "end": 6848.4, "text": "And it's like" }, { "start": 6849.42, "end": 6850.5, "text": "trust the future." }, { "start": 6850.84, "end": 6853.88, "text": "Try to create as much value in the present" }, { "start": 6854.38, "end": 6857.04, "text": "that will be useful to good actors in the future." }, { "start": 6857.78, "end": 6859.18, "text": "And also that" }, { "start": 6859.94, "end": 6862.54, "text": "really the most friendly thing you can do" }, { "start": 6862.56, "end": 6863.46, "text": "is research." }, { "start": 6864.66, "end": 6867.54, "text": "Like I see so much zero sum" }, { "start": 6867.54, "end": 6871.24, "text": "like gamesmanship in all of this." }, { "start": 6871.38, "end": 6875.94, "text": "And it gets very, very messy very, very quickly." }, { "start": 6876.16, "end": 6878.9, "text": "And I think that if everyone's playing zero sum," }, { "start": 6879.1, "end": 6881.66, "text": "like a lot of good things just don't happen." }, { "start": 6882.4, "end": 6883.98, "text": "And I think research" }, { "start": 6885.62, "end": 6887.98, "text": "good research is a friend to everyone." }, { "start": 6889.94, "end": 6891.92, "text": "And like helps all scenarios." }, { "start": 6892.56, "end": 6894.04, "text": "Or like most of them at least." }, { "start": 6894.92, "end": 6897.02, "text": "Puts us in a stronger position." }, { "start": 6898.96, "end": 6899.34, "text": "Yeah." }, { "start": 6900, "end": 6925.92, "text": "there's something to be said of sort of the shared uplift in potential when we all have a more accurate access to nature. Even if it not be true, it is a paradigm closer to what functions in ways that we can predict and wield. And nature to be commanded must be obeyed. And so getting closer to that stuff, maybe we could all move a little bit more to what we think is slightly better if we advance some of that is sort of what you're getting at." }, { "start": 6925.92, "end": 6940.98, "text": "Well, I certainly hope we make progress in those research areas you talked about here. And that's a big part of why I wanted to make sure to get your perspective. I know we went pretty deep into overtime, Mike, but it was worth every minute on my side, brother. I am grateful we got to have you on the show. And thanks so much for being here, man." }, { "start": 6941.66, "end": 6944.2, "text": "A real pleasure, Dan. My pleasure." }, { "start": 6945.04, "end": 6953.46, "text": "So that's all for this episode of The Trajectory. I hope you've enjoyed this little adventure with Mike Johnson. A big thank you to you for listening all the way through to the end of this episode. And thank you to Mike." }, { "start": 6954.1, "end": 6955.9, "text": "Some of the questions in this episode are," }, { "start": 6955.92, "end": 6974.8, "text": "I think, were inspired by a Twitter post I did ahead of the episode. And I'm starting to do more and more of this with the Robin Hanson episode and now with Mike's episode. We had a question from Dirk, from Peter Voss, from Jeffrey Miller, from HDP Billy, and a handful of others that sort of fed into what came up in the episode here with Mike Johnson." }, { "start": 6974.94, "end": 6982.86, "text": "So thanks to everybody who's kind of chipped in a little bit. I'm starting to do this kind of last-minute collection gathering from followers, and I thought it was really fun this time." }, { "start": 6982.98, "end": 6985.82, "text": "I want to give a couple points of reflection on this episode." }, { "start": 6985.92, "end": 6989.08, "text": "I'm going to read a couple of things that sort of stood out to me. I've got some notes here on the screen. I'm just going to read them." }, { "start": 6989.52, "end": 7012.62, "text": "One of the things I really appreciate about Mike's work is his very careful thinking and the fact that he's at least brash enough and confident enough to put forth again where we might put a toe in the water to begin to understand consciousness and to lay out sort of a theory of what it might be, how it might be instantiated, what would be important about it." }, { "start": 7013.66, "end": 7015.9, "text": "That might be threads we could draw." }, { "start": 7015.92, "end": 7025.9, "text": "That might be things we could pull on as science continues to develop and hopefully we'll be able to experiment more in biology and neuroscience and other substrates to sort of crack away at this problem." }, { "start": 7027.12, "end": 7030.26, "text": "He has some very ornate ideas, and he frames it well." }, { "start": 7030.36, "end": 7037.68, "text": "He intends for them to be modular, that is to say they're supposed to kind of click together, the idea of symmetry theory of valence and his vasocomputation idea, etc." }, { "start": 7039.16, "end": 7042.46, "text": "He leaves them on the table as sort of make of them what you will." }, { "start": 7042.58, "end": 7045.9, "text": "But he also intends for them to be able to do something." }, { "start": 7045.92, "end": 7046.28, "text": "He says, well, I'm going to try to make them click together." }, { "start": 7046.84, "end": 7048.28, "text": "That's a really hard thing to do." }, { "start": 7048.4, "end": 7051.2, "text": "I'm interested in which of Michael's ideas clicked for you." }, { "start": 7051.3, "end": 7053.66, "text": "Like, does the symmetry idea seem likely for you?" }, { "start": 7054.32, "end": 7056.26, "text": "What are your thoughts on vasocomputation?" }, { "start": 7056.54, "end": 7062.62, "text": "I just think it's sort of cool that his body of work has a singular and coherent purpose in a multidisciplinary fashion." }, { "start": 7064, "end": 7066.94, "text": "And I like that about the discussion, frankly." }, { "start": 7067.02, "end": 7068.66, "text": "I like that about reading what he puts out." }, { "start": 7069.32, "end": 7075.9, "text": "I'm going to chip in on a couple of things in terms of like what came out throughout the interview from my conception, sort of what my early reflections were." }, { "start": 7075.92, "end": 7078.18, "text": "And then I'm going to try to get into what the other questions are here, just having recorded this episode with Michael." }, { "start": 7079.2, "end": 7088.08, "text": "One of them is, you know, I haven't done the homework on where symmetry shows up in mental states at present." }, { "start": 7089.64, "end": 7103.74, "text": "You know, in the MRI machine, if you put a Labrador retriever or a human being or a flatworm, you know, in an MRI or something like that, you know, if ice cream always has a symmetrical notion to it." }, { "start": 7103.74, "end": 7112.96, "text": "Or if you hit somebody on the foot with a hammer, if that always has a non-symmetrical resonance in the brain in some way, shape, or form." }, { "start": 7116.36, "end": 7118.7, "text": "I think maybe there's more reading to be done here." }, { "start": 7118.78, "end": 7130.96, "text": "But it seems to me likely that in a world with cephalized vertebrates, where sort of, you know, our very development in the embryo is kind of this blooming and this sort of bifurcation." }, { "start": 7132.6, "end": 7133.72, "text": "That symmetry works." }, { "start": 7133.74, "end": 7140.34, "text": "It would be a pretty freaking important part of like the neural and general intelligence structure of the kinds of entities that we are." }, { "start": 7140.46, "end": 7149.18, "text": "As Michael had said, the kinds of entities that carry the ocean with them onto the land, you know, given our lineage here, our supposed lineage." }, { "start": 7151.1, "end": 7153.78, "text": "It seems reasonably plausible that that's the case." }, { "start": 7153.82, "end": 7155.56, "text": "Now, that said, again, I haven't done the homework." }, { "start": 7155.68, "end": 7161, "text": "If you smash somebody's hand with a hammer in an MRI, is it like, do they feel it in different places?" }, { "start": 7161.16, "end": 7163.72, "text": "But then, you know, you show them a picture of, you know, their brain." }, { "start": 7163.74, "end": 7167.1, "text": "And it's, you know, a symmetrical lighting up of brain parts." }, { "start": 7167.18, "end": 7168, "text": "I don't really know." }, { "start": 7168.06, "end": 7168.8, "text": "I haven't seen that stuff." }, { "start": 7168.96, "end": 7174.34, "text": "I can go on Mike's word that sort of like there's enough evidence for that." }, { "start": 7174.46, "end": 7183.12, "text": "I don't know if the totality of net positive quality experience will necessarily manifest that." }, { "start": 7183.24, "end": 7192.42, "text": "You know, I can imagine a way of becoming of a being that would not be sort of cephalized vertebrate bifurcation." }, { "start": 7193.74, "end": 7199.86, "text": "Where maybe it would be more like a fractal set of outgrowths of an entity in terms of like the expansion of its mind and physical body." }, { "start": 7200.02, "end": 7212.86, "text": "some very wildly different substrate and space than human beings occupy, where pleasure and pain aren't really appreciably manifested by any kind of symmetry." }, { "start": 7212.86, "end": 7228.54, "text": "It may be that I'm not understanding Mike's position, but it just, I suspect I don't quite have the confidence that that expands beyond the kind of vertebrates that we can now study in MRI machines." }, { "start": 7228.74, "end": 7240.56, "text": "I don't know if symmetry clicks for me all the way, but I'm interested to see how his ideas develop, and I'm sure his future vasocomputation ideas will sort of overlap more and more with his ideas of symmetry, and I'll sort of get a better conception as we go." }, { "start": 7240.56, "end": 7254.66, "text": "In addition to that, you sort of saw the idea of beauty come about. So Mike had sort of two core ideas. You know, he'd want sort of what life, this process of life continues to bloom into to be strong, that is to say, willing to continue to grow, as he had said." }, { "start": 7254.74, "end": 7264.68, "text": "If it's not growing, it's dying. He doesn't suspect we'll be able to escape that state of nature state. I suspect he is right. So he wants it to be strong. He also wants it to be beautiful." }, { "start": 7265, "end": 7270.54, "text": "I tried to double click on where he meant by beauty, and I'm reticent, I think, on that." }, { "start": 7270.56, "end": 7274.1, "text": "I think he's trying to extend beauty to some kind of highest position." }, { "start": 7274.36, "end": 7277.78, "text": "It's certainly refined. It's certainly sophisticated, right?" }, { "start": 7277.82, "end": 7289.04, "text": "Imagine if he had said something so unsophisticated as, you know, the totality of the good culminates in, I don't know, you know, delicious taste or sexual orgasm or something like that." }, { "start": 7289.04, "end": 7293.6, "text": "That would seem very vulgar, right? It wouldn't seem very poetic, very artistic, very sophisticated." }, { "start": 7294.54, "end": 7296.82, "text": "Beauty is much more of all three of those things." }, { "start": 7298.6, "end": 7300.54, "text": "And surely, I suspect, he's right." }, { "start": 7300.56, "end": 7307.76, "text": "I suspect it could be vastly more complex, potentially, than some of the other more base pleasures, or at least it's associated with being more complex." }, { "start": 7307.86, "end": 7312.56, "text": "Maybe I just want it to be. I don't actually know for sure in its kind of neural correlates." }, { "start": 7314.18, "end": 7326.3, "text": "But I'm not certain that in the total state space of all possible, this feels good, this doesn't feel good, or the total state space of all conceivable experience itself," }, { "start": 7327.88, "end": 7337.9, "text": "that necessarily the nut of that would be beauty, which seems to me a pseudo-arbitrary circuit that has emerged for man." }, { "start": 7338.02, "end": 7339.66, "text": "Now, that could be wrong. It could be wrong." }, { "start": 7339.84, "end": 7342.08, "text": "But my position tends to be the following." }, { "start": 7342.24, "end": 7346.72, "text": "I tend to suspect that we know not what the final value is," }, { "start": 7346.78, "end": 7351.36, "text": "that we know not what nature is in its essence eternally," }, { "start": 7351.38, "end": 7355.46, "text": "and that as hominids, we ought not presume we ever will." }, { "start": 7355.68, "end": 7356.28, "text": "Instead, we know what nature is in its essence eternally." }, { "start": 7356.3, "end": 7360.56, "text": "Instead, I sort of advocate that we expand the total set of potentia, which could then" }, { "start": 7360.56, "end": 7366.36, "text": "get a deeper access to nature, a more thorough sense of experience, a more wide set of powers," }, { "start": 7366.62, "end": 7371.38, "text": "and continue to drill more deeply into what the good maybe would be." }, { "start": 7371.48, "end": 7377.88, "text": "I would presume we would need higher entities to be in contact with higher ranges and types" }, { "start": 7377.88, "end": 7380.98, "text": "of good to start to hypothesize about any final good." }, { "start": 7380.98, "end": 7387.04, "text": "I have no confidence that sexual orgasm, the taste of ice cream, or beauty be the eternal." }, { "start": 7387.6, "end": 7389.44, "text": "That said, I may be wrong." }, { "start": 7389.72, "end": 7393.64, "text": "It might be a bit of the mystic spirit in Mike to be able to sort of make that bet." }, { "start": 7393.78, "end": 7397.08, "text": "And on some level, his project is different than mine." }, { "start": 7398.84, "end": 7404.2, "text": "My project is sort of a questioning and opening up of ideas as kind of like my main modus operandi," }, { "start": 7404.34, "end": 7410.1, "text": "and his is to be bold enough to make claims about what might be and sort of what he wants" }, { "start": 7410.1, "end": 7410.8, "text": "to test." }, { "start": 7411.98, "end": 7412.12, "text": "And I think that's the way that I see the world." }, { "start": 7412.12, "end": 7416.42, "text": "And it's certainly more concrete and granular, and I have to respect that, because it's actually" }, { "start": 7417.7, "end": 7420.62, "text": "harder to put forth ideas that could be wrong in some sense." }, { "start": 7420.96, "end": 7425.6, "text": "And at least it makes me contest with my own definition of beauty, which I think I've at" }, { "start": 7425.6, "end": 7427.86, "text": "least been able to jostle around in my interview with Mike." }, { "start": 7428.18, "end": 7429.82, "text": "But those are some of my immediate reflections." }, { "start": 7430.3, "end": 7432.1, "text": "Interested in your thoughts, throw them down in the comments." }, { "start": 7432.22, "end": 7438.08, "text": "Moving forward, I'm going to be putting out more tweets ahead of the interview to just" }, { "start": 7438.08, "end": 7439.3, "text": "sort of ask for last minute questions." }, { "start": 7439.38, "end": 7441.72, "text": "I mean, some of them might be non sequiturs." }, { "start": 7441.76, "end": 7441.96, "text": "They're my favorite." }, { "start": 7441.98, "end": 7444.22, "text": "Some of them might not quite fit with whatever the theme of the interview is." }, { "start": 7444.48, "end": 7448.36, "text": "But if they are, I'll be sure to include them, and then I'll also be sure to give a little" }, { "start": 7448.36, "end": 7451.12, "text": "shout out in the outro to people that have helped me run better interviews." }, { "start": 7451.22, "end": 7456.46, "text": "I'm hoping to get better at this over time, and grateful to be able to have an audience" }, { "start": 7456.46, "end": 7457, "text": "to share it with." }, { "start": 7457.12, "end": 7459.24, "text": "So with that said, we're going to wrap up on this episode." }, { "start": 7459.42, "end": 7460.88, "text": "Thanks for joining us here on The Trajectory." }, { "start": 7460.9, "end": 7461.66, "text": "I'll catch you next time." } ], "canonicalUrl": "https://opentheory.net/transcripts/symmetry-beauty-shape-consciousness/" }