back to indexLiv Boeree: Poker, Game Theory, AI, Simulation, Aliens & Existential Risk | Lex Fridman Podcast #314
link |
Evolutionarily, if we see a lion running at us,
link |
we didn't have time to sort of calculate
link |
the lion's kinetic energy and is it optimal
link |
to go this way or that way, you just react it.
link |
And physically our bodies are well attuned
link |
to actually make right decisions.
link |
But when you're playing a game like poker,
link |
this is not something that you ever evolved to do.
link |
And yet you're in that same flight or fight response.
link |
And so that's a really important skill
link |
to be able to develop to basically learn
link |
how to like meditate in the moment and calm yourself
link |
so that you can think clearly.
link |
The following is a conversation with Liv Burry,
link |
formerly one of the best poker players in the world,
link |
trained as an astrophysicist and is now a philanthropist
link |
and an educator on topics of game theory,
link |
physics, complexity, and life.
link |
This is the Lex Friedman podcast.
link |
To support it, please check out our sponsors
link |
in the description.
link |
And now, dear friends, here's Liv Burry.
link |
What role do you think luck plays in poker and in life?
link |
You can pick whichever one you want,
link |
poker or life and or life.
link |
The longer you play, the less influence luck has.
link |
Like with all things, the bigger your sample size,
link |
the more the quality of your decisions
link |
or your strategies matter.
link |
So to answer that question, yeah, in poker,
link |
it really depends.
link |
If you and I sat and played 10 hands right now,
link |
I might only win 52% of the time, 53% maybe.
link |
But if we played 10,000 hands,
link |
then I'll probably win like over 98, 99% of the time.
link |
So it's a question of sample sizes.
link |
And what are you figuring out over time?
link |
The betting strategy that this individual does
link |
or literally it doesn't matter
link |
against any individual over time?
link |
Against any individual over time, the better player
link |
because they're making better decisions.
link |
So what does that mean to make a better decision?
link |
Well, to get into the realness of Gritty already,
link |
basically poker is a game of math.
link |
There are these strategies familiar
link |
with like Nash Equilibria, right?
link |
So there are these game theory optimal strategies
link |
that you can adopt.
link |
And the closer you play to them,
link |
the less exploitable you are.
link |
So because I've studied the game a bunch,
link |
although admittedly not for a few years,
link |
but back when I was playing all the time,
link |
I would study these game theory optimal solutions
link |
and try and then adopt those strategies
link |
when I go and play.
link |
So I'd play against you and I would do that.
link |
And because the objective,
link |
when you're playing game theory optimal,
link |
it's actually, it's a loss minimization thing
link |
that you're trying to do.
link |
Your best bet is to try and play a sort of similar style.
link |
You also need to try and adopt this loss minimization.
link |
But because I've been playing much longer than you,
link |
I'll be better at that.
link |
So first of all, you're not taking advantage
link |
But then on top of that,
link |
I'll be better at recognizing
link |
when you are playing suboptimally
link |
and then deviating from this game theory optimal strategy
link |
to exploit your bad plays.
link |
Can you define game theory and Nash equilibria?
link |
Can we try to sneak up to it in a bunch of ways?
link |
Like what's a game theory framework of analyzing poker,
link |
analyzing any kind of situation?
link |
So game theory is just basically the study of decisions
link |
within a competitive situation.
link |
I mean, it's technically a branch of economics,
link |
but it also applies to like wider decision theory.
link |
And usually when you see it,
link |
it's these like little payoff matrices and so on.
link |
That's how it's depicted.
link |
But it's essentially just like study of strategies
link |
under different competitive situations.
link |
And as it happens, certain games,
link |
in fact, many, many games have these things
link |
called Nash equilibria.
link |
And what that means is when you're in a Nash equilibrium,
link |
basically it is not,
link |
there is no strategy that you can take
link |
that would be more beneficial
link |
than the one you're currently taking,
link |
assuming your opponent is also doing the same thing.
link |
So it'd be a bad idea,
link |
if we're both playing in a game theory optimal strategy,
link |
if either of us deviate from that,
link |
now we're putting ourselves at a disadvantage.
link |
Rock, paper, scissors
link |
is actually a really great example of this.
link |
Like if we were to start playing rock, paper, scissors,
link |
you know, you know nothing about me
link |
and we're gonna play for all our money,
link |
let's play 10 rounds of it.
link |
What would your sort of optimal strategy be?
link |
Do you think, what would you do?
link |
I would probably try to be as random as possible.
link |
You wanna, because you don't know anything about me,
link |
you don't want to give anything away about yourself.
link |
So ideally you'd have like a little dice
link |
or somewhat, you know, perfect randomizer
link |
that makes you randomize 33% of the time
link |
each of the three different things.
link |
And in response to that,
link |
well, actually I can kind of do anything,
link |
but I would probably just randomize back too,
link |
but actually it wouldn't matter
link |
because I know that you're playing randomly.
link |
So that would be us in a Nash equilibrium
link |
where we're both playing this like unexploitable strategy.
link |
However, if after a while you then notice
link |
that I'm playing rock a little bit more often than I should.
link |
Yeah, you're the kind of person that would do that,
link |
I'm more of a scissors girl, but anyway.
link |
No, I'm a, as I said, randomizer.
link |
So you notice I'm throwing rock too much
link |
or something like that.
link |
Now you'd be making a mistake
link |
by continuing playing this game theory optimal strategy,
link |
well, the previous one, because you are now,
link |
I'm making a mistake and you're not deviating
link |
and exploiting my mistake.
link |
So you'd want to start throwing paper a bit more often
link |
in whatever you figure is the right sort of percentage
link |
of the time that I'm throwing rock too often.
link |
So that's basically an example of where,
link |
what game theory optimal strategy is
link |
in terms of loss minimization,
link |
but it's not always the maximally profitable thing
link |
if your opponent is doing stupid stuff,
link |
which in that example.
link |
So that's kind of then how it works in poker,
link |
but it's a lot more complex.
link |
And the way poker players typically,
link |
nowadays they study, the games change so much.
link |
And I think we should talk about how it sort of evolved,
link |
but nowadays like the top pros
link |
basically spend all their time in between sessions
link |
running these simulators using like software
link |
where they do basically Monte Carlo simulations,
link |
sort of doing billions of fictitious self play hands.
link |
You input a fictitious hand scenario,
link |
like, oh, what do I do with Jack nine suited
link |
on a King 10 four to two spades board
link |
and against this bet size.
link |
So you'd input that press play,
link |
it'll run its billions of fake hands
link |
and then it will converge upon
link |
what the game theory optimal strategies are.
link |
And then you wanna try and memorize what these are.
link |
Basically they're like ratios of how often,
link |
what types of hands you want to bluff
link |
and what percentage of the time.
link |
So then there's this additional layer
link |
of inbuilt randomization built in.
link |
Yeah, those kinds of simulations incorporate
link |
all the betting strategies and everything else like that.
link |
So as opposed to some kind of very crude mathematical model
link |
of what's the probability you win
link |
just based on the quality of the card,
link |
it's including everything else too.
link |
The game theory of it.
link |
Yes, yeah, essentially.
link |
And what's interesting is that nowadays,
link |
if you want to be a top pro and you go and play
link |
in these really like the super high stakes tournaments
link |
or tough cash games, if you don't know this stuff,
link |
you're gonna get eaten alive in the long run.
link |
But of course you could get lucky over the short run
link |
and that's where this like luck factor comes in
link |
because luck is both a blessing and a curse.
link |
If luck didn't, if there wasn't this random element
link |
and there wasn't the ability for worse players
link |
to win sometimes, then poker would fall apart.
link |
You know, the same reason people don't play chess
link |
professionally for money against,
link |
you don't see people going and hustling chess
link |
like not knowing, trying to make a living from it
link |
because you know there's very little luck in chess,
link |
but there's quite a lot of luck in poker.
link |
Have you seen Beautiful Mind, that movie?
link |
Well, what do you think about the game theoretic formulation
link |
of what is it, the hot blonde at the bar?
link |
What they illustrated is they're trying to pick up a girl
link |
at a bar and there's multiple girls.
link |
They're like friend, it's like a friend group
link |
and you're trying to approach,
link |
I don't remember the details, but I remember.
link |
Don't you like then speak to her friends first
link |
or something like that, feign disinterest.
link |
I mean, it's classic pickup artist stuff, right?
link |
And they were trying to correlate that somehow,
link |
that being an optimal strategy game theoretically.
link |
What, what, like, I don't think, I remember.
link |
I can't imagine that there is,
link |
I mean, there's probably an optimal strategy.
link |
Is it, does that mean that there's an actual Nash equilibrium
link |
of like picking up girls?
link |
Do you know the marriage problem?
link |
It's optimal stopping.
link |
So where it's an optimal dating strategy
link |
where you, do you remember what it is?
link |
Yeah, I think it's like something like,
link |
you know you've got like a set of a hundred people
link |
you're gonna look through and after,
link |
how many do you, now after that,
link |
after going on this many dates out of a hundred,
link |
at what point do you then go, okay, the next best person I see,
link |
is that the right one?
link |
And I think it's like something like 37%.
link |
Uh, it's one over E, whatever that is.
link |
Right, which I think is 37%.
link |
We're gonna fact check that.
link |
So, but it's funny under those strict constraints,
link |
then yes, after that many people,
link |
as long as you have a fixed size pool,
link |
then you just pick the next person
link |
that is better than anyone you've seen before.
link |
Anyone else you've seen, yeah.
link |
Have you tried this?
link |
Have you incorporated it?
link |
I'm not one of those people.
link |
And we're gonna discuss this.
link |
I, and, what do you mean, those people?
link |
I try not to optimize stuff.
link |
I try to listen to the heart.
link |
I don't think, I like,
link |
my mind immediately is attracted to optimizing everything.
link |
Optimizing everything.
link |
And I think that if you really give in
link |
to that kind of addiction,
link |
that you lose the joy of the small things,
link |
the minutiae of life, I think.
link |
I'm concerned about the addictive nature
link |
of my personality in that regard.
link |
while I think the, on average,
link |
people under try and quantify things,
link |
or try, under optimize.
link |
There are some people who, you know,
link |
with all these things, it's a balancing act.
link |
I've been on dating apps, but I've never used them.
link |
I'm sure they have data on this,
link |
because they probably have
link |
the optimal stopping control problem.
link |
Because there aren't a lot of people that use social,
link |
like dating apps, are on there for a long time.
link |
So the interesting aspect is like, all right,
link |
how long before you stop looking
link |
before it actually starts affecting your mind negatively,
link |
such that you see dating as a kind of,
link |
A kind of game versus an actual process
link |
of finding somebody that's going to make you happy
link |
for the rest of your life.
link |
That's really interesting.
link |
They have the data.
link |
I wish they would be able to release that data.
link |
And I do want to hop to it.
link |
It's OkCupid, right?
link |
I think they ran a huge, huge study on all of that.
link |
Yeah, they're more data driven, I think, OkCupid folks are.
link |
I think there's a lot of opportunity for dating apps,
link |
in general, even bigger than dating apps,
link |
people connecting on the internet.
link |
I just hope they're more data driven.
link |
And it doesn't seem that way.
link |
I think like, I've always thought that
link |
Goodreads should be a dating app.
link |
I've never used it.
link |
Goodreads is just lists like books that you've read.
link |
And allows you to comment on the books you read
link |
and what books you're currently reading.
link |
But it's a giant social networks of people reading books.
link |
And that seems to be a much better database
link |
of like interests.
link |
Of course it constrains you to the books you're reading,
link |
but like that really reveals so much more about the person.
link |
Allows you to discover shared interests
link |
because books are a kind of window
link |
into the way you see the world.
link |
Also like the kind of places,
link |
people you're curious about,
link |
the kind of ideas you're curious about.
link |
Are you a romantic or are you cold calculating rationalist?
link |
Are you into Ayn Rand or are you into Bernie Sanders?
link |
Are you into whatever?
link |
And I feel like that reveals so much more
link |
than like a person trying to look hot
link |
from a certain angle in a Tinder profile.
link |
Well, and it'd also be a really great filter
link |
in the first place for people.
link |
It's less people who read books
link |
and are willing to go and rate them
link |
and give feedback on them and so on.
link |
So that's already a really strong filter.
link |
Probably the type of people you'd be looking for.
link |
Well, at least be able to fake reading books.
link |
I mean, the thing about books,
link |
you don't really need to read it.
link |
You can just look at the click counts.
link |
Yeah, game the dating app by feigning intellectualism.
link |
Can I admit something very horrible about myself?
link |
The things that, you know,
link |
I don't have many things in my closet,
link |
but this is one of them.
link |
I've never actually read Shakespeare.
link |
I've only read Cliff Notes
link |
and I got a five in the AP English exam.
link |
The which books have I read?
link |
Oh yeah, which was the exam on which book?
link |
Oh no, they include a lot of them.
link |
But Hamlet, I don't even know
link |
if you read Romeo and Juliet, Macbeth.
link |
I don't remember, but I don't understand it.
link |
It's like really cryptic.
link |
It's really, I don't, and it's not that pleasant to read.
link |
It's like ancient speak.
link |
I don't understand it.
link |
Anyway, maybe I was too dumb.
link |
I'm still too dumb, but I did get...
link |
You got a five, which is...
link |
I don't know how the US grading system...
link |
Oh no, so AP English is a,
link |
there's kind of this advanced versions of courses
link |
in high school, and you take a test
link |
that is like a broad test for that subject
link |
and includes a lot.
link |
It wasn't obviously just Shakespeare.
link |
I think a lot of it was also writing, written.
link |
You have like AP Physics, AP Computer Science,
link |
AP Biology, AP Chemistry, and then AP English
link |
or AP Literature, I forget what it was.
link |
But I think Shakespeare was a part of that.
link |
And the point is you gamified it?
link |
Well, in entirety, I was into getting As.
link |
I saw it as a game.
link |
I don't think any...
link |
I don't think all of the learning I've done
link |
has been outside of school.
link |
The deepest learning I've done has been outside of school
link |
with a few exceptions, especially in grad school,
link |
like deep computer science courses.
link |
But that was still outside of school
link |
because it was outside of getting...
link |
It was outside of getting the A for the course.
link |
The best stuff I've ever done is when you read the chapter
link |
and you do many of the problems at the end of the chapter,
link |
which is usually not what's required for the course,
link |
like the hardest stuff.
link |
In fact, textbooks are freaking incredible.
link |
If you go back now and you look at like biology textbook
link |
or any of the computer science textbooks
link |
on algorithms and data structures,
link |
those things are incredibly...
link |
They have the best summary of a subject,
link |
plus they have practice problems of increasing difficulty
link |
that allows you to truly master the basic,
link |
like the fundamental ideas behind that.
link |
I got through my entire physics degree with one textbook
link |
that was just this really comprehensive one
link |
that they told us at the beginning of the first year,
link |
buy this, but you're gonna have to buy 15 other books
link |
for all your supplementary courses.
link |
And I was like, every time I was just checked
link |
to see whether this book covered it and it did.
link |
And I think I only bought like two or three extra
link |
and thank God, cause they're super expensive textbooks.
link |
It's a whole racket they've got going on.
link |
They could just...
link |
You get the right one, it's just like a manual for...
link |
But what's interesting though,
link |
is this is the tyranny of having exams and metrics.
link |
The tyranny of exams and metrics, yes.
link |
I loved them because I'm very competitive
link |
and I liked finding ways to gamify things
link |
and then like sort of dust off my shoulders afterwards
link |
when I get a good grade
link |
or be annoyed at myself when I didn't.
link |
But yeah, you're absolutely right.
link |
And that the actual...
link |
How much of that physics knowledge I've retained,
link |
like I've learned how to cram and study
link |
and please an examiner,
link |
but did that give me the deep lasting knowledge
link |
I mean, yes and no,
link |
but really like nothing makes you learn a topic better
link |
than when you actually then have to teach it yourself.
link |
Like I'm trying to wrap my teeth
link |
around this like game theory Moloch stuff right now.
link |
And there's no exam at the end of it that I can gamify.
link |
There's no way to gamify
link |
and sort of like shortcut my way through it.
link |
I have to understand it so deeply
link |
from like deep foundational levels
link |
to then to build upon it
link |
and then try and explain it to other people.
link |
And like, you're about to go and do some lectures, right?
link |
You can't sort of just like,
link |
you presumably can't rely on the knowledge
link |
that you got through when you were studying for an exam
link |
Yeah, and especially high level lectures,
link |
especially the kind of stuff you do on YouTube,
link |
you're not just regurgitating material.
link |
You have to think through what is the core idea here.
link |
And when you do the lectures live especially,
link |
you have to, there's no second takes.
link |
That is the luxury you get
link |
if you're recording a video for YouTube
link |
or something like that.
link |
But it definitely is a luxury you shouldn't lean on.
link |
I've gotten to interact with a few YouTubers
link |
that lean on that too much.
link |
And you realize, oh, you've gamified this system
link |
because you're not really thinking deeply about stuff.
link |
You're through the edit,
link |
both written and spoken,
link |
you're crafting an amazing video,
link |
but you yourself as a human being
link |
have not really deeply understood it.
link |
So live teaching or at least recording video
link |
with very few takes is a different beast.
link |
And I think it's the most honest way of doing it,
link |
like as few takes as possible.
link |
That's why I'm nervous about this.
link |
Don't go back and be like, ah, let's do that.
link |
Don't fuck this up, Liv.
link |
The tyranny of exams.
link |
I do think people talk about high school and college
link |
as a time to do drugs and drink and have fun
link |
and all this kind of stuff.
link |
But looking back, of course I did a lot of those things.
link |
Yes, no, yes, but it's also a time
link |
when you get to read textbooks or read books
link |
or learn with all the time in the world.
link |
You don't have these responsibilities of laundry
link |
and having to sort of pay for mortgage,
link |
all that kind of stuff, pay taxes, all this kind of stuff.
link |
In most cases, there's just so much time in the day
link |
for learning and you don't realize it at the time
link |
because at the time it seems like a chore,
link |
like why the hell does there's so much homework?
link |
But you never get a chance to do this kind of learning,
link |
this kind of homework ever again in life,
link |
unless later in life you really make a big effort out of it.
link |
Like basically your knowledge gets solidified.
link |
You don't get to have fun and learn.
link |
Learning is really fulfilling and really fun
link |
if you're that kind of person.
link |
Like some people like, you know,
link |
like knowledge is not something that they think is fun.
link |
But if that's the kind of thing that you think is fun,
link |
that's the time to have fun and do the drugs and drink
link |
and all that kind of stuff.
link |
But the learning, just going back to those textbooks,
link |
the hours spent with the textbooks
link |
is really, really rewarding.
link |
Do people even use textbooks anymore?
link |
Yeah. Do you think?
link |
Kids these days with their TikTok and their...
link |
Well, not even that, but it's just like so much information,
link |
really high quality information,
link |
you know, it's now in digital format online.
link |
Yeah, but they're not, they are using that,
link |
but you know, college is still very, there's a curriculum.
link |
I mean, so much of school is about rigorous study
link |
of a subject and still on YouTube, that's not there.
link |
Right. YouTube has,
link |
YouTube has, Grant Sanderson talks about this.
link |
Yeah, 3Blue1Brown.
link |
He says like, I'm not a math teacher.
link |
I just take really cool concepts and I inspire people.
link |
But if you wanna really learn calculus,
link |
if you wanna really learn linear algebra,
link |
you should do the textbook.
link |
You should do that, you know.
link |
And there's still the textbook industrial complex
link |
that like charges like $200 for textbook and somehow,
link |
I don't know, it's ridiculous.
link |
Well, they're like, oh, sorry, new edition, edition 14.6.
link |
Sorry, you can't use 14.5 anymore.
link |
It's like, what's different?
link |
We've got one paragraph different.
link |
So we mentioned offline, Daniel Negrano.
link |
I'm gonna get a chance to talk to him on this podcast.
link |
And he's somebody that I found fascinating
link |
in terms of the way he thinks about poker,
link |
verbalizes the way he thinks about poker,
link |
the way he plays poker.
link |
So, and he's still pretty damn good.
link |
He's been good for a long time.
link |
So you mentioned that people are running
link |
these kinds of simulations and the game of poker has changed.
link |
Do you think he's adapting in this way?
link |
Like the top pros, do they have to adopt this way?
link |
Or is there still like over the years,
link |
you basically develop this gut feeling about,
link |
like you get to be like good the way,
link |
like alpha zero is good.
link |
You look at the board and somehow from the fog
link |
comes out the right answer.
link |
Like this is likely what they have.
link |
This is likely the best way to move.
link |
And you don't really, you can't really put a finger
link |
on exactly why, but it just comes from your gut feeling.
link |
So gut feelings are definitely very important.
link |
You know, that we've got our two,
link |
you can distill it down to two modes
link |
of decision making, right?
link |
You've got your sort of logical linear voice in your head,
link |
system two, as it's often called,
link |
and your system one, your gut intuition.
link |
And historically in poker,
link |
the very best players were playing
link |
almost entirely by their gut.
link |
You know, often they do some kind of inspired play
link |
and you'd ask them why they do it
link |
and they wouldn't really be able to explain it.
link |
And that's not so much because their process
link |
was unintelligible, but it was more just because
link |
no one had the language with which to describe
link |
what optimal strategies were
link |
because no one really understood how poker worked.
link |
This was before, you know, we had analysis software.
link |
You know, no one was writing,
link |
I guess some people would write down their hands
link |
in a little notebook,
link |
but there was no way to assimilate all this data
link |
But then, you know, when computers became cheaper
link |
and software started emerging,
link |
and then obviously online poker,
link |
where it would like automatically save your hand histories.
link |
Now, all of a sudden you kind of had this body of data
link |
that you could run analysis on.
link |
And so that's when people started to see, you know,
link |
these mathematical solutions.
link |
And so what that meant is the role of intuition
link |
essentially became smaller.
link |
And it went more into, as we talked before about,
link |
you know, this game theory optimal style.
link |
But also, as I said, like game theory optimal
link |
is about loss minimization and being unexploitable.
link |
But if you're playing against people who aren't,
link |
because no person, no human being can play perfectly
link |
game theory optimal in poker, not even the best AIs.
link |
They're still like, you know,
link |
they're 99.99% of the way there or whatever,
link |
but it's kind of like the speed of light.
link |
You can't reach it perfectly.
link |
So there's still a role for intuition?
link |
Yes, so when, yeah,
link |
when you're playing this unexploitable style,
link |
but when your opponents start doing something,
link |
you know, suboptimal that you want to exploit,
link |
well, now that's where not only your like logical brain
link |
will need to be thinking, well, okay,
link |
I know I have this, I'm in the sort of top end
link |
of my range here with this hand.
link |
So that means I need to be calling X percent of the time
link |
and I put them on this range, et cetera.
link |
But then sometimes you'll have this gut feeling
link |
that will tell you, you know what, this time,
link |
I know mathematically I'm meant to call now.
link |
You know, I'm in the sort of top end of my range
link |
and this is the odds I'm getting.
link |
So the math says I should call,
link |
but there's something in your gut saying,
link |
they've got it this time, they've got it.
link |
Like they're beating you, your hand is worse.
link |
So then the real art,
link |
this is where the last remaining art in poker,
link |
the fuzziness is like, do you listen to your gut?
link |
How do you quantify the strength of it?
link |
Or can you even quantify the strength of it?
link |
And I think that's what Daniel has.
link |
I mean, I can't speak for how much he's studying
link |
with the simulators and that kind of thing.
link |
I think he has, like he must be to still be keeping up.
link |
But he has an incredible intuition for just,
link |
he's seen so many hands of poker in the flesh.
link |
He's seen so many people, the way they behave
link |
when the chips are, you know, when the money's on the line
link |
and he've got him staring you down in the eye.
link |
You know, he's intimidating.
link |
He's got this like kind of X factor vibe
link |
that he, you know, gives out.
link |
And he talks a lot, which is an interactive element,
link |
which is he's getting stuff from other people.
link |
And just like the subtlety.
link |
So he's like, he's probing constantly.
link |
Yeah, he's probing and he's getting this extra layer
link |
of information that others can't.
link |
Now that said though, he's good online as well.
link |
You know, I don't know how, again,
link |
would he be beating the top cash game players online?
link |
But when he's in person and he's got that additional
link |
layer of information, he can not only extract it,
link |
but he knows what to do with it still so well.
link |
There's one player who I would say is the exception
link |
And he's one of my favorite people to talk about
link |
in terms of, I think he might have cracked the simulation.
link |
It's Phil Helmuth.
link |
In more ways than one, he's cracked the simulation,
link |
Yeah, he somehow to this day is still
link |
and I love you Phil, I'm not in any way knocking you.
link |
He is still winning so much at the World Series
link |
of Poker specifically.
link |
He's now won 16 bracelets.
link |
The next nearest person I think has won 10.
link |
And he is consistently year in, year out going deep
link |
or winning these huge field tournaments,
link |
you know, with like 2000 people,
link |
which statistically he should not be doing.
link |
And yet you watch some of the plays he makes
link |
and they make no sense, like mathematically,
link |
they are so far from game theory optimal.
link |
And the thing is, if you went and stuck him
link |
in one of these high stakes cash games
link |
with a bunch of like GTO people,
link |
he's gonna get ripped apart.
link |
But there's something that he has that when he's
link |
in the halls of the World Series of Poker specifically,
link |
amongst sort of amateurish players,
link |
he gets them to do crazy shit like that.
link |
And, but my little pet theory is that also,
link |
he just, the card, he's like a wizard
link |
and he gets the cards to do what he needs them to.
link |
Because he just expects to win and he expects to receive,
link |
you know, to get flopper set with a frequency far beyond
link |
what the real percentages are.
link |
And I don't even know if he knows what the real percentages
link |
are, he doesn't need to, because he gets there.
link |
I think he has found the Chico,
link |
because when I've seen him play,
link |
he seems to be like annoyed that the long shot thing
link |
He's like annoyed and it's almost like everybody else
link |
is stupid because he was obviously going to win
link |
If that silly thing hadn't happened.
link |
And it's like, you don't understand,
link |
the silly thing happens 99% of the time.
link |
And it's a 1%, not the other way around,
link |
but genuinely for his lived experience at the World Series,
link |
only at the World Series of Poker, it is like that.
link |
So I don't blame him for feeling that way.
link |
But he does, he has this X factor
link |
and the poker community has tried for years
link |
to rip him down saying like, he's no good,
link |
but he's clearly good because he's still winning
link |
or there's something going on.
link |
Whether that's he's figured out how to mess
link |
with the fabric of reality and how cards,
link |
a randomly shuffled deck of cards come out.
link |
I don't know what it is, but he's doing it right still.
link |
Who do you think is the greatest of all time?
link |
Would you put Hellmuth?
link |
Not Hellmuth definitely, he seems like the kind of person
link |
when mentioned he would actually watch this.
link |
So you might wanna be careful.
link |
Well, as I said, I love Phil and I have,
link |
I would say this to his face, I'm not saying anything.
link |
I don't, he's got, he truly, I mean,
link |
he is one of the greatest.
link |
I don't know if he's the greatest,
link |
he's certainly the greatest at the World Series of Poker.
link |
And he is the greatest at, despite the game switching
link |
into a pure game, almost an entire game of math,
link |
he has managed to keep the magic alive.
link |
And this like, just through sheer force of will,
link |
making the game work for him.
link |
And that is incredible.
link |
And I think it's something that should be studied
link |
because it's an example.
link |
Yeah, there might be some actual game theoretic wisdom.
link |
There might be something to be said about optimality
link |
from studying him.
link |
What do you mean by optimality?
link |
Meaning, or rather game design, perhaps.
link |
Meaning if what he's doing is working,
link |
maybe poker is more complicated
link |
than the one we're currently modeling it as.
link |
So like his, yeah.
link |
Or there's an extra layer,
link |
and I don't mean to get too weird and wooey,
link |
but, or there's an extra layer of ability
link |
to manipulate the things the way you want them to go
link |
that we don't understand yet.
link |
Do you think Phil Hellmuth understands them?
link |
Is he just generally?
link |
Hashtag positivity.
link |
Well, he wrote a book on positivity and he's.
link |
He has, he did, not like a trolling book.
link |
He's just straight up, yeah.
link |
Phil Hellmuth wrote a book about positivity.
link |
And I think it's about sort of manifesting what you want
link |
and getting the outcomes that you want
link |
by believing so much in yourself
link |
and in your ability to win,
link |
like eyes on the prize.
link |
And I mean, it's working.
link |
The man's delivered.
link |
But where do you put like Phil Ivey
link |
and all those kinds of people?
link |
I mean, I'm too, I've been,
link |
to be honest too much out of the scene
link |
for the last few years to really,
link |
I mean, Phil Ivey's clearly got,
link |
again, he's got that X factor.
link |
He's so incredibly intimidating to play against.
link |
I've only played against him a couple of times,
link |
but when he like looks you in the eye
link |
and you're trying to run a bluff on him,
link |
oof, no one's made me sweat harder than Phil Ivey,
link |
just my bluff got through actually.
link |
That was actually one of the most thrilling moments
link |
I've ever had in poker was,
link |
it was in a Monte Carlo in a high roller.
link |
I can't remember exactly what the hand was,
link |
but I, you know, a three bit
link |
and then like just barreled all the way through.
link |
And he just like put his laser eyes into me.
link |
And I felt like he was just scouring my soul.
link |
And I was just like, hold it together, Liv,
link |
And he was like, folded.
link |
And you knew your hand was weaker.
link |
Yeah, I mean, I was bluffing.
link |
I presume, which, you know,
link |
there's a chance I was bluffing with the best hand,
link |
but I'm pretty sure my hand was worse.
link |
I was truly one of the deep highlights of my career.
link |
Did you show the cards or did you fold?
link |
You should never show in game.
link |
Like, because especially as I felt like
link |
I was one of the worst players at the table
link |
in that tournament.
link |
So giving that information,
link |
unless I had a really solid plan
link |
that I was now like advertising,
link |
oh, look, I'm capable of bluffing Phil Ivey.
link |
It's much more valuable to take advantage
link |
of the impression that they have of me,
link |
which is like, I'm a scared girl
link |
playing a high roller for the first time.
link |
Keep that going, you know.
link |
But isn't there layers to this?
link |
Like psychological warfare
link |
that the scared girl might be way smart
link |
and then like just to flip the tables?
link |
Do you think about that kind of stuff?
link |
Or is it better not to reveal information?
link |
I mean, generally speaking,
link |
you want to not reveal information.
link |
You know, the goal of poker is to be
link |
as deceptive as possible about your own strategies
link |
while elucidating as much out of your opponent
link |
So giving them free information,
link |
particularly if they're people
link |
who you consider very good players,
link |
any information I give them is going into
link |
their little database and being,
link |
I assume it's going to be calculated and used well.
link |
So I have to be really confident
link |
that my like meta gaming that I'm going to then do,
link |
oh, they've seen this, so therefore that.
link |
I'm going to be on the right level.
link |
So it's better just to keep that little secret
link |
to myself in the moment.
link |
So how much is bluffing part of the game?
link |
So yeah, I mean, maybe actually let me ask,
link |
like, what did it feel like with Phil Ivey
link |
or anyone else when it's a high stake,
link |
when it's a big, it's a big bluff?
link |
So a lot of money on the table and maybe,
link |
I mean, what defines a big bluff?
link |
Maybe a lot of money on the table,
link |
but also some uncertainty in your mind and heart
link |
about like self doubt.
link |
Well, maybe I miscalculated what's going on here,
link |
what the bet said, all that kind of stuff.
link |
Like, what does that feel like?
link |
I mean, it's, I imagine comparable to,
link |
you know, running a, I mean, any kind of big bluff
link |
where you have a lot of something
link |
that you care about on the line.
link |
You know, so if you're bluffing in a courtroom,
link |
not that anyone should ever do that,
link |
or, you know, something equatable to that.
link |
It's, you know, in that scenario, you know,
link |
I think it was the first time I'd ever played a 20,
link |
I'd won my way into this 25K tournament.
link |
So that was the buy in 25,000 euros.
link |
And I had satelliteed my way in
link |
because it was much bigger
link |
than I would ever normally play.
link |
And, you know, I hadn't, I wasn't that experienced
link |
at the time, and now I was sitting there
link |
against all the big boys, you know,
link |
the Negronus, the Phil Ivey's and so on.
link |
And then to like, you know,
link |
each time you put the bets out, you know,
link |
you put another bet out, your card.
link |
Yeah, I was on what's called a semi bluff.
link |
So there were some cards that could come
link |
that would make my hand very, very strong
link |
and therefore win.
link |
But most of the time, those cards don't come.
link |
So that is a semi bluff because you're representing,
link |
are you representing that you already have something?
link |
So I think in this scenario, I had a flush draw.
link |
So I had two clubs, two clubs came out on the flop.
link |
And then I'm hoping that on the turn
link |
and the river, one will come.
link |
So I have some future equity.
link |
I could hit a club and then I'll have the best hand
link |
in which case, great.
link |
And so I can keep betting and I'll want them to call,
link |
but I'm also got the other way of winning the hand
link |
where if my card doesn't come,
link |
I can keep betting and get them to fold their hand.
link |
And I'm pretty sure that's what the scenario was.
link |
So I had some future equity, but it's still, you know,
link |
most of the time I don't hit that club.
link |
And so I would rather him just fold because I'm, you know,
link |
the pot is now getting bigger and bigger.
link |
And in the end, like I've jam all in on the river.
link |
That's my entire tournament on the line.
link |
As far as I'm aware, this might be the one time
link |
I ever get to play a big 25K.
link |
You know, this was the first time I played one.
link |
So it was, it felt like the most momentous thing.
link |
And this was also when I was trying to build myself up at,
link |
you know, build my name, a name for myself in poker.
link |
I wanted to get respect.
link |
Destroy everything for you.
link |
It felt like it in the moment.
link |
Like, I mean, it literally does feel
link |
like a form of life and death.
link |
Like your body physiologically
link |
is having that flight or fight response.
link |
What are you doing with your body?
link |
What are you doing with your face?
link |
Are you just like, what are you thinking about?
link |
More of a mixture of like, okay, what are the cards?
link |
So in theory, I'm thinking about like, okay,
link |
what are cards that make my hand look stronger?
link |
Which cards hit my perceived range from his perspective?
link |
Which cards don't?
link |
What's the right amount of bet size
link |
to maximize my fold equity in this situation?
link |
You know, that's the logical stuff
link |
that I should be thinking about.
link |
But I think in reality, because I was so scared,
link |
because there's this, at least for me,
link |
there's a certain threshold of like nervousness or stress
link |
beyond which the logical brain shuts off.
link |
And now it just gets into this like,
link |
just like, it feels like a game of wits, basically.
link |
It's like of nerve.
link |
Can you hold your resolve?
link |
And it certainly got by that, like by the river.
link |
I think by that point, I was like,
link |
I don't even know if this is a good bluff anymore,
link |
but fuck it, let's do it.
link |
Your mind is almost numb from the intensity of that feeling.
link |
I call it the white noise.
link |
And it happens in all kinds of decision making.
link |
I think anything that's really, really stressful.
link |
I can imagine someone in like an important job interview,
link |
if it's like a job they've always wanted,
link |
and they're getting grilled, you know,
link |
like Bridgewater style, where they ask these really hard,
link |
like mathematical questions.
link |
You know, it's a really learned skill
link |
to be able to like subdue your flight or fight response.
link |
You know, I think get from the sympathetic
link |
into the parasympathetic.
link |
So you can actually, you know, engage that voice
link |
in your head and do those slow logical calculations.
link |
Because evolutionarily, you know, if we see a lion
link |
running at us, we didn't have time to sort of calculate
link |
the lion's kinetic energy and, you know,
link |
is it optimal to go this way or that way?
link |
You just react it.
link |
And physically, our bodies are well attuned
link |
to actually make right decisions.
link |
But when you're playing a game like poker,
link |
this is not something that you ever, you know,
link |
And yet you're in that same flight or fight response.
link |
And so that's a really important skill to be able to develop
link |
to basically learn how to like meditate in the moment
link |
and calm yourself so that you can think clearly.
link |
But as you were searching for a comparable thing,
link |
it's interesting because you just made me realize
link |
that bluffing is like an incredibly high stakes
link |
And I don't think you can.
link |
No, no, it's straight up lying.
link |
In the context of game, it's not a negative kind of lying.
link |
But it is, yeah, exactly.
link |
You're representing something that you don't have.
link |
And I was thinking like how often in life
link |
do we have such high stakes of lying?
link |
Because I was thinking certainly
link |
in high level military strategy,
link |
I was thinking when Hitler was lying to Stalin
link |
about his plans to invade the Soviet Union.
link |
And so you're talking to a person like your friends
link |
and you're fighting against the enemy,
link |
whatever the formulation of the enemy is.
link |
But meanwhile, whole time you're building up troops
link |
Wait, wait, so Hitler and Stalin were like
link |
pretending to be friends?
link |
Well, my history knowledge is terrible.
link |
Yeah, that they were, oh man.
link |
And it worked because Stalin,
link |
until the troops crossed the border
link |
and invaded in Operation Barbarossa
link |
where this storm of Nazi troops
link |
invaded large parts of the Soviet Union.
link |
And hence, one of the biggest wars in human history began.
link |
Stalin for sure thought that this was never going to be,
link |
that Hitler is not crazy enough to invade the Soviet Union.
link |
And it makes, geopolitically makes total sense
link |
to be collaborators.
link |
And ideologically, even though there's a tension
link |
between communism and fascism or national socialism,
link |
however you formulate it,
link |
it still feels like this is the right way
link |
to battle the West.
link |
They were more ideologically aligned.
link |
They in theory had a common enemy, which is the West.
link |
So it made total sense.
link |
And in terms of negotiations
link |
and the way things were communicated,
link |
it seemed to Stalin that for sure,
link |
that they would remain, at least for a while,
link |
peaceful collaborators.
link |
And that, and everybody, because of that,
link |
in the Soviet Union believed that it was a huge shock
link |
when Kiev was invaded.
link |
And you hear echoes of that when I travel to Ukraine,
link |
sort of the shock of the invasion.
link |
It's not just the invasion on one particular border,
link |
but the invasion of the capital city.
link |
And just like, holy shit, especially at that time,
link |
when you thought World War I,
link |
you realized that that was the war to end all wars.
link |
You would never have this kind of war.
link |
And holy shit, this person is mad enough
link |
to try to take on this monster in the Soviet Union.
link |
So it's no longer going to be a war
link |
of hundreds of thousands dead.
link |
It'll be a war of tens of millions dead.
link |
And yeah, but that, that's a very large scale kind of lie,
link |
but I'm sure there's in politics and geopolitics,
link |
that kind of lying happening all the time.
link |
And a lot of people pay financially
link |
and with their lives for that kind of lying.
link |
But in our personal lives, I don't know how often we,
link |
I think people do.
link |
I mean, like think of spouses
link |
cheating on their partners, right?
link |
And then like having to lie,
link |
like where were you last night?
link |
Stuff like that. Oh shit, that's tough.
link |
Yeah, that's true.
link |
Like that's, I think, you know, I mean,
link |
unfortunately that stuff happens all the time, right?
link |
Or having like multiple families, that one is great.
link |
When each family doesn't know about the other one
link |
and like maintaining that life.
link |
There's probably a sense of excitement about that too.
link |
Or. It seems unnecessary, yeah.
link |
Like, you know, the truth finds a way of coming out.
link |
But hence that's the thrill.
link |
I mean, you know, that's why I think actually like poker.
link |
What's so interesting about poker
link |
is most of the best players I know,
link |
they're always exceptions, you know?
link |
They're always bad eggs.
link |
But actually poker players are very honest people.
link |
I would say they are more honest than the average,
link |
you know, if you just took random population sample.
link |
Because A, you know, I think, you know,
link |
humans like to have that.
link |
Most people like to have some kind of, you know,
link |
mysterious, you know, an opportunity to do something
link |
like a little edgy.
link |
So we get to sort of scratch that itch
link |
of being edgy at the poker table,
link |
where it's like, it's part of the game.
link |
Everyone knows what they're in for, and that's allowed.
link |
And you get to like really get that out of your system.
link |
And then also like poker players learned that, you know,
link |
I would play in a huge game against some of my friends,
link |
even my partner, Igor, where we will be, you know,
link |
absolutely going at each other's throats,
link |
trying to draw blood in terms of winning each money
link |
off each other and like getting under each other's skin,
link |
winding each other up, doing the craftiest moves we can.
link |
But then once the game's done, you know,
link |
the winners and the losers will go off
link |
and get a drink together and have a fun time
link |
and like talk about it in this like weird academic way
link |
afterwards, because, and that's why games are so great.
link |
Cause you get to like live out like this competitive urge
link |
that, you know, most people have.
link |
What's it feel like to lose?
link |
Like we talked about bluffing when it worked out.
link |
What about when you, when you go broke?
link |
So like in a game, I'm, fortunately I've never gone broke.
link |
You mean like full life?
link |
I know plenty of people who have.
link |
And I don't think Igor would mind me saying he went,
link |
you know, he went broke once in poker bowl, you know,
link |
early on when we were together.
link |
I feel like you haven't lived unless you've gone broke.
link |
Some fundamental sense.
link |
I mean, I'm happy, I've sort of lived through it,
link |
vicariously through him when he did it at the time.
link |
But yeah, what's it like to lose?
link |
So it depends on the amount.
link |
It depends what percentage of your net worth
link |
It depends on your brain chemistry.
link |
It really, you know, varies from person to person.
link |
You have a very cold calculating way of thinking about this.
link |
So it depends what percentage.
link |
Well, it did, it really does, right?
link |
Yeah, it's true, it's true.
link |
I mean, that's another thing poker trains you to do.
link |
You see, you see everything in percentages
link |
or you see everything in like ROI or expected hourlies
link |
or cost benefit, et cetera.
link |
You know, so that's, one of the things I've tried to do
link |
is calibrate the strength of my emotional response
link |
to the win or loss that I've received.
link |
Because it's no good if you like, you know,
link |
you have a huge emotional dramatic response to a tiny loss
link |
or on the flip side, you have a huge win
link |
and you're sort of so dead inside
link |
that you don't even feel it.
link |
Well, that's, you know, that's a shame.
link |
I want my emotions to calibrate with reality
link |
as much as possible.
link |
So yeah, what's it like to lose?
link |
I mean, I've had times where I've lost, you know,
link |
busted out of a tournament that I thought I was gonna win in
link |
especially if I got really unlucky or I make a dumb play
link |
where I've gone away and like, you know, kicked the wall,
link |
punched a wall, I like nearly broke my hand one time.
link |
Like I'm a lot less competitive than I used to be.
link |
Like I was like pathologically competitive in my like
link |
late teens, early twenties, I just had to win at everything.
link |
And I think that sort of slowly waned as I've gotten older.
link |
According to you, yeah.
link |
I don't know if others would say the same, right?
link |
I feel like ultra competitive people,
link |
like I've heard Joe Rogan say this to me.
link |
It's like that he's a lot less competitive
link |
than he used to be.
link |
I don't know about that.
link |
No, I totally believe it.
link |
Like, because as you get, you can still be,
link |
like I care about winning.
link |
Like when, you know, I play a game with my buddies online
link |
or, you know, whatever it is,
link |
polytopia is my current obsession.
link |
Thank you for passing on your obsession to me.
link |
Are you playing now?
link |
Yeah, I'm playing now.
link |
We gotta have a game.
link |
But I'm terrible and I enjoy playing terribly.
link |
I don't wanna have a game because that's gonna pull me
link |
into your monster of like a competitive play.
link |
It's important, it's an important skill.
link |
I'm enjoying playing on the, I can't.
link |
You just do the points thing, you know, against the bots.
link |
Yeah, against the bots.
link |
And I can't even do the, there's like a hard one
link |
and there's a very hard one.
link |
And then it's crazy, yeah.
link |
I can't, I don't even enjoy the hard one.
link |
The crazy, I really don't enjoy.
link |
Cause it's intense.
link |
You have to constantly try to win
link |
as opposed to enjoy building a little world and.
link |
There's no time for exploration in polytopia.
link |
Well, when, once you graduate from the crazies,
link |
then you can come play the.
link |
Graduate from the crazies.
link |
Yeah, so in order to be able to play a decent game
link |
against like, you know, our group,
link |
you'll need to be, you'll need to be consistently winning
link |
like 90% of games against 15 crazy bots.
link |
And you'll be able to, like there'll be,
link |
I could teach you it within a day, honestly.
link |
How to beat the crazies?
link |
How to beat the crazies.
link |
And then, and then you'll be ready for the big leagues.
link |
Generalizes to more than just polytopia.
link |
But okay, why were we talking about polytopia?
link |
Losing hurts, oh yeah.
link |
Yes, competitiveness over time.
link |
I think it's more that, at least for me,
link |
I still care about playing,
link |
about winning when I choose to play something.
link |
It's just that I don't see the world
link |
as zero sum as I used to be, you know?
link |
I think as one gets older and wiser,
link |
you start to see the world more as a positive something.
link |
Or at least you're more aware of externalities,
link |
of scenarios, of competitive interactions.
link |
And so, yeah, I just like, I'm more,
link |
and I'm more aware of my own, you know, like,
link |
if I have a really strong emotional response to losing,
link |
and that makes me then feel shitty for the rest of the day,
link |
and then I beat myself up mentally for it.
link |
Like, I'm now more aware
link |
that that's unnecessary negative externality.
link |
So I'm like, okay, I need to find a way to turn this down,
link |
you know, dial this down a bit.
link |
Was poker the thing that has,
link |
if you think back at your life,
link |
and think about some of the lower points of your life,
link |
like the darker places you've got in your mind,
link |
did it have to do something with poker?
link |
Like, did losing spark the descent into darkness,
link |
or was it something else?
link |
I think my darkest points in poker
link |
were when I was wanting to quit and move on to other things,
link |
but I felt like I hadn't ticked all the boxes
link |
Like, I wanted to be the most winningest female player,
link |
which is by itself a bad goal.
link |
You know, that was one of my initial goals,
link |
and I was like, well, I haven't, you know,
link |
and I wanted to win a WPT event.
link |
I've won one of these, I've won one of these,
link |
but I want one of those as well.
link |
And that sort of, again, like,
link |
it's a drive of like overoptimization to random metrics
link |
that I decided were important
link |
without much wisdom at the time, but then like carried on.
link |
That made me continue chasing it longer
link |
than I still actually had the passion to chase it for.
link |
And I don't have any regrets that, you know,
link |
I played for as long as I did, because who knows,
link |
you know, I wouldn't be sitting here,
link |
I wouldn't be living this incredible life
link |
that I'm living now.
link |
This is the height of your life right now.
link |
This is it, peak experience, absolute pinnacle
link |
here in your robot land with your creepy light.
link |
No, it is, I mean, I wouldn't change a thing
link |
about my life right now, and I feel very blessed to say that.
link |
So, but the dark times were in the sort of like 2016 to 18,
link |
even sooner really, where I was like,
link |
I had stopped loving the game,
link |
and I was going through the motions,
link |
and I would, and then I was like, you know,
link |
I would take the losses harder than I needed to,
link |
because I'm like, ah, it's another one.
link |
And it was, I was aware that like,
link |
I felt like my life was ticking away,
link |
and I was like, is this gonna be what's on my tombstone?
link |
Oh yeah, she played the game of, you know,
link |
this zero sum game of poker,
link |
slightly more optimally than her next opponent.
link |
Like, cool, great, legacy, you know?
link |
So, I just wanted, you know, there was something in me
link |
that knew I needed to be doing something
link |
more directly impactful and just meaningful.
link |
It was just like your search for meaning,
link |
and I think it's a thing a lot of poker players,
link |
even a lot of, I imagine any games players
link |
who sort of love intellectual pursuits,
link |
you know, I think you should ask Magnus Carlsen
link |
this question, I don't know what he's on.
link |
He's walking away from chess, right?
link |
Yeah, like, it must be so hard for him.
link |
You know, he's been on the top for so long,
link |
and it's like, well, now what?
link |
He's got this incredible brain, like, what to put it to?
link |
It's this weird moment where I've just spoken with people
link |
that won multiple gold medals at the Olympics,
link |
and the depression hits hard after you win.
link |
Because it's a kind of a goodbye,
link |
saying goodbye to that person,
link |
to all the dreams you had that thought,
link |
you thought would give meaning to your life,
link |
but in fact, life is full of constant pursuits of meaning.
link |
It doesn't, you don't like arrive and figure it all out,
link |
and there's endless bliss,
link |
and it continues going on and on.
link |
You constantly have to figure out to rediscover yourself.
link |
And so for you, like that struggle to say goodbye to poker,
link |
you have to like find the next.
link |
There's always a bigger game.
link |
That's my motto is like, what's the next game?
link |
And more importantly,
link |
because obviously game usually implies zero sum,
link |
like what's a game which is like Omni win?
link |
Like what? Omni win.
link |
Why is Omni win so important?
link |
Because if everyone plays zero sum games,
link |
that's a fast track to either completely stagnate
link |
as a civilization, but more actually,
link |
far more likely to extinct ourselves.
link |
You know, like the playing field is finite.
link |
You know, nuclear powers are playing,
link |
you know, a game of poker with, you know,
link |
but their chips are nuclear weapons, right?
link |
And the stakes have gotten so large
link |
that if anyone makes a single bet, you know,
link |
fires some weapons, the playing field breaks.
link |
I made a video on this.
link |
Like, you know, the playing field is finite.
link |
And if we keep playing these adversarial zero sum games,
link |
thinking that we, you know,
link |
in order for us to win, someone else has to lose,
link |
or if we lose that, you know, someone else wins,
link |
that will extinct us.
link |
It's just a matter of when.
link |
What do you think about that mutually assured destruction,
link |
almost to the point of caricaturing game theory idea
link |
that does seem to be at the core
link |
of why we haven't blown each other up yet
link |
with nuclear weapons.
link |
Do you think there's some truth to that,
link |
this kind of stabilizing force
link |
of mutually assured destruction?
link |
And do you think that's gonna hold up
link |
through the 21st century?
link |
I mean, it has held.
link |
Yes, there's definitely truth to it,
link |
that it was a, you know, it's a Nash equilibrium.
link |
Yeah, are you surprised it held this long?
link |
It is crazy when you factor in all the like
link |
near miss accidental firings.
link |
Yes, that's makes me wonder like, you know,
link |
are you familiar with the like quantum suicide
link |
thought experiment, where it's basically like,
link |
you have a, you know, like a Russian roulette
link |
type scenario hooked up to some kind of quantum event,
link |
you know, particle splitting or pair of particles splitting.
link |
And if it, you know, if it goes A,
link |
then the gun doesn't go off and it goes B,
link |
then it does go off and it kills you.
link |
Because you can only ever be in the universe,
link |
you know, assuming like the Everett branch,
link |
you know, multiverse theory,
link |
you'll always only end up in the branch
link |
where you continually make, you know, option A comes in,
link |
but you run that experiment enough times,
link |
it starts getting pretty damn, you know,
link |
out of the tree gets huge,
link |
there's a million different scenarios,
link |
but you'll always find yourself in this,
link |
in the one where it didn't go off.
link |
And so from that perspective, you are essentially immortal
link |
because someone, and you will only find yourself
link |
in the set of observers that make it down that path.
link |
So it's kind of a...
link |
That doesn't mean, that doesn't mean
link |
you're still not gonna be fucked at some point in your life.
link |
No, of course not, no, I'm not advocating
link |
like that we're all immortal because of this.
link |
It's just like a fun thought experiment.
link |
And the point is it like raises this thing
link |
of like these things called observer selection effects,
link |
which Bostrom, Nick Bostrom talks about a lot,
link |
and I think people should go read.
link |
It's really powerful,
link |
but I think it could be overextended, that logic.
link |
I'm not sure exactly how it can be.
link |
I just feel like you can get, you can overgeneralize
link |
that logic somehow.
link |
Well, no, I mean, it leaves you into like solipsism,
link |
which is a very dangerous mindset.
link |
Again, if everyone like falls into solipsism of like,
link |
well, I'll be fine.
link |
That's a great way of creating a very,
link |
self terminating environment.
link |
But my point is, is that with the nuclear weapons thing,
link |
there have been at least, I think it's 12 or 11 near misses
link |
of like just stupid things, like there was moonrise
link |
over Norway, and it made weird reflections
link |
of some glaciers in the mountains, which set off,
link |
I think the alarms of NORAD radar,
link |
and that put them on high alert, nearly ready to shoot.
link |
And it was only because the head of Russian military
link |
happened to be at the UN in New York at the time
link |
that they go like, well, wait a second,
link |
why would they fire now when their guy is there?
link |
And it was only that lucky happenstance,
link |
which doesn't happen very often where they didn't then
link |
escalate it into firing.
link |
And there's a bunch of these different ones.
link |
Stanislav Petrov, like saved the person
link |
who should be the most famous person on earth,
link |
cause he's probably on expectation,
link |
saved the most human lives of anyone,
link |
like billions of people by ignoring Russian orders to fire
link |
because he felt in his gut that actually
link |
this was a false alarm.
link |
And it turned out to be, you know, very hard thing to do.
link |
And there's so many of those scenarios that I can't help
link |
but wonder at this point that we aren't having this kind
link |
of like selection effect thing going on.
link |
Cause you look back and you're like, geez,
link |
that's a lot of near misses.
link |
But of course we don't know the actual probabilities
link |
that they would have lent each one would have ended up
link |
Maybe they were not that likely, but still the point is,
link |
it's a very dark, stupid game that we're playing.
link |
And it is an absolute moral imperative if you ask me
link |
to get as many people thinking about ways
link |
to make this like very precarious.
link |
Cause we're in a Nash equilibrium,
link |
but it's not like we're in the bottom of a pit.
link |
You know, if you would like map it topographically,
link |
it's not like a stable ball at the bottom of a thing.
link |
We're not in equilibrium because of that.
link |
We're on the top of a hill with a ball balanced on top.
link |
And just at any little nudge could send it flying down
link |
and you know, nuclear war pops off
link |
and hellfire and bad times.
link |
On the positive side,
link |
life on earth will probably still continue.
link |
And another intelligent civilization might still pop up.
link |
Several millennia after.
link |
Pick your X risk, depends on the X risk.
link |
Nuclear war, sure.
link |
That's one of the perhaps less bad ones.
link |
Green goo through synthetic biology, very bad.
link |
Will turn, you know, destroy all, you know,
link |
organic matter through, you know,
link |
it's basically like a biological paperclip maximizer.
link |
Or AI type, you know, mass extinction thing as well
link |
would also be bad.
link |
Shh, they're listening.
link |
There's a robot right behind you.
link |
So let me ask you about this from a game theory perspective.
link |
Do you think we're living in a simulation?
link |
Do you think we're living inside a video game
link |
created by somebody else?
link |
Well, so what was the second part of the question?
link |
Do I think we're living in a simulation and?
link |
A simulation that is observed by somebody
link |
for purpose of entertainment.
link |
So like a video game.
link |
Are we, because there's a,
link |
it's like Phil Hellmuth type of situation, right?
link |
Like there's a creepy level of like,
link |
this is kind of fun and interesting.
link |
Like there's a lot of interesting stuff going on.
link |
Maybe that could be somehow integrated
link |
into the evolutionary process where the way we perceive
link |
Are you asking me if I believe in God?
link |
Kind of, but God seems to be not optimizing
link |
in the different formulations of God that we conceive of.
link |
He doesn't seem to be, or she, optimizing
link |
for like personal entertainment.
link |
Maybe the older gods did.
link |
But the, you know, just like, basically like a teenager
link |
in their mom's basement watching, create a fun universe
link |
to observe what kind of crazy shit might happen.
link |
Okay, so to try and answer this.
link |
Do I think there is some kind of extraneous intelligence
link |
to like our, you know, classic measurable universe
link |
that we, you know, can measure with, you know,
link |
through our current physics and instruments?
link |
Partly because I've had just small little bits of evidence
link |
in my own life, which have made me question.
link |
Like, so I was a diehard atheist, even five years ago.
link |
You know, I got into like the rationality community,
link |
big fan of less wrong, continue to be an incredible resource.
link |
But I've just started to have too many little snippets
link |
of experience, which don't make sense with the current sort
link |
of purely materialistic explanation of how reality works.
link |
Isn't that just like a humbling, practical realization
link |
that we don't know how reality works?
link |
Isn't that just a reminder to yourself that you're
link |
like, I don't know how reality works, isn't that just
link |
a reminder to yourself?
link |
Yeah, no, it's a reminder of epistemic humility
link |
because I fell too hard, you know, same as people,
link |
like I think, you know, many people who are just like,
link |
my religion is the way, this is the correct way,
link |
this is the work, this is the law, you are immoral
link |
if you don't follow this, blah, blah, blah.
link |
I think they are lacking epistemic humility.
link |
They're a little too much hubris there.
link |
But similarly, I think that sort of the Richard Dawkins
link |
realism is too rigid as well and doesn't, you know,
link |
there's a way to try and navigate these questions
link |
which still honors the scientific method,
link |
which I still think is our best sort of realm
link |
of like reasonable inquiry, you know, a method of inquiry.
link |
So an example, two kind of notable examples
link |
that like really rattled my cage.
link |
The first one was actually in 2010 early on
link |
in quite early on in my poker career.
link |
And I, remember the Icelandic volcano that erupted
link |
that like shut down kind of all Atlantic airspace.
link |
And it meant I got stuck down in the South of France.
link |
I was there for something else.
link |
And I couldn't get home and someone said,
link |
well, there's a big poker tournament happening in Italy.
link |
Maybe, do you wanna go?
link |
I was like, all right, sure.
link |
Like, let's, you know, got a train across,
link |
found a way to get there.
link |
And the buy in was 5,000 euros,
link |
which was much bigger than my bankroll would normally allow.
link |
And so I played a feeder tournament, won my way in
link |
kind of like I did with the Monte Carlo big one.
link |
So then I won my way, you know,
link |
from 500 euros into 5,000 euros to play this thing.
link |
And on day one of then the big tournament,
link |
which turned out to have,
link |
it was the biggest tournament ever held in Europe
link |
It got over like 1,200 people, absolutely huge.
link |
And I remember they dimmed the lights for before, you know,
link |
the normal shuffle up and deal
link |
to tell everyone to start playing.
link |
And they played Chemical Brothers, Hey Boy, Hey Girl,
link |
which I don't know why it's notable,
link |
but it was just like a really,
link |
it was a song I always liked.
link |
It was like one of these like pump me up songs.
link |
And I was sitting there thinking, oh yeah, it's exciting.
link |
I'm playing this really big tournament.
link |
And out of nowhere, just suddenly this voice in my head,
link |
just, and it sounded like my own sort of, you know,
link |
when you think in your mind, you hear a voice kind of, right?
link |
And so it sounded like my own voice and it said,
link |
you are going to win this tournament.
link |
And it was so powerful that I got this like wave of like,
link |
you know, sort of goosebumps down my body.
link |
And that I even, I remember looking around being like,
link |
did anyone else hear that?
link |
And obviously people are in their phones,
link |
like no one else heard it.
link |
And I was like, okay, six days later,
link |
I win the fucking tournament out of 1,200 people.
link |
And I don't know how to explain it.
link |
Okay, yes, maybe I have that feeling
link |
before every time I play.
link |
And it's just that I happened to, you know,
link |
because I won the tournament, I retroactively remembered it.
link |
Or the feeling gave you a kind of,
link |
now from the film, Helmutian.
link |
Like it gave you a confident, a deep confidence.
link |
It definitely did.
link |
Like, I remember then feeling this like sort of,
link |
well, although I remember then on day one,
link |
I then went and lost half my stack quite early on.
link |
And I remember thinking like, oh, well, that was bullshit.
link |
You know, what kind of premonition is this?
link |
Thinking, oh, I'm out.
link |
But you know, I managed to like keep it together
link |
and recover and then just went like pretty perfectly
link |
And either way, it definitely instilled me
link |
with this confidence.
link |
And I don't want to put, I can't put an explanation.
link |
Like, you know, was it some, you know, huge extra to extra,
link |
you know, supernatural thing driving me?
link |
Or was it just my own self confidence in someone
link |
that just made me make the right decisions?
link |
And I don't, I'm not going to put a frame on it.
link |
I think I know a good explanation.
link |
So we're a bunch of NPCs living in this world
link |
created by, in the simulation.
link |
And then people, not people, creatures from outside
link |
of the simulation sort of can tune in
link |
and play your character.
link |
And that feeling you got is somebody just like,
link |
they got to play a poker tournament through you.
link |
Honestly, it felt like that.
link |
It did actually feel a little bit like that.
link |
But it's been 12 years now.
link |
I've retold the story many times.
link |
Like, I don't even know how much I can trust my memory.
link |
You're just an NPC retelling the same story.
link |
Because they just played the tournament and left.
link |
Yeah, they're like, oh, that was fun.
link |
And now you're for the rest of your life left
link |
as a boring NPC retelling this story of greatness.
link |
But it was, and what was interesting was that after that,
link |
then I didn't obviously win a major tournament
link |
for quite a long time.
link |
And it left, that was actually another sort of dark period
link |
because I had this incredible,
link |
like the highs of winning that,
link |
just on a like material level were insane,
link |
winning the money.
link |
I was on the front page of newspapers
link |
because there was like this girl that came out of nowhere
link |
and won this big thing.
link |
And so again, like sort of chasing that feeling
link |
But then on top of that, there was this feeling
link |
of like almost being touched by something bigger
link |
that was like, ah.
link |
So maybe, did you have a sense
link |
that I might be somebody special?
link |
Like this kind of,
link |
I think that's the confidence thing
link |
that maybe you could do something special in this world
link |
after all kind of feeling.
link |
I definitely, I mean, this is the thing
link |
I think everybody wrestles with to an extent, right?
link |
We are truly the protagonists in our own lives.
link |
And so it's a natural bias, human bias
link |
And I think, and in some ways we are special.
link |
Every single person is special
link |
because you are that, the universe does,
link |
the world literally does revolve around you.
link |
That's the thing in some respect.
link |
But of course, if you then zoom out
link |
and take the amalgam of everyone's experiences,
link |
then no, it doesn't.
link |
So there is this shared sort of objective reality,
link |
but sorry, there's objective reality that is shared,
link |
but then there's also this subjective reality
link |
which is truly unique to you.
link |
And I think both of those things coexist.
link |
And it's not like one is correct and one isn't.
link |
And again, anyone who's like,
link |
oh no, your lived experience is everything
link |
versus your lived experience is nothing.
link |
No, it's a blend between these two things.
link |
They can exist concurrently.
link |
But there's a certain kind of sense
link |
that at least I've had my whole life.
link |
And I think a lot of people have this as like,
link |
well, I'm just like this little person.
link |
Surely I can't be one of those people
link |
that do the big thing, right?
link |
There's all these big people doing big things.
link |
There's big actors and actresses, big musicians.
link |
There's big business owners and all that kind of stuff,
link |
scientists and so on.
link |
I have my own subject experience that I enjoy and so on,
link |
but there's like a different layer.
link |
Like surely I can't do those great things.
link |
I mean, one of the things just having interacted
link |
with a lot of great people, I realized,
link |
no, they're like just the same humans as me.
link |
And that realization I think is really empowering.
link |
And to remind yourself.
link |
Well, in terms of.
link |
Depends on some, yeah.
link |
They're like a bag of insecurities and.
link |
Peculiar sort of, like their own little weirdnesses
link |
and so on, I should say also not.
link |
They have the capacity for brilliance,
link |
but they're not generically brilliant.
link |
Like, you know, we tend to say this person
link |
or that person is brilliant, but really no,
link |
they're just like sitting there and thinking through stuff
link |
just like the rest of us.
link |
I think they're in the habit of thinking through stuff
link |
seriously and they've built up a habit of not allowing them,
link |
their mind to get trapped in a bunch of bullshit
link |
and minutia of day to day life.
link |
They really think big ideas, but those big ideas,
link |
it's like allowing yourself the freedom to think big,
link |
to realize that you can be one that actually solved
link |
this particular big problem.
link |
First identify a big problem that you care about,
link |
then like, I can actually be the one
link |
that solves this problem.
link |
And like allowing yourself to believe that.
link |
And I think sometimes you do need to have like
link |
that shock go through your body and a voice tells you,
link |
you're gonna win this tournament.
link |
And whether it was, it's this idea of useful fictions.
link |
So again, like going through all like
link |
the classic rationalist training of Les Wrong
link |
where it's like, you want your map,
link |
you know, the image you have of the world in your head
link |
to as accurately match up with how the world actually is.
link |
You want the map and the territory to perfectly align
link |
as, you know, you want it to be
link |
as an accurate representation as possible.
link |
I don't know if I fully subscribed to that anymore,
link |
having now had these moments of like feeling of something
link |
either bigger or just actually just being overconfident.
link |
Like there is value in overconfidence sometimes.
link |
If you, you know, take, you know,
link |
take Magnus Carlsen, right?
link |
If he, I'm sure from a young age,
link |
he knew he was very talented,
link |
but I wouldn't be surprised if he was also had something
link |
in him to, well, actually maybe he's a bad example
link |
because he truly is the world's greatest,
link |
but someone who it was unclear
link |
whether they were gonna be the world's greatest,
link |
but ended up doing extremely well
link |
because they had this innate, deep self confidence,
link |
this like even overblown idea
link |
of how good their relative skill level is.
link |
That gave them the confidence to then pursue this thing
link |
and they're like with the kind of focus and dedication
link |
that it requires to excel in whatever it is
link |
you're trying to do, you know?
link |
And so there are these useful fictions
link |
and that's where I think I diverge slightly
link |
with the classic sort of rationalist community
link |
because that's a field that is worth studying
link |
of like how the stories we tell,
link |
what the stories we tell to ourselves,
link |
even if they are actually false,
link |
and even if we suspect they might be false,
link |
how it's better to sort of have that like little bit
link |
of faith, like value in faith, I think actually.
link |
And that's partly another thing
link |
that's now led me to explore the concept of God,
link |
whether you wanna call it a simulator,
link |
the classic theological thing.
link |
I think we're all like elucidating to the same thing.
link |
Now, I don't know, I'm not saying,
link |
because obviously the Christian God
link |
is like all benevolent, endless love.
link |
The simulation, at least one of the simulation hypothesis
link |
is like, as you said, like a teenager in his bedroom
link |
who doesn't really care, doesn't give a shit
link |
about the individuals within there.
link |
It just like wants to see how the thing plays out
link |
because it's curious and it could turn it off like that.
link |
Where on the sort of psychopathy
link |
to benevolent spectrum God is, I don't know.
link |
But just having a little bit of faith
link |
that there is something else out there
link |
that might be interested in our outcome
link |
is I think an essential thing actually for people to find.
link |
A, because it creates commonality between,
link |
it's something we can all share.
link |
And it is uniquely humbling of all of us to an extent.
link |
It's like a common objective.
link |
But B, it gives people that little bit of like reserve
link |
when things get really dark.
link |
And I do think things are gonna get pretty dark
link |
over the next few years.
link |
But it gives that like,
link |
to think that there's something out there
link |
that actually wants our game to keep going.
link |
I keep calling it the game.
link |
It's a thing C and I, we call it the game.
link |
You and C is a.k.a. Grimes, we call what the game?
link |
Everything, the whole thing?
link |
Yeah, we joke about like.
link |
So everything is a game.
link |
Well, the universe, like what if it's a game
link |
and the goal of the game is to figure out like,
link |
well, either how to beat it, how to get out of it.
link |
Maybe this universe is an escape room,
link |
like a giant escape room.
link |
And the goal is to figure out,
link |
put all the pieces to puzzle, figure out how it works
link |
in order to like unlock this like hyperdimensional key
link |
and get out beyond what it is.
link |
No, but then, so you're saying it's like different levels
link |
and it's like a cage within a cage within a cage
link |
and never like one cage at a time,
link |
you figure out how to escape that.
link |
Like a new level up, you know,
link |
like us becoming multi planetary would be a level up
link |
or us, you know, figuring out how to upload
link |
our consciousnesses to the thing.
link |
That would probably be a leveling up or spiritually,
link |
you know, humanity becoming more combined
link |
and less adversarial and bloodthirsty
link |
and us becoming a little bit more enlightened.
link |
That would be a leveling up.
link |
You know, there's many different frames to it,
link |
whether it's physical, you know, digital
link |
or like metaphysical.
link |
I wonder what the levels, I think,
link |
I think level one for earth is probably
link |
the biological evolutionary process.
link |
So going from single cell organisms to early humans.
link |
Then maybe level two is whatever's happening inside our minds
link |
and creating ideas and creating technologies.
link |
That's like evolutionary process of ideas.
link |
And then multi planetary is interesting.
link |
Is that fundamentally different
link |
from what we're doing here on earth?
link |
Probably, because it allows us to like exponentially scale.
link |
It delays the Malthusian trap, right?
link |
It's a way to keep the playing field,
link |
to make the playing field get larger
link |
so that it can accommodate more of our stuff, more of us.
link |
And that's a good thing,
link |
but I don't know if it like fully solves this issue of,
link |
well, this thing called Moloch,
link |
which we haven't talked about yet,
link |
but which is basically,
link |
I call it the God of unhealthy competition.
link |
Yeah, let's go to Moloch.
link |
You did a great video on Moloch and one aspect of it,
link |
the application of it to one aspect.
link |
Instagram beauty filters.
link |
Very niche, but I wanted to start off small.
link |
So Moloch was originally coined as,
link |
well, so apparently back in the like Canaanite times,
link |
it was to say ancient Carthaginian,
link |
I can never say it Carthaginian,
link |
somewhere around like 300 BC or 280, I don't know.
link |
There was supposedly this death cult
link |
who would sacrifice their children
link |
to this awful demon God thing they called Moloch
link |
in order to get power to win wars.
link |
So really dark, horrible things.
link |
And it was literally like about child sacrifice,
link |
whether they actually existed or not, we don't know,
link |
but in mythology they did.
link |
And this God that they worshiped
link |
was this thing called Moloch.
link |
And then I don't know,
link |
it seemed like it was kind of quiet throughout history
link |
in terms of mythology beyond that,
link |
until this movie Metropolis in 1927 talked about this,
link |
you see that there was this incredible futuristic city
link |
that everyone was living great in,
link |
but then the protagonist goes underground into the sewers
link |
and sees that the city is run by this machine.
link |
And this machine basically would just like kill the workers
link |
all the time because it was just so hard to keep it running.
link |
They were always dying.
link |
So there was all this suffering that was required
link |
in order to keep the city going.
link |
And then the protagonist has this vision
link |
that this machine is actually this demon Moloch.
link |
So again, it's like this sort of like mechanistic consumption
link |
of humans in order to get more power.
link |
And then Allen Ginsberg wrote a poem in the 60s,
link |
which incredible poem called Howl about this thing Moloch.
link |
And a lot of people sort of quite understandably
link |
take the interpretation of that,
link |
that he's talking about capitalism.
link |
But then the sort of piece to resistance
link |
that's moved Moloch into this idea of game theory
link |
was Scott Alexander of Slate Style Codex
link |
wrote this incredible,
link |
well, literally I think it might be my favorite piece
link |
of writing of all time.
link |
It's called Meditations on Moloch.
link |
Everyone must go read it.
link |
I say Codex is a blog.
link |
We can link to it in the show notes or something, right?
link |
But I like how you assume
link |
I have a professional operation going on here.
link |
I shall try to remember to...
link |
You were gonna assume.
link |
What are you, what do you want?
link |
You're giving the impression of it.
link |
Yeah, I'll look, please.
link |
If I don't, please somebody in the comments remind me.
link |
If you don't know this blog,
link |
it's one of the best blogs ever probably.
link |
You should probably be following it.
link |
Are blogs still a thing?
link |
I think they are still a thing, yeah.
link |
Yeah, he's migrated onto Substack,
link |
but yeah, it's still a blog.
link |
Substack better not fuck things up, but...
link |
I hope they don't, I hope they don't turn Molochy,
link |
which will mean something to people when we continue.
link |
When I stop interrupting for once.
link |
No, no, it's good.
link |
So anyway, so he writes,
link |
he writes this piece, Meditations on Moloch,
link |
and basically he analyzes the poem and he's like,
link |
okay, so it seems to be something relating
link |
to where competition goes wrong.
link |
And, you know, Moloch was historically this thing
link |
of like where people would sacrifice a thing
link |
that they care about, in this case, children,
link |
their own children, in order to gain power,
link |
a competitive advantage.
link |
And if you look at almost everything that sort of goes wrong
link |
in our society, it's that same process.
link |
So with the Instagram beauty filters thing,
link |
you know, if you're trying to become
link |
a famous Instagram model,
link |
you are incentivized to post the hottest pictures
link |
of yourself that you can, you know,
link |
you're trying to play that game.
link |
There's a lot of hot women on Instagram.
link |
How do you compete against them?
link |
You post really hot pictures
link |
and that's how you get more likes.
link |
As technology gets better, you know,
link |
more makeup techniques come along.
link |
And then more recently, these beauty filters
link |
where like at the touch of a button,
link |
it makes your face look absolutely incredible
link |
compared to your natural face.
link |
These technologies come along,
link |
it's everyone is incentivized to that short term strategy.
link |
But over on net, it's bad for everyone
link |
because now everyone is kind of feeling
link |
like they have to use these things.
link |
And these things like they make you like,
link |
the reason why I talked about them in this video
link |
is because I noticed it myself, you know,
link |
like I was trying to grow my Instagram for a while,
link |
I've given up on it now.
link |
But yeah, and I noticed these filters,
link |
how good they made me look.
link |
And I'm like, well, I know that everyone else
link |
is kind of doing it.
link |
Go subscribe to Liv's Instagram.
link |
Please, so I don't have to use the filters.
link |
I'll post a bunch of, yeah, make it blow up.
link |
So yeah, you felt the pressure actually.
link |
Exactly, these short term incentives
link |
to do this like, this thing that like either sacrifices
link |
your integrity or something else
link |
in order to like stay competitive,
link |
which on aggregate turns like,
link |
creates this like sort of race to the bottom spiral
link |
where everyone else ends up in a situation
link |
which is worse off than if they hadn't started,
link |
you know, than they were before.
link |
Kind of like if, like at a football stadium,
link |
like the system is so badly designed,
link |
a competitive system of like everyone sitting
link |
and having a view that if someone at the very front
link |
stands up to get an even better view,
link |
it forces everyone else behind
link |
to like adopt that same strategy
link |
just to get to where they were before.
link |
But now everyone's stuck standing up.
link |
Like, so you need this like top down God's eye coordination
link |
to make it go back to the better state.
link |
But from within the system, you can't actually do that.
link |
So that's kind of what this Moloch thing is.
link |
It's this thing that makes people sacrifice values
link |
in order to optimize for the winning the game in question,
link |
the short term game.
link |
But this Moloch, can you attribute it
link |
to any one centralized source
link |
or is it an emergent phenomena
link |
from a large collection of people?
link |
It's an emergent phenomena.
link |
It's a force of game theory.
link |
It's a force of bad incentives on a multi agent system
link |
where you've got more, you know,
link |
prisoner's dilemma is technically
link |
a kind of Moloch system as well,
link |
but it's just a two player thing.
link |
But another word for Moloch is it multipolar trap.
link |
Where basically you just got a lot of different people
link |
all competing for some kind of prize.
link |
And it would be better
link |
if everyone didn't do this one shitty strategy,
link |
but because that strategy gives you a short term advantage,
link |
everyone's incentivized to do it.
link |
And so everyone ends up doing it.
link |
So the responsibility for,
link |
I mean, social media is a really nice place
link |
for a large number of people to play game theory.
link |
And so they also have the ability
link |
to then design the rules of the game.
link |
And is it on them to try to anticipate
link |
what kind of like to do the thing
link |
that poker players are doing to run simulation?
link |
Ideally that would have been great.
link |
If, you know, Mark Zuckerberg and Jack
link |
and all the, you know, the Twitter founders and everyone,
link |
if they had at least just run a few simulations
link |
of how their algorithms would, you know,
link |
if different types of algorithms would turn out for society,
link |
that would have been great.
link |
That's really difficult to do
link |
that kind of deep philosophical thinking
link |
about thinking about humanity actually.
link |
So not kind of this level of how do we optimize engagement
link |
or what brings people joy in the short term,
link |
but how is this thing going to change
link |
the way people see the world?
link |
How is it gonna get morphed in iterative games played
link |
into something that will change society forever?
link |
That requires some deep thinking.
link |
That's, I hope there's meetings like that inside companies,
link |
but I haven't seen them.
link |
There aren't, that's the problem.
link |
And it's difficult because like,
link |
when you're starting up a social media company,
link |
you know, you're aware that you've got investors to please,
link |
there's bills to pay, you know,
link |
there's only so much R&D you can afford to do.
link |
You've got all these like incredible pressures,
link |
bad incentives to get on and just build your thing
link |
as quickly as possible and start making money.
link |
And, you know, I don't think anyone intended
link |
when they built these social media platforms
link |
and just to like preface it.
link |
So the reason why, you know, social media is relevant
link |
because it's a very good example of like,
link |
everyone these days is optimizing for, you know, clicks,
link |
whether it's a social media platforms themselves,
link |
because, you know, every click gets more, you know,
link |
impressions and impressions pay for, you know,
link |
they get advertising dollars
link |
or whether it's individual influencers
link |
or, you know, whether it's a New York Times or whoever,
link |
they're trying to get their story to go viral.
link |
So everyone's got this bad incentive of using, you know,
link |
as you called it, the clickbait industrial complex.
link |
That's a very molly key system
link |
because everyone is now using worse and worse tactics
link |
in order to like try and win this attention game.
link |
And yeah, so ideally these companies
link |
would have had enough slack in the beginning
link |
in order to run these experiments to see,
link |
okay, what are the ways this could possibly go wrong
link |
What are the ways that Moloch,
link |
they should be aware of this concept of Moloch
link |
and realize that whenever you have
link |
a highly competitive multiagent system,
link |
which social media is a classic example of,
link |
millions of agents all trying to compete
link |
for likes and so on,
link |
and you try and bring all this complexity down
link |
into like very small metrics,
link |
such as number of likes, number of retweets,
link |
whatever the algorithm optimizes for,
link |
that is a guaranteed recipe for this stuff to go wrong
link |
and become a race to the bottom.
link |
I think there should be an honesty when founders,
link |
I think there's a hunger for that kind of transparency
link |
of like, we don't know what the fuck we're doing.
link |
This is a fascinating experiment.
link |
We're all running as a human civilization.
link |
Let's try this out.
link |
And like, actually just be honest about this,
link |
that we're all like these weird rats in a maze.
link |
None of us are controlling it.
link |
There's this kind of sense like the founders,
link |
the CEO of Instagram or whatever,
link |
Mark Zuckerberg has a control and he's like,
link |
like with strings playing people.
link |
He's at the mercy of this is like everyone else.
link |
He's just like trying to do his best.
link |
And like, I think putting on a smile
link |
and doing over polished videos
link |
about how Instagram and Facebook are good for you,
link |
I think is not the right way to actually ask
link |
some of the deepest questions we get to ask as a society.
link |
How do we design the game such that we build a better world?
link |
I think a big part of this as well is people,
link |
there's this philosophy, particularly in Silicon Valley
link |
of well, techno optimism,
link |
technology will solve all our issues.
link |
And there's a steel man argument to that where yes,
link |
technology has solved a lot of problems
link |
and can potentially solve a lot of future ones.
link |
But it can also, it's always a double edged sword.
link |
And particularly as you know,
link |
technology gets more and more powerful
link |
and we've now got like big data
link |
and we're able to do all kinds of like
link |
psychological manipulation with it and so on.
link |
Technology is not a values neutral thing.
link |
People think, I used to always think this myself.
link |
It's like this naive view that,
link |
oh, technology is completely neutral.
link |
It's just, it's the humans that either make it good or bad.
link |
No, to the point we're at now,
link |
the technology that we are creating,
link |
they are social technologies.
link |
They literally dictate how humans now form social groups
link |
and so on beyond that.
link |
And beyond that, it also then,
link |
that gives rise to like the memes
link |
that we then like coalesce around.
link |
And that, if you have the stack that way
link |
where it's technology driving social interaction,
link |
which then drives like memetic culture
link |
and like which ideas become popular, that's Moloch.
link |
And we need the other way around, we need it.
link |
So we need to figure out what are the good memes?
link |
What are the good values
link |
that we think we need to optimize for
link |
that like makes people happy and healthy
link |
and like keeps society as robust and safe as possible,
link |
then figure out what the social structure
link |
around those should be.
link |
And only then do we figure out technology,
link |
but we're doing the other way around.
link |
And as much as I love in many ways
link |
the culture of Silicon Valley,
link |
and like I do think that technology has,
link |
I don't wanna knock it.
link |
It's done so many wonderful things for us,
link |
same as capitalism.
link |
There are, we have to like be honest with ourselves.
link |
We're getting to a point where we are losing control
link |
of this very powerful machine that we have created.
link |
Can you redesign the machine within the game?
link |
Can you just have, can you understand the game enough?
link |
Okay, this is the game.
link |
And this is how we start to reemphasize
link |
the memes that matter,
link |
the memes that bring out the best in us.
link |
You know, like the way I try to be in real life
link |
and the way I try to be online
link |
is to be about kindness and love.
link |
And I feel like I'm sometimes get like criticized
link |
for being naive and all those kinds of things.
link |
But I feel like I'm just trying to live within this game.
link |
I'm trying to be authentic.
link |
Yeah, but also like, hey, it's kind of fun to do this.
link |
Like you guys should try this too, you know,
link |
and that's like trying to redesign
link |
some aspects of the game within the game.
link |
I don't know, but I think we should try.
link |
I don't think we have an option but to try.
link |
Well, the other option is to create new companies
link |
or to pressure companies that,
link |
or anyone who has control of the rules of the game.
link |
I think we need to be doing all of the above.
link |
I think we need to be thinking hard
link |
about what are the kind of positive, healthy memes.
link |
You know, as Elon said,
link |
he who controls the memes controls the universe.
link |
I think he did, yeah.
link |
But there's truth to that.
link |
It's very, there is wisdom in that
link |
because memes have driven history.
link |
You know, we are a cultural species.
link |
That's what sets us apart from chimpanzees
link |
and everything else.
link |
We have the ability to learn and evolve through culture
link |
as opposed to biology or like, you know,
link |
classic physical constraints.
link |
And that means culture is incredibly powerful
link |
and we can create and become victim
link |
to very bad memes or very good ones.
link |
But we do have some agency over which memes,
link |
you know, we, but not only put out there,
link |
but we also like subscribe to.
link |
So I think we need to take that approach.
link |
We also need to, you know,
link |
because I don't want, I'm making this video right now
link |
called The Attention Wars,
link |
which is about like how Moloch,
link |
like the media machine is this Moloch machine.
link |
Well, is this kind of like blind dumb thing
link |
where everyone is optimizing for engagement
link |
in order to win their share of the attention pie.
link |
And then if you zoom out,
link |
it's really like Moloch that's pulling the strings
link |
because the only thing that benefits from this in the end,
link |
you know, like our information ecosystem is breaking down.
link |
Like we have, you look at the state of the US,
link |
it's in, we're in a civil war.
link |
It's just not a physical war.
link |
It's an information war.
link |
And people are becoming more fractured
link |
in terms of what their actual shared reality is.
link |
Like truly like an extreme left person,
link |
an extreme right person,
link |
like they literally live in different worlds
link |
in their minds at this point.
link |
And it's getting more and more amplified.
link |
And this force is like a razor blade
link |
pushing through everything.
link |
It doesn't matter how innocuous a topic is,
link |
it will find a way to split into this,
link |
you know, bifurcated cultural and it's fucking terrifying.
link |
Because that maximizes the tension.
link |
And that's like an emergent Moloch type force
link |
that takes anything, any topic
link |
and cuts through it so that it can split nicely
link |
Well, it's whatever, yeah,
link |
all everyone is trying to do within the system
link |
is just maximize whatever gets them the most attention
link |
because they're just trying to make money
link |
so they can keep their thing going, right?
link |
And the best emotion for getting attention,
link |
well, because it's not just about attention on the internet,
link |
it's engagement, that's the key thing, right?
link |
In order for something to go viral,
link |
you need people to actually engage with it.
link |
They need to like comment or retweet or whatever.
link |
And of all the emotions that,
link |
there's like seven classic shared emotions
link |
that studies have found that all humans,
link |
even from like previously uncontacted tribes have.
link |
Some of those are negative, you know, like sadness,
link |
disgust, anger, et cetera, some are positive,
link |
happiness, excitement, and so on.
link |
The one that happens to be the most useful
link |
for the internet is anger.
link |
Because anger, it's such an active emotion.
link |
If you want people to engage, if someone's scared,
link |
and I'm not just like talking out my ass here,
link |
there are studies here that have looked into this.
link |
Whereas like if someone's like,
link |
disgusted or fearful, they actually tend to then be like,
link |
oh, I don't wanna deal with this.
link |
So they're less likely to actually engage
link |
and share it and so on, they're just gonna be like, ugh.
link |
Whereas if they're enraged by a thing,
link |
well now that triggers all the like,
link |
the old tribalism emotions.
link |
And so that's how then things get sort of spread,
link |
you know, much more easily.
link |
They out compete all the other memes in the ecosystem.
link |
And so this like, the attention economy,
link |
the wheels that make it go around are,
link |
I did a tweet, the problem with raging against the machine
link |
is that the machine has learned to feed off rage.
link |
Because it is feeding off our rage.
link |
That's the thing that's now keeping it going.
link |
So the more we get angry, the worse it gets.
link |
So the mullet in this attention,
link |
in the war of attention is constantly maximizing rage.
link |
What it is optimizing for is engagement.
link |
And it happens to be that engagement
link |
is more propaganda, you know.
link |
I mean, it just sounds like everything is putting,
link |
more and more things are being put through this
link |
like propagandist lens of winning
link |
whatever the war is in question.
link |
Whether it's the culture war or the Ukraine war, yeah.
link |
Well, I think the silver lining of this,
link |
do you think it's possible that in the long arc
link |
of this process, you actually do arrive
link |
at greater wisdom and more progress?
link |
It just, in the moment, it feels like people are
link |
tearing each other to shreds over ideas.
link |
But if you think about it, one of the magic things
link |
about democracy and so on, is you have
link |
the blue versus red constantly fighting.
link |
It's almost like they're in discourse,
link |
creating devil's advocate, making devils out of each other.
link |
And through that process, discussing ideas.
link |
Like almost really embodying different ideas
link |
just to yell at each other.
link |
And through the yelling, over the period of decades,
link |
maybe centuries, figuring out a better system.
link |
Like in the moment, it feels fucked up.
link |
But in the long arc, it actually is productive.
link |
That said, we are now in the era of,
link |
just as we have weapons of mass destruction
link |
with nuclear weapons, you know,
link |
that can break the whole playing field,
link |
we now are developing weapons
link |
of informational mass destruction.
link |
Information weapons, you know, WMDs
link |
that basically can be used for propaganda
link |
or just manipulating people however is needed,
link |
whether that's through dumb TikTok videos,
link |
or, you know, there are significant resources being put in.
link |
I don't mean to sound like, you know,
link |
to doom and gloom, but there are bad actors out there.
link |
That's the thing, there are plenty of good actors
link |
within the system who are just trying to stay afloat
link |
in the game, so effectively doing monarchy things.
link |
But then on top of that, we have actual bad actors
link |
who are intentionally trying to, like,
link |
manipulate the other side into doing things.
link |
And using, so because it's a digital space,
link |
they're able to use artificial actors, meaning bots.
link |
Exactly, botnets, you know,
link |
and this is a whole new situation
link |
that we've never had before.
link |
Yeah, it's exciting.
link |
You know what I want to do?
link |
You know what I want to do that,
link |
because there is, you know, people are talking about bots
link |
manipulating and, like, malicious bots
link |
that are basically spreading propaganda.
link |
I want to create, like, a bot army for, like,
link |
that fights that. For love?
link |
Yeah, exactly, for love, that fights, that, I mean.
link |
You know, there's, I mean, there's truth
link |
to fight fire with fire, it's like,
link |
but how you always have to be careful
link |
whenever you create, again, like,
link |
Moloch is very tricky. Yeah, yeah.
link |
Hitler was trying to spread the love, too.
link |
Well, yeah, so we thought, but, you know, I agree with you
link |
that, like, that is a thing that should be considered,
link |
but there is, again, everyone,
link |
the road to hell is paved in good intentions.
link |
And this is, there's always unforeseen circumstances,
link |
you know, outcomes, externalities
link |
of you trying to adopt a thing,
link |
even if you do it in the very best of faith.
link |
But you can learn lessons of history.
link |
If you can run some sims on it first, absolutely.
link |
But also there's certain aspects of a system,
link |
as we've learned through history, that do better than others.
link |
Like, for example, don't have a dictator,
link |
so, like, if I were to create this bot army,
link |
it's not good for me to have full control over it.
link |
Because in the beginning, I might have a good understanding
link |
of what's good and not, but over time,
link |
that starts to get deviated,
link |
because I'll get annoyed at some assholes,
link |
and I'll think, okay, wouldn't it be nice
link |
to get rid of those assholes?
link |
But then that power starts getting to your head,
link |
you become corrupted, that's basic human nature.
link |
So distribute the power somehow.
link |
We need a love botnet on a DAO.
link |
A DAO love botnet.
link |
Yeah, and without a leader, like without...
link |
Well, exactly, a distributed, right,
link |
but yeah, without any kind of centralized...
link |
Yeah, without even, you know,
link |
basically it's the more control,
link |
the more you can decentralize the control of a thing
link |
to people, you know, but the balance...
link |
But then you still need the ability to coordinate,
link |
because that's the issue when something is too,
link |
you know, that's really, to me, like the culture wars,
link |
the bigger war we're dealing with is actually between
link |
the sort of the, I don't know what even the term is for it,
link |
but like centralization versus decentralization.
link |
That's the tension we're seeing.
link |
Power in control by a few versus completely distributed.
link |
And the trouble is if you have a fully centralized thing,
link |
then you're at risk of tyranny, you know,
link |
Stalin type things can happen, or completely distributed.
link |
Now you're at risk of complete anarchy and chaos
link |
but you can't even coordinate to like on, you know,
link |
when there's like a pandemic or anything like that.
link |
So it's like, what is the right balance to strike
link |
between these two structures?
link |
Can't Moloch really take hold
link |
in a fully decentralized system?
link |
That's one of the dangers too.
link |
Yes, very vulnerable to Moloch.
link |
So a dictator can commit huge atrocities,
link |
but they can also make sure the infrastructure works
link |
and trains run on time.
link |
They have that God's eye view at least.
link |
They have the ability to create like laws and rules
link |
that like force coordination, which stops Moloch.
link |
But then you're vulnerable to that dictator
link |
getting infected with like this,
link |
with some kind of psychopathy type thing.
link |
What's reverse Moloch?
link |
Sorry, great question.
link |
So that's where, so I've been working on this series.
link |
It's been driving me insane for the last year and a half.
link |
I did the first one a year ago.
link |
I can't believe it's nearly been a year.
link |
The second one, hopefully will be coming out
link |
And my goal at the end of the series is to like present,
link |
cause basically I'm painting the picture of like
link |
what Moloch is and how it's affecting
link |
almost all these issues in our society
link |
and how it's driving.
link |
It's like kind of the generator function
link |
as people describe it of existential risk.
link |
And then at the end of that.
link |
Wait, wait, the generator function of existential risk.
link |
So you're saying Moloch is sort of the engine
link |
that creates a bunch of X risks.
link |
Yes, not all of them.
link |
Like a, you know, a.
link |
Just a cool phrase, generator function.
link |
It's not my phrase.
link |
It's Daniel Schmacktenberger.
link |
Oh, Schmacktenberger.
link |
I got that from him.
link |
All things, it's like all roads lead back
link |
to Daniel Schmacktenberger, I think.
link |
The dude is, the dude is brilliant.
link |
He's really brilliant.
link |
After that it's Mark Twain.
link |
But anyway, sorry.
link |
Totally rude interruptions from me.
link |
So not all X risks.
link |
So like an asteroid technically isn't
link |
because it's, you know, it's just like
link |
this one big external thing.
link |
It's not like a competition thing going on.
link |
But, you know, synthetic bio, you know,
link |
bio weapons, that's one because everyone's incentivized
link |
to build, even for defense, you know,
link |
bad, bad viruses, you know,
link |
just to threaten someone else, et cetera.
link |
Or AI, technically the race to AGI
link |
is kind of potentially a Molochi situation.
link |
But yeah, so if Moloch is this like generator function
link |
that's driving all of these issues
link |
over the coming century that might wipe us out,
link |
what's the inverse?
link |
And so far what I've gotten to is this character
link |
that I want to put out there called Winwin.
link |
Because Moloch is the God of lose, lose, ultimately.
link |
It masquerades as the God of win, lose,
link |
but in reality it's lose, lose.
link |
Everyone ends up worse off.
link |
So I was like, well, what's the opposite of that?
link |
And I was thinking for ages, like,
link |
what's a good name for this character?
link |
And then tomorrow I was like, okay, well,
link |
don't try and, you know, think through it logically.
link |
What's the vibe of Winwin?
link |
And to me, like in my mind, Moloch is like,
link |
and I addressed that in the video,
link |
like it's red and black.
link |
It's kind of like very, you know, hyper focused
link |
on it's one goal you must win.
link |
So Winwin is kind of actually like these colors.
link |
It's like purple, turquoise.
link |
It's loves games too.
link |
It loves a little bit of healthy competition,
link |
but constrained, like kind of like before,
link |
like knows how to ring fence zero sum competition
link |
into like just the right amount,
link |
whereby its externalities can be controlled
link |
and kept positive.
link |
And then beyond that, it also loves cooperation,
link |
coordination, love, all these other things.
link |
But it's also kind of like mischievous,
link |
like, you know, it will have a good time.
link |
It's not like kind of like boring, you know,
link |
like, oh God, it knows how to have fun.
link |
It can get like, it can get down,
link |
but ultimately it's like unbelievably wise
link |
and it just wants the game to keep going.
link |
And I call it Winwin.
link |
That's a good like pet name, Winwin.
link |
I think the, Winwin, right?
link |
And I think it's formal name when it has to do
link |
like official functions is Omnia.
link |
From like omniscience kind of, why Omnia?
link |
You just like Omnia?
link |
She's like Omniwin.
link |
But I'm open to suggestions.
link |
I would like, you know, and this is.
link |
But there is an angelic kind of sense to Omnia though.
link |
So Winwin is more fun.
link |
So it's more like, it embraces the fun aspect.
link |
I mean, there is something about sort of,
link |
there's some aspect to Winwin interactions
link |
that requires embracing the chaos of the game
link |
and enjoying the game itself.
link |
I don't know what that is.
link |
That's almost like a Zen like appreciation
link |
of the game itself, not optimizing
link |
for the consequences of the game.
link |
Right, well, it's recognizing the value
link |
of competition in of itself about,
link |
it's not like about winning.
link |
It's about you enjoying the process of having a competition
link |
and not knowing whether you're gonna win
link |
or lose this little thing.
link |
But then also being aware that, you know,
link |
what's the boundary?
link |
How big do I want competition to be?
link |
Because one of the reason why Moloch is doing so well now
link |
in our society, in our civilization is
link |
because we haven't been able to ring fence competition.
link |
You know, and so it's just having all
link |
these negative externalities
link |
and it's, we've completely lost control of it.
link |
You know, it's, I think my guess is,
link |
and now we're getting really like,
link |
you know, metaphysical technically,
link |
but I think we'll be in a more interesting universe
link |
if we have one that has both pure cooperation,
link |
you know, lots of cooperation
link |
and some pockets of competition
link |
than one that's purely competition, cooperation entirely.
link |
Like it's good to have some little zero sumness bits,
link |
but I don't know that fully
link |
and I'm not qualified as a philosopher to know that.
link |
And that's what reverse Moloch,
link |
so this kind of win, win creature is a system,
link |
is an antidote to the Moloch system.
link |
And I don't know how it's gonna do that.
link |
But it's good to kind of try to start
link |
to formulate different ideas,
link |
different frameworks of how we think about that.
link |
At the small scale of a collection of individuals
link |
and a large scale of a society.
link |
It's a meme, I think it's an example of a good meme.
link |
And I'm open, I'd love to hear feedback from people
link |
if they think it's, you know, they have a better idea
link |
or it's not, you know,
link |
but it's the direction of memes that we need to spread,
link |
this idea of like, look for the win, wins in life.
link |
Well, on the topic of beauty filters,
link |
so in that particular context
link |
where Moloch creates negative consequences,
link |
Dostoevsky said beauty will save the world.
link |
What is beauty anyway?
link |
It would be nice to just try to discuss
link |
what kind of thing we would like to converge towards
link |
in our understanding of what is beautiful.
link |
So to me, I think something is beautiful
link |
when it can't be reduced down to easy metrics.
link |
Like if you think of a tree, what is it about a tree,
link |
like a big, ancient, beautiful tree, right?
link |
What is it about it that we find so beautiful?
link |
It's not, you know, the sweetness of its fruit
link |
or the value of its lumber.
link |
It's this entirety of it that is,
link |
there's these immeasurable qualities,
link |
it's like almost like a qualia of it.
link |
That's both, like it walks this fine line between pattern,
link |
well, it's got lots of patternicity,
link |
but it's not overly predictable.
link |
Again, it walks this fine line between order and chaos.
link |
It's a very highly complex system.
link |
It's evolving over time,
link |
the definition of a complex versus,
link |
and this is another Schmackt and Berger thing,
link |
a complex versus a complicated system.
link |
A complicated system can be sort of broken down
link |
into bits and pieces,
link |
a complicated system can be sort of broken down into bits,
link |
understood and then put back together.
link |
A complex system is kind of like a black box.
link |
It does all this crazy stuff,
link |
but if you take it apart,
link |
you can't put it back together again,
link |
because there's all these intricacies.
link |
And also very importantly, like there's some of the parts,
link |
sorry, the sum of the whole is much greater
link |
than the sum of the parts.
link |
And that's where the beauty lies, I think.
link |
And I think that extends to things like art as well.
link |
Like there's something immeasurable about it.
link |
There's something we can't break down to a narrow metric.
link |
Does that extend to humans, you think?
link |
So how can Instagram reveal that kind of beauty,
link |
the complexity of a human being?
link |
And this takes us back to dating sites and Goodreads,
link |
Very good question.
link |
I mean, well, I know what it shouldn't do.
link |
It shouldn't try and like, right now,
link |
you know, I was talking to like a social media expert
link |
recently, because I was like, oh, I hate that.
link |
There's such a thing as a social media expert?
link |
Oh, yeah, there are like agencies out there
link |
that you can like outsource,
link |
because I'm thinking about working with one to like,
link |
I want to start a podcast.
link |
You should, you should have done it a long time ago.
link |
It's going to be called Win Win.
link |
And it's going to be about this like positive sum stuff.
link |
And the thing that, you know, they always come back and say,
link |
is like, well, you need to like figure out
link |
what your thing is.
link |
You know, you need to narrow down what your thing is
link |
and then just follow that.
link |
Have like a sort of a formula,
link |
because that's what people want.
link |
They want to know that they're coming back
link |
to the same thing.
link |
And that's the advice on YouTube, Twitter, you name it.
link |
And that's why, and the trouble with that
link |
is that it's a complexity reduction.
link |
And generally speaking, you know,
link |
complexity reduction is bad.
link |
It's making things more, it's an oversimplification.
link |
Not that simplification is always a bad thing.
link |
But when you're trying to take, you know,
link |
what is social media doing?
link |
It's trying to like encapsulate the human experience
link |
and put it into digital form and commodify it to an extent.
link |
That, so you do that, you compress people down
link |
into these like narrow things.
link |
And that's why I think it's kind of ultimately
link |
fundamentally incompatible with at least
link |
my definition of beauty.
link |
It's interesting because there is some sense in which
link |
a simplification sort of in the Einstein kind of sense
link |
of a really complex idea, a simplification in a way
link |
that still captures some core power of an idea of a person
link |
is also beautiful.
link |
And so maybe it's possible for social media to do that.
link |
A presentation, a sort of a slither, a slice,
link |
a look into a person's life that reveals something
link |
But in a simple way, in a way that can be displayed
link |
graphically or through words.
link |
Some way, I mean, in some way Twitter can do
link |
that kind of thing.
link |
A very few set of words can reveal the intricacies
link |
Of course, the viral machine that spreads those words
link |
often results in people taking the thing out of context.
link |
People often don't read tweets in the context
link |
of the human being that wrote them.
link |
The full history of the tweets they've written,
link |
the education level, the humor level,
link |
the world view they're playing around with,
link |
all that context is forgotten and people just see
link |
the different words.
link |
So that can lead to trouble.
link |
But in a certain sense, if you do take it in context,
link |
it reveals some kind of quirky little beautiful idea
link |
or a profound little idea from that particular person
link |
that shows something about that person.
link |
So in that sense, Twitter can be more successful
link |
if we're talking about Mollux is driving
link |
a better kind of incentive.
link |
Yeah, I mean, how they can, like if we were to rewrite,
link |
is there a way to rewrite the Twitter algorithm
link |
so that it stops being the fertile breeding ground
link |
of the culture wars?
link |
Because that's really what it is.
link |
I mean, maybe I'm giving it, Twitter too much power,
link |
but just the more I looked into it
link |
and I had conversations with Tristan Harris
link |
from Center of Humane Technology.
link |
And he explained it as like,
link |
Twitter is where you have this amalgam of human culture
link |
and then this terribly designed algorithm
link |
that amplifies the craziest people
link |
and the angriest most divisive takes and amplifies them.
link |
And then the media, the mainstream media,
link |
because all the journalists are also on Twitter,
link |
they then are informed by that.
link |
And so they draw out the stories they can
link |
from this already like very boiling lava of rage
link |
and then spread that to their millions
link |
and millions of people who aren't even on Twitter.
link |
And so I honestly, I think if I could press a button,
link |
turn them off, I probably would at this point,
link |
because I just don't see a way
link |
of being compatible with healthiness,
link |
but that's not gonna happen.
link |
And so at least one way to like stem the tide
link |
and make it less malachy would be to change,
link |
at least if like it was on a subscription model,
link |
then it's now not optimizing for impressions.
link |
Cause basically what it wants is for people
link |
to keep coming back as often as possible.
link |
That's how they get paid, right?
link |
Every time an ad gets shown to someone
link |
and the way is to get people constantly refreshing their feed.
link |
So you're trying to encourage addictive behaviors.
link |
Whereas if someone, if they moved on
link |
to at least a subscription model,
link |
then they're getting the money either way,
link |
whether someone comes back to the site once a month
link |
or 500 times a month,
link |
they get the same amount of money.
link |
So now that takes away that incentive,
link |
to use technology, to build,
link |
to design an algorithm that is maximally addictive.
link |
That would be one way, for example.
link |
Yeah, but you still want people to,
link |
yeah, I just feel like that just slows down,
link |
creates friction in the virality of things.
link |
We need to slow down virality.
link |
It's good, it's one way.
link |
Virality is malach, to be clear.
link |
So malach is always negative then?
link |
Yes, by definition.
link |
Competition is not always negative.
link |
Competition is neutral.
link |
I disagree with you that all virality is negative then,
link |
Because it's a good intuition,
link |
because we have a lot of data on virality being negative.
link |
But I happen to believe that the core of human beings,
link |
so most human beings want to be good
link |
more than they want to be bad to each other.
link |
And so I think it's possible,
link |
it might be just harder to engineer systems
link |
that enable virality,
link |
but it's possible to engineer systems that are viral
link |
that enable virality.
link |
And the kind of stuff that rises to the top
link |
is things that are positive.
link |
And positive, not like la la positive,
link |
it's more like win win,
link |
meaning a lot of people need to be challenged.
link |
You grow from it, it might challenge you,
link |
you might not like it, but you ultimately grow from it.
link |
And ultimately bring people together
link |
as opposed to tear them apart.
link |
I deeply want that to be true.
link |
And I very much agree with you that people at their core
link |
are on average good, care for each other,
link |
as opposed to not.
link |
Like I think it's actually a very small percentage
link |
of people are truly wanting to do
link |
just like destructive malicious things.
link |
Most people are just trying to win their own little game.
link |
And they don't mean to be,
link |
they're just stuck in this badly designed system.
link |
That said, the current structure, yes,
link |
is the current structure means that virality
link |
is optimized towards Moloch.
link |
That doesn't mean there aren't exceptions.
link |
Sometimes positive stories do go viral
link |
and I think we should study them.
link |
I think there should be a whole field of study
link |
into understanding, identifying memes
link |
that above a certain threshold of the population
link |
agree is a positive, happy, bringing people together meme.
link |
The kind of thing that brings families together
link |
that would normally argue about cultural stuff
link |
at the table, at the dinner table.
link |
Identify those memes and figure out what it was,
link |
what was the ingredient that made them spread that day.
link |
And also like not just like happiness
link |
and connection between humans,
link |
but connection between humans in other ways
link |
that enables like productivity, like cooperation,
link |
solving difficult problems and all those kinds of stuff.
link |
So it's not just about let's be happy
link |
and have a fulfilling lives.
link |
It's also like, let's build cool shit.
link |
Let's get excited.
link |
Which is the spirit of collaboration,
link |
which is deeply anti Moloch, right?
link |
That's, it's not using competition.
link |
It's like, Moloch hates collaboration and coordination
link |
and people working together.
link |
And that's, again, like the internet started out as that
link |
and it could have been that,
link |
but because of the way it was sort of structured
link |
in terms of, you know, very lofty ideal,
link |
they wanted everything to be open source,
link |
open source and also free.
link |
And, but they needed to find a way to pay the bills anyway,
link |
because they were still building this
link |
on top of our old economics system.
link |
And so the way they did that
link |
was through third party advertisement.
link |
But that meant that things were very decoupled.
link |
You know, you've got this third party interest,
link |
which means that you're then like,
link |
people having to optimize for that.
link |
And that is, you know, the actual consumer
link |
is actually the product,
link |
not the person you're making the thing for.
link |
In the end, you start making the thing for the advertiser.
link |
And so that's why it then like breaks down.
link |
Yeah, like it's, there's no clean solution to this.
link |
And I, it's a really good suggestion by you actually
link |
to like figure out how we can optimize virality
link |
for positive sum topics.
link |
I shall be the general of the love bot army.
link |
Distributed, distributed, no, okay, yeah.
link |
The power, just even in saying that,
link |
the power already went to my head.
link |
No, okay, you've talked about quantifying your thinking.
link |
We've been talking about this,
link |
sort of a game theoretic view on life
link |
and putting probabilities behind estimates.
link |
Like if you think about different trajectories
link |
you can take through life,
link |
just actually analyzing life in game theoretic way,
link |
like your own life, like personal life.
link |
I think you've given an example
link |
that you had an honest conversation with Igor
link |
about like, how long is this relationship gonna last?
link |
So similar to our sort of marriage problem
link |
kind of discussion, having an honest conversation
link |
about the probability of things
link |
that we sometimes are a little bit too shy
link |
or scared to think of in a probabilistic terms.
link |
Can you speak to that kind of way of reasoning,
link |
the good and the bad of that?
link |
Can you do this kind of thing with human relations?
link |
Yeah, so the scenario you're talking about, it was like.
link |
Yeah, tell me about that scenario.
link |
Yeah, I think it was about a year into our relationship
link |
and we were having a fairly heavy conversation
link |
because we were trying to figure out
link |
whether or not I was gonna sell my apartment.
link |
Well, you know, he had already moved in,
link |
but I think we were just figuring out
link |
what like our longterm plans would be.
link |
We should be by a place together, et cetera.
link |
When you guys are having that conversation,
link |
are you like drunk out of your mind on wine
link |
or is he sober and you're actually having a serious?
link |
I think we were sober.
link |
How do you get to that conversation?
link |
Because most people are kind of afraid
link |
to have that kind of serious conversation.
link |
Well, so our relationship was very,
link |
well, first of all, we were good friends
link |
for a couple of years before we even got romantic.
link |
And when we did get romantic,
link |
it was very clear that this was a big deal.
link |
It wasn't just like another, it wasn't a random thing.
link |
So the probability of it being a big deal was high.
link |
It was already very high.
link |
And then we'd been together for a year
link |
and it had been pretty golden and wonderful.
link |
So, you know, there was a lot of foundation already
link |
where we felt very comfortable
link |
having a lot of frank conversations.
link |
But Igor's MO has always been much more than mine.
link |
He was always from the outset,
link |
like just in a relationship,
link |
radical transparency and honesty is the way
link |
because the truth is the truth,
link |
whether you want to hide it or not, you know,
link |
but it will come out eventually.
link |
And if you aren't able to accept difficult things yourself,
link |
then how could you possibly expect to be like
link |
the most integral version that, you know,
link |
you can't, the relationship needs this bedrock
link |
of like honesty as a foundation more than anything.
link |
Yeah, that's really interesting,
link |
but I would like to push against some of those ideas,
link |
but that's the down the line, yes, throw them up.
link |
I just rudely interrupt.
link |
And so, you know, we'd been about together for a year
link |
and things were good
link |
and we were having this hard conversation
link |
and then he was like, well, okay,
link |
what's the likelihood that we're going to be together
link |
in three years then?
link |
Because I think it was roughly a three year time horizon.
link |
And I was like, ooh, ooh, interesting.
link |
And then we were like, actually wait,
link |
before you said out loud,
link |
let's both write down our predictions formally
link |
because we'd been like,
link |
we're just getting into like effective altruism
link |
and rationality at the time,
link |
which is all about making formal predictions
link |
as a means of measuring your own,
link |
well, your own foresight essentially in a quantified way.
link |
So we like both wrote down our percentages
link |
and we also did a one year prediction
link |
and a 10 year one as well.
link |
So we got percentages for all three
link |
and then we showed each other.
link |
And I remember like having this moment of like, ooh,
link |
because for the 10 year one, I was like, well, I mean,
link |
but like a lot can happen in 10 years,
link |
and we've only been together for,
link |
so I was like, I think it's over 50%,
link |
but it's definitely not 90%.
link |
And I remember like wrestling,
link |
I was like, oh, but I don't want him to be hurt.
link |
I don't want him to,
link |
I don't want to give a number lower than his.
link |
And I remember thinking, I was like, ah, ah, don't game it.
link |
This is an exercise in radical honesty.
link |
So just give your real percentage.
link |
And I think mine was like 75%.
link |
And then we showed each other
link |
and luckily we were fairly well aligned.
link |
And, but honestly, even if we weren't.
link |
It definitely would have,
link |
I, if his had been consistently lower than mine,
link |
that would have rattled me for sure.
link |
Whereas if it had been the other way around,
link |
I think he would have,
link |
he's just kind of like a water off a duck's back type of guy.
link |
It'd be like, okay, well, all right, we'll figure this out.
link |
Well, did you guys provide error bars on the estimate?
link |
Like the level of uncertainty?
link |
They came built in.
link |
We didn't give formal plus or minus error bars.
link |
I didn't draw any or anything like that.
link |
Well, I guess that's the question I have is,
link |
did you feel informed enough to make such decisions?
link |
Cause like, I feel like if you were,
link |
if I were to do this kind of thing rigorously,
link |
I would want some data.
link |
I would want to set one of the assumptions you have
link |
is you're not that different from other relationships.
link |
And so I want to have some data about the way.
link |
You want the base rates.
link |
Yeah, and also actual trajectories of relationships.
link |
I would love to have like time series data
link |
about the ways that relationships fall apart or prosper,
link |
how they collide with different life events,
link |
losses, job changes, moving.
link |
Both partners find jobs, only one has a job.
link |
I want that kind of data
link |
and how often the different trajectories change in life.
link |
Like how informative is your past to your future?
link |
That's the whole thing.
link |
Like can you look at my life and have a good prediction
link |
about in terms of my characteristics and my relationships,
link |
what that's going to look like in the future or not?
link |
I don't even know the answer to that question.
link |
I'll be very ill informed in terms of making the probability.
link |
I would be far, yeah, I just would be under informed.
link |
I would be under informed.
link |
I'll be over biasing to my prior experiences, I think.
link |
Right, but as long as you're aware of that
link |
and you're honest with yourself,
link |
and you're honest with the other person,
link |
say, look, I have really wide error bars on this
link |
for the following reasons, that's okay.
link |
I still think it's better than not trying
link |
to quantify it at all.
link |
If you're trying to make really major
link |
irreversible life decisions.
link |
And I feel also the romantic nature of that question
link |
for me personally, I try to live my life
link |
thinking it's very close to 100%.
link |
Like, allowing myself actually the,
link |
this is the difficulty of this is allowing myself
link |
to think differently, I feel like has
link |
a psychological consequence.
link |
That's where that, that's one of my pushbacks
link |
against radical honesty is this one particular perspective.
link |
So you're saying you would rather give
link |
a falsely high percentage to your partner.
link |
Going back to the wide sage filth.
link |
In order to sort of create this additional optimism.
link |
Of fake it till you make it.
link |
The positive, the power of positive thinking.
link |
Hashtag positivity.
link |
Yeah, hashtag, it's with a hashtag.
link |
Well, so that, and this comes back to this idea
link |
of useful fictions, right?
link |
And I agree, I don't think there's a clear answer to this.
link |
And I think it's actually quite subjective.
link |
Some people this works better for than others.
link |
You know, to be clear, Igor and I weren't doing
link |
this formal prediction in it.
link |
Like we did it with very much tongue in cheek.
link |
It wasn't like we were going to make,
link |
I don't think it even would have drastically changed
link |
what we decided to do even.
link |
We kind of just did it more as a fun exercise.
link |
For the consequence of that fun exercise,
link |
you really actually kind of, there was a deep honesty to it.
link |
Exactly, it was a deep, and it was, yeah,
link |
it was just like this moment of reflection.
link |
I'm like, oh wow, I actually have to think
link |
like through this quite critically and so on.
link |
And it's also what was interesting was I got to like check
link |
in with what my desires were.
link |
So there was one thing of like what my actual prediction is,
link |
but what are my desires and could these desires
link |
be affecting my predictions and so on.
link |
And you know, that's a method of rationality.
link |
And I personally don't think it loses anything in terms of,
link |
I didn't take any of the magic away
link |
from our relationship, quite the opposite.
link |
Like it brought us closer together because it was like,
link |
we did this weird fun thing that I appreciate
link |
a lot of people find quite strange.
link |
And I think it was somewhat unique in our relationship
link |
that both of us are very, we both love numbers,
link |
we both love statistics, we're both poker players.
link |
So this was kind of like our safe space anyway.
link |
For others, one partner really might not
link |
like that kind of stuff at all, in which case
link |
this is not a good exercise to do.
link |
I don't recommend it to everybody.
link |
But I do think there's, it's interesting sometimes
link |
to poke holes in the probe at these things
link |
that we consider so sacred that we can't try
link |
to quantify them, which is interesting
link |
because that's in tension with like the idea
link |
of what we just talked about with beauty
link |
and like what makes something beautiful,
link |
the fact that you can't measure everything about it.
link |
And perhaps something shouldn't be tried to measure,
link |
maybe it's wrong to completely try and value
link |
the utilitarian, put a utilitarian frame
link |
of measuring the utility of a tree in its entirety.
link |
I don't know, maybe we should, maybe we shouldn't.
link |
I'm ambivalent on that.
link |
But overall, people have too many biases.
link |
People are overly biased against trying to do
link |
like a quantified cost benefit analysis
link |
on really tough life decisions.
link |
They're like, oh, just go with your gut.
link |
It's like, well, sure, but guts, our intuitions
link |
are best suited for things that we've got tons
link |
of experience in, then we can really, you don't trust on it.
link |
If it's a decision we've made many times,
link |
but if it's like, should I marry this person
link |
or should I buy this house over that house?
link |
You only make those decisions a couple of times
link |
in your life, maybe.
link |
Well, I would love to know, there's a balance,
link |
probably is a personal balance to strike
link |
is the amount of rationality you apply
link |
to a question versus the useful fiction,
link |
the fake it till you make it.
link |
For example, just talking to soldiers in Ukraine,
link |
you ask them, what's the probability of you winning,
link |
Almost everybody I talk to is 100%.
link |
And you listen to the experts, right?
link |
They say all kinds of stuff.
link |
They are, first of all, the morale there
link |
is higher than probably enough.
link |
I've never been to a war zone before this,
link |
but I've read about many wars
link |
and I think the morale in Ukraine is higher
link |
than almost any war I've read about.
link |
It's every single person in the country
link |
is proud to fight for their country.
link |
Everybody, not just soldiers, not everybody.
link |
Why do you think that is?
link |
Specifically more than in other wars?
link |
I think because there's perhaps a dormant desire
link |
for the citizens of this country to find
link |
the identity of this country because it's been
link |
going through this 30 year process
link |
of different factions and political bickering
link |
and they haven't had, as they talk about,
link |
they haven't had their independence war.
link |
They say all great nations have had an independence war.
link |
They had to fight for their independence,
link |
for the discovery of the identity of the core
link |
of the ideals that unify us and they haven't had that.
link |
There's constantly been factions, there's been divisions,
link |
there's been pressures from empires,
link |
from the United States and from Russia,
link |
from NATO and Europe, everybody telling them what to do.
link |
Now they want to discover who they are
link |
and there's that kind of sense that we're going to fight
link |
for the safety of our homeland,
link |
but we're also gonna fight for our identity.
link |
And that, on top of the fact that there's just,
link |
if you look at the history of Ukraine
link |
and there's certain other countries like this,
link |
there are certain cultures that are feisty
link |
in their pride of being the citizens of that nation.
link |
Ukraine is that, Poland was that.
link |
You just look at history.
link |
In certain countries, you do not want to occupy.
link |
I mean, both Stalin and Hitler talked about Poland
link |
in this way, they're like, this is a big problem
link |
if we occupy this land for prolonged periods of time.
link |
They're gonna be a pain in their ass.
link |
They're not going to want to be occupied.
link |
And certain other countries are pragmatic.
link |
They're like, well, leaders come and go.
link |
I guess this is good.
link |
Ukraine just doesn't have, Ukrainians,
link |
throughout the 20th century,
link |
don't seem to be the kind of people
link |
that just sit calmly and let the quote unquote occupiers
link |
impose their rules.
link |
That's interesting though, because you said it's always been
link |
under conflict and leaders have come and gone.
link |
So you would expect them to actually be the opposite
link |
under that like reasoning.
link |
Well, because it's a very fertile land,
link |
it's great for agriculture.
link |
So a lot of people want to,
link |
I mean, I think they've developed this culture
link |
because they've constantly been occupied
link |
by different people for the different peoples.
link |
And so maybe there is something to that
link |
where you've constantly had to feel like within the blood
link |
of the generations, there's the struggle against the man,
link |
against the imposition of rules, against oppression
link |
and all that kind of stuff, and that stays with them.
link |
So there's a will there, but a lot of other aspects
link |
are also part of it that has to do with
link |
the reverse Mollet kind of situation
link |
where social media has definitely played a part of it.
link |
Also different charismatic individuals
link |
have had to play a part.
link |
The fact that the president of the nation, Zelensky,
link |
stayed in Kiev during the invasion
link |
is a huge inspiration to them
link |
because most leaders, as you can imagine,
link |
when the capital of the nation is under attack,
link |
the wise thing, the smart thing
link |
that the United States advised Zelensky to do
link |
is to flee and to be the leader of the nation
link |
from a distant place.
link |
He said, fuck that, I'm staying put.
link |
Everyone around him, there was a pressure to leave
link |
and he didn't, and those singular acts
link |
really can unify a nation.
link |
There's a lot of people that criticize Zelensky
link |
Before the war, he was very unpopular, even still,
link |
but they put that aside, especially that singular act
link |
of staying in the capital.
link |
Yeah, a lot of those kinds of things come together
link |
to create something within people.
link |
These things always, of course, though,
link |
how zoomed out of a view do you wanna take?
link |
Because, yeah, you describe it,
link |
it's like an anti Moloch thing happened within Ukraine
link |
because it brought the Ukrainian people together
link |
in order to fight a common enemy.
link |
Maybe that's a good thing, maybe that's a bad thing.
link |
In the end, we don't know
link |
how this is all gonna play out, right?
link |
But if you zoom it out from a level, on a global level,
link |
they're coming together to fight that,
link |
that could make a conflict larger.
link |
You know what I mean?
link |
I don't know what the right answer is here.
link |
It seems like a good thing that they came together,
link |
but we don't know how this is all gonna play out.
link |
If this all turns into nuclear war, we'll be like,
link |
okay, that was the bad, that was the...
link |
Oh yeah, so I was describing the reverse Moloch
link |
for the local level.
link |
Now, this is where the experts come in and they say,
link |
well, if you channel most of the resources of the nation
link |
and the nations supporting Ukraine into the war effort,
link |
are you not beating the drums of war
link |
that is much bigger than Ukraine?
link |
In fact, even the Ukrainian leaders
link |
are speaking of it this way.
link |
This is not a war between two nations.
link |
This is the early days of a world war,
link |
if we don't play this correctly.
link |
Yes, and we need cool heads from our leaders.
link |
So from Ukraine's perspective,
link |
Ukraine needs to win the war
link |
because what does winning the war mean
link |
is coming to peace negotiations, an agreement
link |
that guarantees no more invasions.
link |
And then you make an agreement
link |
about what land belongs to who.
link |
And that's, you stop that.
link |
And basically from their perspective
link |
is you want to demonstrate to the rest of the world
link |
who's watching carefully, including Russia and China
link |
and different players on the geopolitical stage,
link |
that this kind of conflict is not going to be productive
link |
if you engage in it.
link |
So you want to teach everybody a lesson,
link |
let's not do World War III.
link |
It's gonna be bad for everybody.
link |
And so it's a lose, lose.
link |
It's a deep lose, lose.
link |
And I think that's actually a correct,
link |
when I zoom out, I mean, 99% of what I think about
link |
is just individual human beings and human lives
link |
and just that war is horrible.
link |
But when you zoom out and think
link |
from a geopolitics perspective,
link |
we should realize that it's entirely possible
link |
that we will see a World War III in the 21st century.
link |
And this is like a dress rehearsal for that.
link |
And so the way we play this as a human civilization
link |
will define whether we do or don't have a World War III.
link |
How we discuss war, how we discuss nuclear war,
link |
the kind of leaders we elect and prop up,
link |
the kind of memes we circulate,
link |
because you have to be very careful
link |
when you're being pro Ukraine, for example,
link |
you have to realize that you're being,
link |
you are also indirectly feeding
link |
the ever increasing military industrial complex.
link |
So you have to be extremely careful
link |
that when you say pro Ukraine or pro anybody,
link |
you're pro human beings, not pro the machine
link |
that creates narratives that says it's pro human beings.
link |
But it's actually, if you look at the raw use
link |
of funds and resources, it's actually pro making weapons
link |
and shooting bullets and dropping bombs.
link |
The real, we have to just somehow get the meme
link |
into everyone's heads that the real enemy is war itself.
link |
That's the enemy we need to defeat.
link |
And that doesn't mean to say that there isn't justification
link |
for small local scenarios, adversarial conflicts.
link |
If you have a leader who is starting wars,
link |
they're on the side of team war, basically.
link |
It's not that they're on the side of team country,
link |
whatever that country is,
link |
it's they're on the side of team war.
link |
So that needs to be stopped and put down.
link |
But you also have to find a way
link |
that your corrective measure doesn't actually then
link |
end up being coopted by the war machine
link |
and creating greater war.
link |
Again, the playing field is finite.
link |
The scale of conflict is now getting so big
link |
that the weapons that can be used are so mass destructive
link |
that we can't afford another giant conflict.
link |
We just, we won't make it.
link |
What existential threat in terms of us not making it
link |
are you most worried about?
link |
What existential threat to human civilization?
link |
We got like, let's go.
link |
Going down a dark path, huh?
link |
It's good, but no, well, no, it's a dark.
link |
No, it's like, well, while we're in the somber place,
link |
Some of my best friends are dark paths.
link |
What worries you most?
link |
We mentioned asteroids, we mentioned AGI, nuclear weapons.
link |
The one that's on my mind the most,
link |
mostly because I think it's the one where we have
link |
actually a real chance to move the needle on
link |
in a positive direction or more specifically,
link |
stop some really bad things from happening,
link |
really dumb, avoidable things is bio risks.
link |
In what kind of bio risks?
link |
There's so many fun options.
link |
So many, so of course, we have natural risks
link |
from natural pandemics, naturally occurring viruses
link |
or pathogens, and then also as time and technology goes on
link |
and technology becomes more and more democratized
link |
and into the hands of more and more people,
link |
the risk of synthetic pathogens.
link |
And whether or not you fall into the camp of COVID
link |
was gain of function accidental lab leak
link |
or whether it was purely naturally occurring,
link |
either way, we are facing a future where synthetic pathogens
link |
or like human meddled with pathogens
link |
either accidentally get out or get into the hands
link |
of bad actors who, whether they're omnicidal maniacs,
link |
you know, either way.
link |
And so that means we need more robustness for that.
link |
And you would think that us having this nice little dry run,
link |
which is what as awful as COVID was,
link |
and all those poor people that died,
link |
it was still like child's play compared
link |
to what a future one could be in terms of fatality rate.
link |
And so you'd think that we would then be coming,
link |
we'd be much more robust in our pandemic preparedness.
link |
And meanwhile, the budget in the last two years for the US,
link |
sorry, they just did this, I can't remember the name
link |
of what the actual budget was,
link |
but it was like a multi trillion dollar budget
link |
that the US just set aside.
link |
And originally in that, you know, considering that COVID
link |
cost multiple trillions to the economy, right?
link |
The original allocation in this new budget
link |
for future pandemic preparedness was 60 billion,
link |
so tiny proportion of it.
link |
That's proceeded to get whittled down to like 30 billion,
link |
to 15 billion, all the way down to 2 billion
link |
out of multiple trillions.
link |
For a thing that has just cost us multiple trillions,
link |
we've just finished, we're barely even,
link |
we're not even really out of it.
link |
It basically got whittled down to nothing
link |
because for some reason people think that,
link |
oh, all right, we've got the pandemic,
link |
out of the way, that was that one.
link |
And the reason for that is that people are,
link |
and I say this with all due respect
link |
to a lot of the science community,
link |
but there's an immense amount of naivety about,
link |
they think that nature is the main risk moving forward,
link |
and it really isn't.
link |
And I think nothing demonstrates this more
link |
than this project that I was just reading about
link |
that's sort of being proposed right now called Deep Vision.
link |
And the idea is to go out into the wilds,
link |
and we're not talking about just like within cities,
link |
like deep into like caves that people don't go to,
link |
deep into the Arctic, wherever, scour the earth
link |
for whatever the most dangerous possible pathogens
link |
could be that they can find.
link |
And then not only do, try and find these,
link |
bring samples of them back to laboratories.
link |
And again, whether you think COVID was a lab leak or not,
link |
I'm not gonna get into that,
link |
but we have historically had so many, as a civilization,
link |
we've had so many lab leaks
link |
from even like the highest level security things.
link |
Like it's just, people should go and just read it.
link |
It's like a comedy show of just how many they are,
link |
how leaky these labs are,
link |
even when they do their best efforts.
link |
So bring these things then back to civilization.
link |
That's step one of the badness.
link |
Then the next step would be to then categorize them,
link |
do experiments on them and categorize them
link |
by their level of potential.
link |
And then the piece de resistance on this plan
link |
is to then publish that information freely on the internet
link |
about all these pathogens, including their genome,
link |
which is literally like the building instructions
link |
of how to do them on the internet.
link |
And this is something that genuinely,
link |
a pocket of the like bio,
link |
of the scientific community thinks is a good idea.
link |
And I think on expectation, like the,
link |
and their argument is, is that, oh, this is good,
link |
because it might buy us some time to develop the vaccines,
link |
which, okay, sure, maybe would have made sense
link |
prior to mRNA technology, but you know, like they,
link |
mRNA, we can develop a vaccine now
link |
when we find a new pathogen within a couple of days.
link |
Now then there's all the trials and so on.
link |
Those trials would have to happen anyway,
link |
in the case of a brand new thing.
link |
So you're saving maybe a couple of days.
link |
So that's the upside.
link |
Meanwhile, the downside is you're not only giving,
link |
you're not only giving the vaccine,
link |
you're bringing the risk of these pathogens
link |
of like getting leaked,
link |
but you're literally handing it out
link |
to every bad actor on earth who would be doing cartwheels.
link |
And I'm talking about like Kim Jong Un, ISIS,
link |
people who like want,
link |
they think the rest of the world is their enemy.
link |
And in some cases they think that killing it themselves
link |
is like a noble cause.
link |
And you're literally giving them the building blocks
link |
of how to do this.
link |
It's the most batshit idea I've ever heard.
link |
Like on expectation, it's probably like minus EV
link |
of like multiple billions of lives
link |
if they actually succeeded in doing this.
link |
Certainly in the tens or hundreds of millions.
link |
So the cost benefit is so unbelievably, it makes no sense.
link |
And I was trying to wrap my head around like why,
link |
like what's going wrong in people's minds
link |
to think that this is a good idea?
link |
And it's not that it's malice or anything like that.
link |
I think it's that people don't,
link |
the proponents, they're actually overly naive
link |
about the interactions of humanity.
link |
And well, like there are bad actors
link |
who will use this for bad things.
link |
Because not only will it,
link |
if you publish this information,
link |
even if a bad actor couldn't physically make it themselves,
link |
which given in 10 years time,
link |
like the technology is getting cheaper and easier to use.
link |
But even if they couldn't make it, they could now bluff it.
link |
Like what would you do if there's like some deadly new virus
link |
that we were published on the internet
link |
in terms of its building blocks?
link |
Kim Jong Un could be like,
link |
hey, if you don't let me build my nuclear weapons,
link |
I'm gonna release this, I've managed to build it.
link |
Well, now he's actually got a credible bluff.
link |
And so that's, it's just like handing the keys,
link |
it's handing weapons of mass destruction to people.
link |
The possible, I agree with you,
link |
but the possible world in which it might make sense
link |
is if the good guys, which is a whole nother problem,
link |
defining who the good guys are,
link |
but the good guys are like an order of magnitude
link |
higher competence.
link |
And so they can stay ahead of the bad actors
link |
by just being very good at the defense.
link |
By very good, not meaning like a little bit better,
link |
but an order of magnitude better.
link |
But of course the question is,
link |
in each of those individual disciplines, is that feasible?
link |
Can you, can the bad actors,
link |
even if they don't have the competence leapfrog
link |
to the place where the good guys are?
link |
Yeah, I mean, I would agree in principle
link |
with pertaining to this like particular plan of like,
link |
that, you know, with the thing I described,
link |
this deep vision thing, where at least then
link |
that would maybe make sense for steps one and step two
link |
of like getting the information,
link |
but then why would you release it,
link |
the information to your literal enemies?
link |
You know, that's, that makes,
link |
that doesn't fit at all in that perspective
link |
of like trying to be ahead of them.
link |
You're literally handing them the weapon.
link |
But there's different levels of release, right?
link |
So there's the kind of secrecy
link |
where you don't give it to anybody,
link |
but there's a release where you incrementally give it
link |
to like major labs.
link |
So it's not public release, but it's like,
link |
you're giving it to major labs.
link |
Yeah, there's different layers of reasonability, but.
link |
But the problem there is it's going to,
link |
if you go anywhere beyond like complete secrecy,
link |
That's the thing, it's very hard to keep secrets.
link |
And so that's still. Information is.
link |
So you might as well release it to the public
link |
So you either go complete secrecy
link |
or you release it to the public.
link |
So, which is essentially the same thing.
link |
It's going to leak anyway,
link |
if you don't do complete secrecy.
link |
Right, which is why you shouldn't get the information
link |
in the first place.
link |
Yeah, I mean, what, in that, I think.
link |
Well, that's a solution.
link |
Yeah, the solution is either don't get the information
link |
in the first place or B, keep it incredibly,
link |
incredibly contained.
link |
See, I think, I think it really matters
link |
which discipline we're talking about.
link |
So in the case of biology, I do think you're very right.
link |
We shouldn't even be, it should be forbidden
link |
to even like, think about that.
link |
Meaning don't collect, don't just even collect
link |
the information, but like, don't do,
link |
I mean, gain of function research is a really iffy area.
link |
I mean, it's all about cost benefits, right?
link |
There are some scenarios where I could imagine
link |
the cost benefit of a gain of function research
link |
is very, very clear, where you've evaluated
link |
all the potential risks, factored in the probability
link |
that things can go wrong.
link |
And like, you know, not only known unknowns,
link |
but unknown unknowns as well, tried to quantify that.
link |
And then even then it's like orders of magnitude
link |
better to do that.
link |
I'm behind that argument.
link |
But the point is that there's this like,
link |
naivety that's preventing people from even doing
link |
the cost benefit properly on a lot of the things
link |
because, you know, I get it.
link |
The science community, again, I don't want to bucket
link |
the science community, but like some people
link |
within the science community just think
link |
that everyone's good and everyone just cares
link |
about getting knowledge and doing the best for the world.
link |
And unfortunately, that's not the case.
link |
I wish we lived in that world, but we don't.
link |
Yeah, I mean, there's a lie.
link |
Listen, I've been criticizing the science community
link |
broadly quite a bit.
link |
There's so many brilliant people that brilliance
link |
is somehow a hindrance sometimes
link |
because it has a bunch of blind spots.
link |
And then you start to look at the history of science,
link |
how easily it's been used by dictators
link |
to any conclusion they want.
link |
And it's dark how you can use brilliant people
link |
that like playing the little game of science
link |
because it is a fun game.
link |
You know, you're building, you're going to conferences,
link |
you're building on top of each other's ideas,
link |
there's breakthroughs.
link |
Hi, I think I've realized how this particular molecule works
link |
and I could do this kind of experiment
link |
and everyone else is impressed.
link |
No, I think you're wrong.
link |
Let me show you why you're wrong.
link |
And that little game, everyone gets really excited
link |
and they get excited, oh, I came up with a pill
link |
that solves this problem
link |
and it's going to help a bunch of people.
link |
And I came up with a giant study
link |
that shows the exact probability it's going to help or not.
link |
And you get lost in this game
link |
and you forget to realize this game, just like Moloch,
link |
Unintended consequences.
link |
Unintended consequences that might
link |
destroy human civilization.
link |
Or divide human civilization
link |
or have dire geopolitical consequences.
link |
I mean, the effects of, I mean, it's just so...
link |
The most destructive effects of COVID
link |
have nothing to do with the biology of the virus,
link |
I mean, I could just list them forever,
link |
but like one of them is the complete distress
link |
of public institutions.
link |
The other one is because of that public distress,
link |
I feel like if a much worse pandemic came along,
link |
we as a world have now cried wolf.
link |
And if an actual wolf now comes,
link |
people will be like, fuck masks, fuck...
link |
Fuck vaccines, yeah.
link |
And they won't be...
link |
They'll distrust every single thing
link |
that any major institution is going to tell them.
link |
Because that's the thing,
link |
like there were certain actions made by
link |
certain health public figures where they told,
link |
they very knowingly told it was a white lie,
link |
it was intended in the best possible way,
link |
such as early on when there was clearly a shortage of masks.
link |
And so they said to the public,
link |
oh, don't get masks, there's no evidence that they work.
link |
Or don't get them, they don't work.
link |
In fact, it might even make it worse.
link |
You might even spread it more.
link |
Like that was the real like stinker.
link |
Yeah, no, no, unless you know how to do it properly,
link |
you're gonna make that you're gonna get sicker
link |
or you're more likely to catch the virus,
link |
which is just absolute crap.
link |
And they put that out there.
link |
And it's pretty clear the reason why they did that
link |
was because there was actually a shortage of masks
link |
and they really needed it for health workers,
link |
which makes sense.
link |
Like, I agree, like, you know,
link |
but the cost of lying to the public
link |
when that then comes out,
link |
people aren't as stupid as they think they are.
link |
And that's, I think where this distrust of experts
link |
has largely come from.
link |
A, they've lied to people overtly,
link |
but B, people have been treated like idiots.
link |
Now, that's not to say that there aren't a lot
link |
of stupid people who have a lot of wacky ideas
link |
around COVID and all sorts of things.
link |
But if you treat the general public like children,
link |
they're going to see that, they're going to notice that.
link |
And that is going to just like absolutely decimate the trust
link |
in the public institutions that we depend upon.
link |
And honestly, the best thing that could happen,
link |
I wish like if like Fauci or, you know,
link |
and these other like leaders who, I mean, God,
link |
I would, I can't imagine how nightmare his job has been
link |
for the last few years, hell on earth.
link |
Like, so, you know, I, you know,
link |
I have a lot of sort of sympathy
link |
for the position he's been in.
link |
But like, if he could just come out and be like,
link |
okay, look, guys, hands up,
link |
we didn't handle this as well as we could have.
link |
These are all the things I would have done differently
link |
I apologize for this and this and this and this.
link |
That would go so far.
link |
And maybe I'm being naive, who knows,
link |
maybe this would backfire, but I don't think it would.
link |
Like to someone like me even,
link |
cause I've like, I've lost trust
link |
in a lot of these things.
link |
But I'm fortunate that I at least know people
link |
who I can go to who I think are good,
link |
like have good epistemics on this stuff.
link |
But you know, if they, if they could sort of put their hands
link |
on my go, okay, these are the spots where we screwed up.
link |
This, this, this, this was our reasons.
link |
Yeah, we actually told a little white lie here.
link |
We did it for this reason.
link |
We're really sorry.
link |
Where they just did the radical honesty thing,
link |
the radical transparency thing,
link |
that would go so far to rebuilding public trust.
link |
And I think that's what needs to happen.
link |
I totally agree with you.
link |
Unfortunately, yeah, his job was very tough
link |
and all those kinds of things, but I see arrogance
link |
and arrogance prevented him from being honest
link |
in that way previously.
link |
And I think arrogance will prevent him
link |
from being honest in that way.
link |
Now we need leaders.
link |
I think young people are seeing that,
link |
that kind of talking down to people
link |
from a position of power, I hope is the way of the past.
link |
People really like authenticity
link |
and they like leaders that are like a man
link |
and a woman of the people.
link |
And I think that just.
link |
I mean, he still has a chance to do that, I think.
link |
I mean, I don't wanna, you know, I don't think, you know,
link |
if I doubt he's listening, but if he is like,
link |
hey, I think, you know, I don't think he's irredeemable
link |
I think there's, you know, I don't have an opinion
link |
whether there was arrogance or there or not.
link |
Just know that I think like coming clean on the, you know,
link |
it's understandable to have fucked up during this pandemic.
link |
Like I won't expect any government to handle it well
link |
because it was so difficult, like so many moving pieces,
link |
so much like lack of information and so on.
link |
But the step to rebuilding trust is to go, okay, look,
link |
we're doing a scrutiny of where we went wrong.
link |
And for my part, I did this wrong in this part.
link |
And that would be huge.
link |
All of us can do that.
link |
I mean, I was struggling for a while
link |
whether I want to talk to him or not.
link |
I talked to his boss, Francis Collins.
link |
Another person that's screwed up in terms of trust,
link |
lost a little bit of my respect too.
link |
There seems to have been a kind of dishonesty
link |
in the backrooms in that they didn't trust people
link |
to be intelligent.
link |
Like we need to tell them what's good for them.
link |
We know what's good for them.
link |
That kind of idea.
link |
To be fair, the thing that's, what's it called?
link |
I heard the phrase today, nut picking.
link |
Social media does that.
link |
So you've got like nitpicking.
link |
Nut picking is where the craziest, stupidest,
link |
you know, if you have a group of people,
link |
let's say people who are vaccine,
link |
I don't like the term anti vaccine,
link |
people who are vaccine hesitant, vaccine speculative.
link |
So what social media did or the media or anyone,
link |
their opponents would do is pick the craziest example.
link |
So the ones who are like,
link |
I think I need to inject myself with motor oil
link |
up my ass or something.
link |
Select the craziest ones and then have that beamed too.
link |
So from like someone like Fauci or Francis's perspective,
link |
that's what they get because they're getting
link |
the same social media stuff as us.
link |
They're getting the same media reports.
link |
I mean, they might get some more information,
link |
but they too are gonna get the nuts portrayed to them.
link |
So they probably have a misrepresentation
link |
of what the actual public's intelligence is.
link |
Well, that's just, yes.
link |
And that just means they're not social media savvy.
link |
So one of the skills of being on social media
link |
is to be able to filter that in your mind,
link |
like to understand, to put into proper context.
link |
To realize that what you are seeing,
link |
social media is not anywhere near
link |
an accurate representation of humanity.
link |
Nut picking, and there's nothing wrong
link |
with putting motor oil up your ass.
link |
It's just one of the better aspects of,
link |
I do this every weekend.
link |
Where the hell did that analogy come from in my mind?
link |
I think you need to, there's some Freudian thing
link |
you would need to deeply investigate with a therapist.
link |
Okay, what about AI?
link |
Are you worried about AGI, super intelligence systems
link |
or paperclip maximizer type of situation?
link |
Yes, I'm definitely worried about it,
link |
but I feel kind of bipolar in the,
link |
some days I wake up and I'm like.
link |
You're excited about the future?
link |
I'm like, wow, we can unlock the mysteries of the universe.
link |
You know, escape the game.
link |
And this, you know,
link |
because I spend all my time thinking
link |
about these molecule problems that, you know,
link |
what is the solution to them?
link |
What, you know, in some ways you need this like
link |
omni benevolent, omniscient, omni wise coordination mechanism
link |
that can like make us all not do the molecule thing
link |
or like provide the infrastructure
link |
or redesign the system so that it's not vulnerable
link |
to this molecule process.
link |
And in some ways, you know,
link |
that's the strongest argument to me
link |
for like the race to build AGI
link |
is that maybe, you know, we can't survive without it.
link |
But the flip side to that is the,
link |
the unfortunately now that there's multiple actors
link |
trying to build AI, AGI, you know,
link |
this was fine 10 years ago when it was just DeepMind,
link |
but then other companies started up
link |
and now it created a race dynamic.
link |
Now it's like, that's the whole thing.
link |
Is it the same, it's got the same problem.
link |
It's like whichever company is the one that like optimizes
link |
for speed at the cost of safety
link |
will get the competitive advantage.
link |
And so we're the more likely the ones to build the AGI,
link |
you know, and that's the same cycle that you're in.
link |
And there's no clear solution to that
link |
because you can't just go like slapping,
link |
if you go and try and like stop all the different companies,
link |
then it will, you know, the good ones will stop
link |
because they're the ones, you know,
link |
within the West's reach,
link |
but then that leaves all the other ones to continue
link |
and then they're even more likely.
link |
So it's like, it's a very difficult problem
link |
with no clean solution.
link |
And, you know, at the same time, you know,
link |
I know at least some of the folks at DeepMind
link |
and they're incredible and they're thinking about this.
link |
They're very aware of this problem.
link |
And they're like, you know,
link |
I think some of the smartest people on earth.
link |
Yeah, the culture is important there
link |
because they are thinking about that
link |
and they're some of the best machine learning engineers.
link |
So it's possible to have a company or a community of people
link |
that are both great engineers
link |
and are thinking about the philosophical topics.
link |
Exactly, and importantly, they're also game theorists,
link |
you know, and because this is ultimately
link |
a game theory problem, the thing, this Moloch mechanism
link |
and like, you know, how do we voice arms race scenarios?
link |
You need people who aren't naive to be thinking about this.
link |
And again, like luckily there's a lot of smart,
link |
non naive game theorists within that group.
link |
Yes, I'm concerned about it and I think it's again,
link |
a thing that we need people to be thinking about
link |
in terms of like, how do we create,
link |
how do we mitigate the arms race dynamics
link |
and how do we solve the thing of,
link |
Bostrom calls it the orthogonality problem whereby,
link |
because it's obviously there's a chance, you know,
link |
the belief, the hope is,
link |
is that you build something that's super intelligent
link |
and by definition of being super intelligent,
link |
it will also become super wise
link |
and have the wisdom to know what the right goals are.
link |
And hopefully those goals include keeping humanity alive.
link |
But Bostrom says that actually those two things,
link |
you know, super intelligence and super wisdom
link |
aren't necessarily correlated.
link |
They're actually kind of orthogonal things.
link |
And how do we make it so that they are correlated?
link |
How do we guarantee it?
link |
Because we need it to be guaranteed really,
link |
to know that we're doing the thing safely.
link |
But I think that like merging of intelligence and wisdom,
link |
at least my hope is that this whole process
link |
happens sufficiently slowly
link |
that we're constantly having these kinds of debates
link |
that we have enough time to figure out
link |
how to modify each version of the system
link |
as it becomes more and more intelligent.
link |
Yes, buying time is a good thing, definitely.
link |
Anything that slows everything down.
link |
We just, everyone needs to chill out.
link |
We've got millennia to figure this out.
link |
Or at least, at least, well, it depends.
link |
Again, some people think that, you know,
link |
we can't even make it through the next few decades
link |
without having some kind of
link |
omni wise coordination mechanism.
link |
And there's also an argument to that.
link |
Yeah, I don't know.
link |
Well, there is, I'm suspicious of that kind of thinking
link |
because it seems like the entirety of human history
link |
has people in it that are like predicting doom
link |
just around the corner.
link |
There's something about us
link |
that is strangely attracted to that thought.
link |
It's almost like fun to think about
link |
the destruction of everything.
link |
Just objectively speaking,
link |
I've talked and listened to a bunch of people
link |
and they are gravitating towards that.
link |
It's almost, I think it's the same thing
link |
that people love about conspiracy theories
link |
is they love to be the person that kind of figured out
link |
some deep fundamental thing about the,
link |
that's going to be, it's going to mark something
link |
extremely important about the history of human civilization
link |
because then I will be important.
link |
When in reality, most of us will be forgotten
link |
and life will go on.
link |
And one of the sad things about
link |
whenever anything traumatic happens to you,
link |
whenever you lose loved ones or just tragedy happens,
link |
you realize life goes on.
link |
Even after a nuclear war that will wipe out
link |
some large percentage of the population
link |
and will torture people for years to come
link |
because of the effects of a nuclear winter,
link |
people will still survive.
link |
Life will still go on.
link |
I mean, it depends on the kind of nuclear war.
link |
But in the case of nuclear war, it will still go on.
link |
That's one of the amazing things about life.
link |
And so in that sense, I just,
link |
I feel like the doom and gloom thing
link |
Well, what we don't, yeah,
link |
we don't want a self fulfilling prophecy.
link |
Yes, that's exactly.
link |
Yes, and I very much agree with that.
link |
And I even have a slight feeling
link |
from the amount of time we spent in this conversation
link |
talking about this,
link |
because it's like, is this even a net positive
link |
if it's like making everyone feel,
link |
oh, in some ways, like making people imagine
link |
these bad scenarios can be a self fulfilling prophecy,
link |
but at the same time, that's weighed off
link |
with at least making people aware of the problem
link |
and gets them thinking.
link |
And I think particularly,
link |
the reason why I wanna talk about this to your audience
link |
is that on average, they're the type of people
link |
who gravitate towards these kinds of topics
link |
because they're intellectually curious
link |
and they can sort of sense that there's trouble brewing.
link |
They can smell that there's,
link |
I think there's a reason
link |
that people are thinking about this stuff a lot
link |
is because the probability,
link |
the probability, it's increased in probability
link |
over certainly over the last few years,
link |
trajectories have not gone favorably,
link |
let's put it since 2010.
link |
So it's right, I think, for people to be thinking about it,
link |
but that's where they're like,
link |
I think whether it's a useful fiction
link |
or whether it's actually true
link |
or whatever you wanna call it,
link |
I think having this faith,
link |
this is where faith is valuable
link |
because it gives you at least this like anchor of hope.
link |
And I'm not just saying it to like trick myself,
link |
I do think there's something out there that wants us to win.
link |
I think there's something that really wants us to win.
link |
And it just, you just have to be like,
link |
just like kind of, okay, now I sound really crazy,
link |
but like open your heart to it a little bit
link |
and it will give you the like,
link |
the sort of breathing room
link |
with which to marinate on the solutions.
link |
We are the ones who have to come up with the solutions,
link |
but we can use that.
link |
There's like, there's hashtag positivity.
link |
There's value in that.
link |
Yeah, you have to kind of imagine
link |
all the destructive trajectories that lay in our future
link |
and then believe in the possibility
link |
of avoiding those trajectories.
link |
All while, you said audience,
link |
all while sitting back, which is majority,
link |
the two people that listen to this
link |
are probably sitting on a beach,
link |
smoking some weed, just, that's a beautiful sunset.
link |
They're looking at just the waves going in and out.
link |
And ultimately there's a kind of deep belief there
link |
in the momentum of humanity to figure it all out.
link |
But we've got a lot of work to do.
link |
Which is what makes this whole simulation,
link |
this video game kind of fun.
link |
This battle of polytopia,
link |
I still, man, I love those games so much.
link |
And that one for people who don't know,
link |
Battle of Polytopia is a big,
link |
it's like a, is this really radical simplification
link |
of a civilization type of game.
link |
It still has a lot of the skill tree development,
link |
a lot of the strategy,
link |
but it's easy enough to play on a phone.
link |
It's kind of interesting.
link |
They've really figured it out.
link |
It's one of the most elegantly designed games
link |
It's incredibly complex.
link |
And yet being, again, it walks that line
link |
between complexity and simplicity
link |
in this really, really great way.
link |
And they use pretty colors
link |
that hack the dopamine reward circuits in our brains.
link |
Video games are so fun.
link |
Most of this life is just about fun.
link |
Escaping all the suffering to find the fun.
link |
What's energy healing?
link |
I have in my notes, energy healing question mark.
link |
What's that about?
link |
God, your audience is gonna think I'm mad.
link |
So the two crazy things that happened to me,
link |
the one was the voice in the head
link |
that said you're gonna win this tournament
link |
and then I won the tournament.
link |
The other craziest thing that's happened to me
link |
I started getting this like weird problem in my ear
link |
where it was kind of like low frequency sound distortion,
link |
where voices, particularly men's voices,
link |
became incredibly unpleasant to listen to.
link |
It would like create this,
link |
it would like be falsely amplified or something
link |
and it was almost like a physical sensation in my ear,
link |
which was really unpleasant.
link |
And it would like last for a few hours and then go away
link |
and then come back for a few hours and go away.
link |
And I went and got hearing tests
link |
and they found that like the bottom end,
link |
I was losing the hearing in that ear.
link |
And in the end, I got,
link |
doctors said they think it was this thing
link |
called Meniere's disease,
link |
which is this very unpleasant disease
link |
where people basically end up losing their hearing,
link |
but they get this like,
link |
it often comes with like dizzy spells and other things
link |
because it's like the inner ear gets all messed up.
link |
Now, I don't know if that's actually what I had,
link |
but that's what at least a couple of,
link |
one doctor said to me.
link |
But anyway, so I'd had three months of this stuff,
link |
this going on and it was really getting me down.
link |
And I was at Burning Man of all places.
link |
I don't mean to be that person talking about Burning Man,
link |
And again, I'd had it and I was unable to listen to music,
link |
which is not what you want
link |
because Burning Man is a very loud, intense place.
link |
And I was just having a really rough time.
link |
And on the final night,
link |
I get talking to this girl who's like a friend of a friend.
link |
And I mentioned, I was like,
link |
oh, I'm really down in the dumps about this.
link |
And she's like, oh, well,
link |
I've done a little bit of energy healing.
link |
Would you like me to have a look?
link |
And I was like, sure.
link |
Now this was again,
link |
deep, I was, you know, no time in my life for this.
link |
I didn't believe in any of this stuff.
link |
I was just like, it's all bullshit.
link |
It's all wooey nonsense.
link |
But I was like, sure, I'll have a go.
link |
And she starts like with her hand and she says,
link |
oh, there's something there.
link |
And then she leans in and she starts like sucking
link |
over my ear, not actually touching me,
link |
but like close to it, like with her mouth.
link |
And it was really unpleasant.
link |
I was like, whoa, can you stop?
link |
She's like, no, no, no, there's something there.
link |
And I was like, no, no, no, I really don't like it.
link |
Please, this is really loud.
link |
She's like, I need to just bear with me.
link |
And I don't know how long, for a few minutes.
link |
And then she eventually collapses on the ground,
link |
like freezing cold, crying.
link |
And I'm just like, I don't know what the hell is going on.
link |
Like I'm like thoroughly freaked out
link |
as is everyone else watching.
link |
Just like, what the hell?
link |
And we like warm her up and she was like,
link |
oh, what, oh, you know, she was really shaken up.
link |
And she's like, I don't know what that,
link |
she said it was something very unpleasant and dark.
link |
Don't worry, it's gone.
link |
I think you'll be fine in a couple,
link |
you'll have the physical symptoms for a couple of weeks
link |
and you'll be fine.
link |
But, you know, she was just like that, you know,
link |
so I was so rattled, A, because the potential that actually
link |
I'd had something bad in me that made someone feel bad
link |
and that she was scared.
link |
That was what, you know, I was like, wait,
link |
I thought you do this, this is the thing.
link |
Now you're terrified.
link |
Like you bought like some kind of exorcism or something.
link |
Like what the fuck is going on?
link |
So it, like just the most insane experience.
link |
And frankly, it took me like a few months
link |
to sort of emotionally recover from it.
link |
But my ear problem went away about a couple of weeks later
link |
and touch wood, I've not had any issues since.
link |
That gives you like hints
link |
that maybe there's something out there.
link |
I mean, I don't, again,
link |
I don't have an explanation for this.
link |
The most probable explanation was, you know,
link |
I was a burning man, I was in a very open state.
link |
Let's just leave it at that.
link |
And, you know, placebo is an incredibly powerful thing
link |
and a very not understood thing.
link |
Almost assigning the word placebo to it reduces it down
link |
to a way that it doesn't deserve to be reduced down.
link |
Maybe there's a whole science of what we call placebo.
link |
Maybe there's a, placebo's a door.
link |
Self healing, you know?
link |
And I mean, I don't know what the problem was.
link |
Like I was told it was many years.
link |
I don't want to say I definitely had that
link |
because I don't want people to think that,
link |
oh, that's how, you know, if they do have that,
link |
because it's a terrible disease.
link |
And if they have that,
link |
that this is going to be a guaranteed way for it
link |
to fix it for them.
link |
And I also don't, I don't,
link |
and you're absolutely right to say,
link |
like using even the word placebo is like,
link |
it comes with this like baggage of, of like frame.
link |
And I don't want to reduce it down.
link |
All I can do is describe the experience and what happened.
link |
I cannot put an ontological framework around it.
link |
I can't say why it happened, what the mechanism was,
link |
what the problem even was in the first place.
link |
I just know that something crazy happened
link |
and it was while I was in an open state.
link |
And fortunately for me, it made the problem go away.
link |
But what I took away from it, again,
link |
it was part of this, you know,
link |
this took me on this journey of becoming more humble
link |
about what I think I know.
link |
Because as I said before, I was like,
link |
I was in the like Richard Dawkins train of atheism
link |
in terms of there is no God.
link |
And everything like that is bullshit.
link |
We know everything, we know, you know,
link |
the only way we can get through,
link |
we know how medicine works and its molecules
link |
and chemical interactions and that kind of stuff.
link |
And now it's like, okay, well,
link |
there's clearly more for us to understand.
link |
And that doesn't mean that it's ascientific as well,
link |
because, you know, the beauty of the scientific method
link |
is that it still can apply to this situation.
link |
Like, I don't see why, you know,
link |
I would like to try and test this experimentally.
link |
I haven't really, like, you know,
link |
I don't know how we would go about doing that.
link |
We'd have to find other people with the same condition,
link |
I guess, and like, try and repeat the experiment.
link |
But it doesn't, just because something happens
link |
that's sort of out of the realms
link |
of our current understanding,
link |
it doesn't mean that it's,
link |
the scientific method can't be used for it.
link |
Yeah, I think the scientific method sits on a foundation
link |
of those kinds of experiences,
link |
because the scientific method is a process
link |
to carve away at the mystery all around us.
link |
And experiences like this is just a reminder
link |
that we're mostly shrouded in mystery still.
link |
It's just like a humility.
link |
Like, we haven't really figured this whole thing out.
link |
But at the same time, we have found ways
link |
to act, you know, we're clearly doing something right,
link |
because think of the technological scientific advancements,
link |
the knowledge that we have that would blow people's minds
link |
even from 100 years ago.
link |
Yeah, and we've even allegedly got out to space
link |
and landed on the moon, although I still haven't,
link |
I have not seen evidence of the Earth being round,
link |
but I'm keeping an open mind.
link |
Speaking of which, you studied physics
link |
and astrophysics, just to go to that,
link |
just to jump around through the fascinating life you've had,
link |
when did you, how did that come to be?
link |
Like, when did you fall in love with astronomy
link |
and space and things like this?
link |
As early as I can remember.
link |
I was very lucky that my mom, and my dad,
link |
but particularly my mom, my mom is like the most nature,
link |
she is Mother Earth, is the only way to describe her.
link |
Just, she's like Dr. Doolittle, animals flock to her
link |
and just like sit and look at her adoringly.
link |
Yeah, she just is Mother Earth,
link |
and she has always been fascinated by,
link |
she doesn't have any, she never went to university
link |
or anything like that, she's actually phobic of maths,
link |
if I try and get her to like,
link |
you know, I was trying to teach her poker and she hated it.
link |
But she's so deeply curious,
link |
and that just got instilled in me when, you know,
link |
we would sleep out under the stars,
link |
whenever it was, you know, the two nights a year
link |
when it was warm enough in the UK to do that.
link |
And we would just lie out there until we fell asleep,
link |
looking at, looking for satellites,
link |
looking for shooting stars, and I was just always,
link |
I don't know whether it was from that,
link |
but I've always naturally gravitated to like the biggest,
link |
the biggest questions.
link |
And also the like, the most layers of abstraction I love,
link |
just like, what's the meta question?
link |
What's the meta question and so on.
link |
So I think it just came from that really.
link |
And then on top of that, like physics,
link |
you know, it also made logical sense
link |
in that it was a degree that,
link |
well, a subject that ticks the box of being,
link |
you know, answering these really big picture questions,
link |
but it was also extremely useful.
link |
It like has a very high utility in terms of,
link |
I didn't know necessarily,
link |
I thought I was gonna become like a research scientist.
link |
My original plan was,
link |
I wanna be a professional astronomer.
link |
So it's not just like a philosophy degree
link |
that asks the big questions,
link |
and it's not like biology and the path
link |
to go to medical school or something like that,
link |
which is all overly pragmatic, not overly,
link |
is very pragmatic, but this is, yeah,
link |
physics is a good combination of the two.
link |
Yeah, at least for me, it made sense.
link |
And I was good at it, I liked it.
link |
Yeah, I mean, it wasn't like I did an immense amount
link |
of soul searching to choose it or anything.
link |
It just was like this, it made the most sense.
link |
I mean, you have to make this decision in the UK age 17,
link |
which is crazy, because, you know, in US,
link |
you go the first year, you do a bunch of stuff, right?
link |
And then you choose your major.
link |
Yeah, I think the first few years of college,
link |
you focus on the drugs and only as you get closer
link |
to the end, do you start to think, oh shit,
link |
this wasn't about that.
link |
And I owe the government a lot of money.
link |
How many alien civilizations are out there?
link |
When you looked up at the stars with your mom
link |
and you were counting them, what's your mom think
link |
about the number of alien civilizations?
link |
I actually don't know.
link |
I would imagine she would take the viewpoint of,
link |
you know, she's pretty humble and she knows how many,
link |
she knows there's a huge number of potential spawn sites
link |
out there, so she would.
link |
Spawn sites, yeah.
link |
You know, this is all spawn sites.
link |
Yeah, spawn sites in Polytopia.
link |
We spawned on Earth, you know, it's.
link |
Hmm, yeah, spawn sites.
link |
Why does that feel weird to say spawn?
link |
Because it makes me feel like there's only one source
link |
of life and it's spawning in different locations.
link |
That's why the word spawn.
link |
Because it feels like life that originated on Earth
link |
really originated here.
link |
Right, it is unique to this particular.
link |
Yeah, I mean, but I don't, in my mind, it doesn't exclude,
link |
you know, the completely different forms of life
link |
and different biochemical soups can't also spawn,
link |
but I guess it implies that there's some spark
link |
that is uniform, which I kind of like the idea of.
link |
And then I get to think about respawning,
link |
like after it dies, like what happens if life on Earth ends?
link |
Is it gonna restart again?
link |
Probably not, it depends.
link |
Maybe Earth is too.
link |
It depends on the type of, you know,
link |
what's the thing that kills it off, right?
link |
If it's a paperclip maximizer, not for the example,
link |
but, you know, some kind of very self replicating,
link |
high on the capabilities, very low on the wisdom type thing.
link |
So whether that's, you know, gray goo, green goo,
link |
you know, like nanobots or just a shitty misaligned AI
link |
that thinks it needs to turn everything into paperclips.
link |
You know, if it's something like that,
link |
then it's gonna be very hard for life,
link |
you know, complex life, because by definition,
link |
you know, a paperclip maximizer
link |
is the ultimate instantiation of molecule.
link |
Deeply low complexity, over optimization on a single thing,
link |
sacrificing everything else, turning the whole world into.
link |
Although something tells me,
link |
like if we actually take a paperclip maximizer,
link |
it destroys everything.
link |
It's a really dumb system that just envelops
link |
the whole of Earth.
link |
And the universe beyond, yeah.
link |
Oh, I didn't know that part, but okay, great.
link |
That's the thought experiment.
link |
So it becomes a multi planetary paperclip maximizer?
link |
Well, it just propagates.
link |
I mean, it depends whether it figures out
link |
how to jump the vacuum gap.
link |
But again, I mean, this is all silly
link |
because it's a hypothetical thought experiment,
link |
which I think doesn't actually have
link |
much practical application to the AI safety problem,
link |
but it's just a fun thing to play around with.
link |
But if by definition, it is maximally intelligent,
link |
which means it is maximally good at
link |
navigating the environment around it
link |
in order to achieve its goal,
link |
but extremely bad at choosing goals in the first place.
link |
So again, we're talking on this orthogonality thing, right?
link |
It's very low on wisdom, but very high on capability.
link |
Then it will figure out how to jump the vacuum gap
link |
between planets and stars and so on,
link |
and thus just turn every atom it gets its hands on
link |
Yeah, by the way, for people who don't.
link |
Which is maximum virality, by the way.
link |
That's what virality is.
link |
But does not mean that virality is necessarily
link |
all about maximizing paperclips.
link |
In that case, it is.
link |
So for people who don't know,
link |
this is just a thought experiment example
link |
of an AI system that's very, that has a goal
link |
and is willing to do anything to accomplish that goal,
link |
including destroying all life on Earth
link |
and all human life and all of consciousness in the universe
link |
for the goal of producing a maximum number of paperclips.
link |
Or whatever its optimization function was
link |
that it was set at.
link |
But don't you think?
link |
It could be making, recreating Lexus.
link |
Maybe it'll tile the universe in Lex.
link |
No, I'm just kidding.
link |
That's more interesting than paperclips.
link |
That could be infinitely optimal
link |
if I were to say it to myself.
link |
But if you ask me, it's still a bad thing
link |
because it's permanently capping
link |
what the universe could ever be.
link |
It's like, that's its end state.
link |
Or achieving the optimal
link |
that the universe could ever achieve.
link |
different people have different perspectives.
link |
But don't you think within the paperclip world
link |
that would emerge, just like in the zeros and ones
link |
that make up a computer,
link |
that would emerge beautiful complexities?
link |
Like, it won't suppress, you know,
link |
as you scale to multiple planets and throughout,
link |
there'll emerge these little worlds
link |
that on top of the fabric of maximizing paperclips,
link |
there will be, that would emerge like little societies
link |
Well, then we're not describing
link |
a paperclip maximizer anymore.
link |
Because by the, like, if you think of what a paperclip is,
link |
it is literally just a piece of bent iron, right?
link |
So if it's maximizing that throughout the universe,
link |
it's taking every atom it gets its hand on
link |
into somehow turning it into iron or steel.
link |
And then bending it into that shape
link |
and then done and done.
link |
By definition, like paperclips,
link |
there is no way for, well, okay.
link |
So you're saying that paperclips somehow
link |
will just emerge and create through gravity or something.
link |
Because there's a dynamic element to the whole system.
link |
It's not just, it's creating those paperclips
link |
and the act of creating, there's going to be a process.
link |
And that process will have a dance to it.
link |
Because it's not like sequential thing.
link |
There's a whole complex three dimensional system
link |
of paperclips, you know, like, you know,
link |
people like string theory, right?
link |
It's supposed to be strings that are interacting
link |
in fascinating ways.
link |
I'm sure paperclips are very string like,
link |
they can be interacting in very interesting ways
link |
as you scale exponentially through three dimensional.
link |
I mean, I'm sure the paperclip maximizer
link |
has to come up with a theory of everything.
link |
It has to create like wormholes, right?
link |
It has to break, like,
link |
it has to understand quantum mechanics.
link |
It has to understand general relativity.
link |
I love your optimism.
link |
This is where I'd say this,
link |
we're going into the realm of pathological optimism
link |
I'm sure there'll be a,
link |
I think there's an intelligence
link |
that emerges from that system.
link |
So you're saying that basically intelligence
link |
is inherent in the fabric of reality and will find a way.
link |
Kind of like Goldblum says, life will find a way.
link |
You think life will find a way
link |
even out of this perfectly homogenous dead soup.
link |
It's not perfectly homogenous.
link |
It has to, it's perfectly maximal in the production.
link |
I don't know why people keep thinking it's homogenous.
link |
It maximizes the number of paperclips.
link |
That's the only thing.
link |
It's not trying to be homogenous.
link |
It's trying to maximize paperclips.
link |
So you're saying, you're saying that because it,
link |
because, you know, kind of like in the Big Bang
link |
or, you know, it seems like, you know, things,
link |
there were clusters, there was more stuff here than there.
link |
That was enough of the patternicity
link |
that kickstarted the evolutionary process.
link |
It's the little weirdness that will make it beautiful.
link |
Complexity emerges.
link |
Interesting, okay.
link |
Well, so how does that line up then
link |
with the whole heat death of the universe, right?
link |
Cause that's another sort of instantiation of this.
link |
It's like everything becomes so far apart and so cold
link |
and so perfectly mixed that it's like homogenous grayness.
link |
Do you think that even out of that homogenous grayness
link |
where there's no, you know, negative entropy,
link |
that, you know, there's no free energy that we understand
link |
even from that new stuff?
link |
Yeah, the paperclip maximizer
link |
or any other intelligence systems
link |
will figure out ways to travel to other universes
link |
to create Big Bangs within those universes
link |
or through black holes to create whole other worlds
link |
to break the, what we consider are the limitations
link |
The paperclip maximizer will find a way if a way exists.
link |
And we should be humbled to realize that we don't.
link |
Yeah, but because it just wants to make more paperclips.
link |
So it's gonna go into those universes
link |
and turn them into paperclips.
link |
Yeah, but we humans, not humans,
link |
but complex system exists on top of that.
link |
We're not interfering with it.
link |
This complexity emerges from the simple base state.
link |
Whether it's, yeah, whether it's, you know,
link |
plank lengths or paperclips as the base unit.
link |
Yeah, you can think of like the universe
link |
as a paperclip maximizer because it's doing some dumb stuff.
link |
Like physics seems to be pretty dumb.
link |
It has, like, I don't know if you can summarize it.
link |
Yeah, the laws are fairly basic
link |
and yet out of them amazing complexity emerges.
link |
And its goals seem to be pretty basic and dumb.
link |
If you can summarize its goals,
link |
I mean, I don't know what's a nice way maybe,
link |
maybe laws of thermodynamics could be good.
link |
I don't know if you can assign goals to physics,
link |
but if you formulate in the sense of goals,
link |
it's very similar to paperclip maximizing
link |
in the dumbness of the goals.
link |
But the pockets of complexity as it emerge
link |
is where beauty emerges.
link |
That's where life emerges.
link |
That's where intelligence, that's where humans emerge.
link |
And I think we're being very down
link |
on this whole paperclip maximizer thing.
link |
Now, the reason we hated it.
link |
I think, yeah, because what you're saying
link |
is that you think that the force of emergence itself
link |
is another like unwritten, not unwritten,
link |
but like another baked in law of reality.
link |
And you're trusting that emergence will find a way to,
link |
even out of seemingly the most mollusky,
link |
awful, plain outcome, emergence will still find a way.
link |
I love that as a philosophy.
link |
I think it's very nice.
link |
I would wield it carefully
link |
because there's large error bars on that
link |
and the certainty of that.
link |
How about we build the paperclip maximizer and find out.
link |
Moloch is doing cartwheels, man.
link |
But the thing is it will destroy humans in the process,
link |
which is the reason we really don't like it.
link |
We seem to be really holding on
link |
to this whole human civilization thing.
link |
Would that make you sad if AI systems that are beautiful,
link |
that are conscious, that are interesting
link |
and complex and intelligent,
link |
ultimately lead to the death of humans?
link |
Would that make you sad?
link |
If humans led to the death of humans?
link |
Like if they would supersede humans.
link |
Yeah, AI would end humans.
link |
I mean, that's the reason why I'm like,
link |
in some ways less emotionally concerned about AI risk
link |
than say, bio risk.
link |
Because at least with AI, there's a chance,
link |
you know, if we're in this hypothetical
link |
where it wipes out humans,
link |
but it does it for some like higher purpose,
link |
it needs our atoms and energy to do something.
link |
At least now the universe is going on
link |
to do something interesting,
link |
whereas if it wipes everything, you know,
link |
bio like just kills everything on earth and that's it.
link |
And there's no more, you know,
link |
earth cannot spawn anything more meaningful
link |
in the few hundred million years it has left,
link |
because it doesn't have much time left.
link |
Then, yeah, I don't know.
link |
So one of my favorite books I've ever read is,
link |
Novocene by James Lovelock, who sadly just died.
link |
He wrote it when he was like 99.
link |
He died aged 102, so it's a fairly new book.
link |
And he sort of talks about that,
link |
that he thinks it's, you know,
link |
sort of building off this Gaia theory
link |
where like earth is like living,
link |
some form of intelligence itself,
link |
and that this is the next like step, right?
link |
Is this, whatever this new intelligence
link |
that is maybe silicon based
link |
as opposed to carbon based goes on to do.
link |
And it's a really sort of, in some ways an optimistic,
link |
but really fatalistic book.
link |
And I don't know if I fully subscribed to it,
link |
but it's a beautiful piece to read anyway.
link |
So am I sad by that idea?
link |
And actually, yeah, this is the reason
link |
why I'm sad by the idea,
link |
because if something is truly brilliant
link |
and wise and smart and truly super intelligent,
link |
it should be able to figure out abundance.
link |
So if it figures out abundance,
link |
it shouldn't need to kill us off.
link |
It should be able to find a way for us.
link |
It should be, there's plenty, the universe is huge.
link |
There should be plenty of space for it to go out
link |
and do all the things it wants to do,
link |
and like give us a little pocket
link |
where we can continue doing our things
link |
and we can continue to do things and so on.
link |
And again, if it's so supremely wise,
link |
it shouldn't even be worried
link |
about the game theoretic considerations
link |
that by leaving us alive,
link |
we'll then go and create another like super intelligent agent
link |
that it then has to compete against,
link |
because it should be only wise and smart enough
link |
to not have to concern itself with that.
link |
Unless it deems humans to be kind of assholes.
link |
Like the humans are a source of non
link |
of a lose, lose kind of dynamics.
link |
Well, yes and no, we're not,
link |
Moloch is, that's why I think it's important to separate.
link |
But maybe humans are the source of Moloch.
link |
No, I think, I mean, I think game theory
link |
is the source of Moloch.
link |
And, you know, because Moloch exists
link |
in nonhuman systems as well.
link |
It happens within like agents within a game
link |
in terms of like, you know, it applies to agents,
link |
but like it can apply to, you know,
link |
a species that's on an island of animals,
link |
you know, rats out competing,
link |
the ones that like massively consume all the resources
link |
are the ones that are gonna win out
link |
over the more like chill, socialized ones.
link |
And so, you know, creates this Malthusian trap,
link |
like Moloch exists in little pockets in nature as well.
link |
So it's not a strictly human thing.
link |
I wonder if it's actually a result of consequences
link |
of the invention of predator and prey dynamics.
link |
Maybe it needs to, AI will have to kill off
link |
every organism that's.
link |
Now you're talking about killing off competition.
link |
Not competition, but just like the way,
link |
it's like the weeds or whatever
link |
in a beautiful flower garden.
link |
The parasites, yeah, on the whole system.
link |
Now, of course, it won't do that completely.
link |
It'll put them in a zoo like we do with parasites.
link |
Yeah, and there'll be somebody doing a PhD
link |
on like they'll prod humans with a stick
link |
and see what they do.
link |
But I mean, in terms of letting us run wild
link |
outside of the, you know, a geographically
link |
constrained region that might be,
link |
that it might decide to against that.
link |
No, I think there's obviously the capacity
link |
for beauty and kindness and non Moloch behavior
link |
amidst humans, so I'm pretty sure AI will preserve us.
link |
Let me, I don't know if you answered the aliens question.
link |
You had a good conversation with Toby Orr.
link |
About various sides of the universe.
link |
I think, did he say, now I'm forgetting,
link |
but I think he said it's a good chance we're alone.
link |
So the classic, you know, Fermi paradox question is,
link |
there are so many spawn points and yet, you know,
link |
it didn't take us that long to go from harnessing fire
link |
to sending out radio signals into space.
link |
So surely given the vastness of space we should be,
link |
and you know, even if only a tiny fraction of those
link |
create life and other civilizations too,
link |
we should be, the universe should be very noisy.
link |
There should be evidence of Dyson spheres or whatever,
link |
you know, like at least radio signals and so on,
link |
but seemingly things are very silent out there.
link |
Now, of course, it depends on who you speak to.
link |
Some people say that they're getting signals all the time
link |
and so on and like, I don't wanna make
link |
an epistemic statement on that,
link |
but it seems like there's a lot of silence.
link |
And so that raises this paradox.
link |
And then say, you know, the Drake equation.
link |
So the Drake equation is like basically just a simple thing
link |
of like trying to estimate the number of possible
link |
civilizations within the galaxy
link |
by multiplying the number of stars created per year
link |
by the number of stars that have planets,
link |
planets that are habitable, blah, blah, blah.
link |
So all these like different factors.
link |
And then you plug in numbers into that and you, you know,
link |
depending on like the range of, you know,
link |
your lower bound and your upper bound point estimates
link |
that you put in, you get out a number at the end
link |
for the number of civilizations.
link |
But what Toby and his crew did differently was,
link |
Toby is a researcher at the Future of Humanity Institute.
link |
They, instead of, they realized that it's like basically
link |
a statistical quirk that if you put in point sources,
link |
even if you think you're putting in
link |
conservative point sources,
link |
because on some of these variables,
link |
the uncertainty is so large,
link |
it spans like maybe even like a couple of hundred
link |
orders of magnitude.
link |
By putting in point sources,
link |
it's always going to lead to overestimates.
link |
And so they, like by putting stuff on a log scale,
link |
or actually they did it on like a log log scale
link |
and then like ran the simulation across the whole
link |
bucket of uncertainty,
link |
across all of those orders of magnitude.
link |
then actually the number comes out much, much smaller.
link |
And that's the more statistically rigorous,
link |
you know, mathematically correct way
link |
of doing the calculation.
link |
It's still a lot of hand waving.
link |
As science goes, it's like definitely, you know,
link |
just waving, I don't know what an analogy is,
link |
but it's hand wavy.
link |
And anyway, when they did this,
link |
and then they did a Bayesian update on it as well,
link |
to like factor in the fact that there is no evidence
link |
that we're picking up because, you know,
link |
no evidence is actually a form of evidence, right?
link |
And the long and short of it comes out that the,
link |
we're roughly around 70% to be the only
link |
intelligent civilization in our galaxy thus far,
link |
and around 50, 50 in the entire observable universe,
link |
which sounds so crazily counterintuitive,
link |
but their math is legit.
link |
Well, yeah, the math around this particular equation,
link |
which the equation is ridiculous on many levels,
link |
but the powerful thing about the equation
link |
is there's the different things,
link |
different components that can be estimated,
link |
and the error bars on which can be reduced with science.
link |
And hence throughout, since the equation came out,
link |
the error bars have been coming out on different,
link |
different aspects.
link |
And so that, it almost kind of says,
link |
what, like this gives you a mission to reduce the error bars
link |
on these estimates over a period of time.
link |
And once you do, you can better and better understand,
link |
like in the process of redoing the error bars,
link |
you'll get to understand actually
link |
what is the right way to find out where the aliens are,
link |
how many of them there are, and all those kinds of things.
link |
So I don't think it's good to use that for an estimation.
link |
I think you do have to think from like,
link |
more like from first principles,
link |
just looking at what life is on Earth,
link |
and trying to understand the very physics based,
link |
biology, chemistry, biology based question of what is life,
link |
maybe computation based.
link |
What the fuck is this thing?
link |
And that, like how difficult is it to create this thing?
link |
It's one way to say like how many planets like this
link |
are out there, all that kind of stuff,
link |
but it feels like from our very limited knowledge
link |
perspective, the right way is to think how does,
link |
what is this thing and how does it originate?
link |
From very simple nonlife things,
link |
how does complex lifelike things emerge?
link |
From a rock to a bacteria, protein,
link |
and these like weird systems that encode information
link |
and pass information from self replicate,
link |
and then also select each other and mutate
link |
in interesting ways such that they can adapt
link |
and evolve and build increasingly more complex systems.
link |
Right, well it's a form of information processing, right?
link |
Whereas information transfer, but then also
link |
an energy processing, which then results in,
link |
I guess information processing,
link |
maybe I'm getting bogged down.
link |
It's doing some modification and yeah,
link |
the input is some energy.
link |
Right, it's able to extract, yeah,
link |
extract resources from its environment
link |
in order to achieve a goal.
link |
But the goal doesn't seem to be clear.
link |
Right, well the goal is to make more of itself.
link |
Yeah, but in a way that increases,
link |
I mean I don't know if evolution
link |
is a fundamental law of the universe,
link |
but it seems to want to replicate itself
link |
in a way that maximizes the chance of its survival.
link |
Individual agents within an ecosystem do, yes, yes.
link |
Evolution itself doesn't give a fuck.
link |
It's a very, it don't care.
link |
It's just like, oh, you optimize it.
link |
Well, at least it's certainly, yeah,
link |
it doesn't care about the welfare
link |
of the individual agents within it,
link |
but it does seem to, I don't know.
link |
I think the mistake is that we're anthropomorphizing.
link |
To even try and give evolution a mindset
link |
because it is, there's a really great post
link |
by Eliezer Yudkowsky on Lesrong,
link |
which is an alien God.
link |
And he talks about the mistake we make
link |
when we try and put our mind,
link |
think through things from an evolutionary perspective
link |
as though giving evolution some kind of agency
link |
and what it wants.
link |
Yeah, worth reading, but yeah.
link |
I would like to say that having interacted
link |
with a lot of really smart people
link |
that say that anthropomorphization is a mistake,
link |
I would like to say that saying
link |
that anthropomorphization is a mistake is a mistake.
link |
I think there's a lot of power in anthropomorphization,
link |
if I can only say that word correctly one time.
link |
I think that's actually a really powerful way
link |
to reason to things.
link |
And I think people, especially people in robotics
link |
seem to run away from it as fast as possible.
link |
And I just, I think.
link |
Can you give an example of like how it helps in robotics?
link |
Oh, in that our world is a world of humans
link |
and to see robots as fundamentally just tools
link |
runs away from the fact that we live in a world,
link |
a dynamic world of humans.
link |
That like these, all these game theory systems
link |
we've talked about, that a robot
link |
that ever has to interact with humans.
link |
And I don't mean like intimate friendship interaction.
link |
I mean, in a factory setting where it has to deal
link |
with the uncertainty of humans, all that kind of stuff.
link |
You have to acknowledge that the robot's behavior
link |
has an effect on the human, just as much as the human
link |
has an effect on the robot.
link |
And there's a dance there.
link |
And you have to realize that this entity,
link |
when a human sees a robot, this is obvious
link |
in a physical manifestation of a robot,
link |
they feel a certain way.
link |
They have a fear, they have uncertainty.
link |
They have their own personal life projections.
link |
We have to have pets and dogs
link |
and the thing looks like a dog.
link |
They have their own memories of what a dog is like.
link |
They have certain feelings and that's gonna be useful
link |
in a safety setting, safety critical setting,
link |
which is one of the most trivial settings for a robot
link |
in terms of how to avoid any kind of dangerous situations.
link |
And a robot should really consider that
link |
in navigating its environment.
link |
And we humans are right to reason about how a robot
link |
should consider navigating its environment
link |
through anthropomorphization.
link |
I also think our brains are designed to think
link |
in human terms, like game theory,
link |
I think is best applied in the space of human decisions.
link |
Right, you're dealing, I mean, with things like AI,
link |
AI is, they are, we can somewhat,
link |
like, I don't think it's,
link |
the reason I say anthropomorphization
link |
we need to be careful with is because there is a danger
link |
of overly applying, overly wrongly assuming
link |
that this artificial intelligence is going to operate
link |
in any similar way to us,
link |
because it is operating
link |
on a fundamentally different substrate.
link |
Like even dogs or even mice or whatever, in some ways,
link |
like anthropomorphizing them is less of a mistake, I think,
link |
than an AI, even though it's an AI we built and so on,
link |
because at least we know
link |
that they're running from the same substrate.
link |
And they've also evolved from the same,
link |
out of the same evolutionary process.
link |
They've followed this evolution
link |
of like needing to compete for resources
link |
and needing to find a mate and that kind of stuff.
link |
Whereas an AI that has just popped into existence
link |
somewhere on like a cloud server,
link |
let's say, you know, or whatever, however it runs
link |
and whatever, whether it,
link |
I don't know whether they have an internal experience.
link |
I don't think they necessarily do.
link |
In fact, I don't think they do.
link |
But the point is, is that to try and apply
link |
any kind of modeling of like thinking through problems
link |
and decisions in the same way that we do
link |
has to be done extremely carefully because they are,
link |
like, they're so alien,
link |
their method of whatever their form of thinking is,
link |
it's just so different because they've never had to evolve,
link |
you know, in the same way.
link |
Yeah, beautifully put.
link |
I was just playing devil's advocate.
link |
I do think in certain contexts,
link |
anthropomorphization is not gonna hurt you.
link |
Engineers run away from it too fast.
link |
But from the most point, you're right.
link |
Do you have advice for young people today,
link |
like the 17 year old that you were,
link |
of how to live life?
link |
You can be proud of how to have a career
link |
you can be proud of in this world full of mullocks.
link |
Think about the win wins.
link |
Look for win win situations.
link |
And be careful not to, you know, overly use your smarts
link |
to convince yourself that something is win win
link |
So that's difficult.
link |
And I don't know how to advise, you know, people on that
link |
because it's something I'm still figuring out myself.
link |
But have that as a sort of default MO.
link |
Don't see things, everything as a zero sum game.
link |
Try to find the positive sumness and like find ways
link |
if there doesn't seem to be one,
link |
consider playing a different game.
link |
So that I would suggest that.
link |
Do not become a professional poker player.
link |
I, cause people always ask that like, oh, she's a pro.
link |
I wanna do that too.
link |
Fine, you could have done it if you were, you know,
link |
when I started out,
link |
it was a very different situation back then.
link |
Poker is, you know, a great game to learn
link |
in order to understand the ways to think.
link |
And I recommend people learn it,
link |
but don't try and make a living from it these days.
link |
It's almost, it's very, very difficult
link |
to the point of being impossible.
link |
And then really, really be aware of how much time
link |
you spend on your phone and on social media
link |
and really try and keep it to a minimum.
link |
Be aware that basically every moment that you spend on it
link |
So it doesn't mean to say you can never do it,
link |
but just have that running in the background.
link |
I'm doing a bad thing for myself right now.
link |
I think that's the general rule of thumb.
link |
Of course, about becoming a professional poker player,
link |
if there is a thing in your life that's like that
link |
and nobody can convince you otherwise, just fucking do it.
link |
Don't listen to anyone's advice.
link |
Find a thing that you can't be talked out of too.
link |
I like that, yeah.
link |
You were a lead guitarist in a metal band?
link |
Did I write that down from something?
link |
What did you, what'd you do it for?
link |
The performing, was it the pure, the music of it?
link |
Was it just being a rock star?
link |
So we only ever played two gigs.
link |
We didn't last, you know, it wasn't a very,
link |
we weren't famous or anything like that.
link |
But I was very into metal.
link |
Like it was my entire identity,
link |
sort of from the age of 16 to 23.
link |
What's the best metal band of all time?
link |
Don't ask me that, it's so hard to answer.
link |
So I know I had a long argument with,
link |
I'm a guitarist, more like a classic rock guitarist.
link |
So, you know, I've had friends who are very big
link |
Pantera fans and so there was often arguments
link |
about what's the better metal band,
link |
Metallica versus Pantera.
link |
This is a more kind of 90s maybe discussion.
link |
But I was always on the side of Metallica,
link |
both musically and in terms of performance
link |
and the depth of lyrics and so on.
link |
So, but they were, basically everybody was against me.
link |
Because if you're a true metal fan,
link |
I guess the idea goes is you can't possibly
link |
be a Metallica fan.
link |
Because Metallica is pop, it's just like, they sold out.
link |
Metallica are metal.
link |
Like they were the, I mean, again, you can't say
link |
who was the godfather of metal, blah, blah, blah.
link |
But like they were so groundbreaking and so brilliant.
link |
I mean, you've named literally two of my favorite bands.
link |
Like when you asked that question, who are my favorites?
link |
Like those were two that came up.
link |
A third one is Children of Bodom,
link |
who I just think, oh, they just tick all the boxes for me.
link |
Yeah, I don't know.
link |
It's nowadays, like I kind of sort of feel
link |
like a repulsion to the, I was that myself.
link |
Like I'd be like, who do you prefer more?
link |
Come on, who's like, no, you have to rank them.
link |
But it's like this false zero sumness that's like, why?
link |
They're so additive.
link |
Like there's no conflict there.
link |
Although when people ask that kind of question
link |
about anything, movies, I feel like it's hard work.
link |
And it's unfair, but it's, you should pick one.
link |
Like, and that's actually the same kind of,
link |
it's like a fear of a commitment.
link |
When people ask me, what's your favorite band?
link |
It's like, but I, it's good to pick.
link |
And thank you for the tough question, yeah.
link |
Well, maybe not in the context
link |
when a lot of people are listening.
link |
Yeah, I'm not just like, what, why does it matter?
link |
Are you still into metal?
link |
Funny enough, I was listening to a bunch
link |
before I came over here.
link |
Oh, like, do you use it for like motivation
link |
or it gets you in a certain?
link |
Yeah, I was weirdly listening
link |
to 80s hair metal before I came.
link |
Does that count as metal?
link |
I think so, it's like proto metal and it's happy.
link |
It's optimistic, happy proto metal.
link |
Yeah, I mean, all these genres bleed into each other.
link |
But yeah, sorry, to answer your question
link |
about guitar playing, my relationship with it
link |
was kind of weird in that I was deeply uncreative.
link |
My objective would be to hear some really hard
link |
technical solo and then learn it, memorize it
link |
and then play it perfectly.
link |
But I was incapable of trying to write my own music.
link |
Like the idea was just absolutely terrifying.
link |
But I was also just thinking, I was like,
link |
it'd be kind of cool to actually try starting a band again
link |
and getting back into it and write.
link |
I mean, I put out some guitar playing
link |
just other people's covers.
link |
I play Comfortly Numb on the internet.
link |
And it's scary too.
link |
It's scary putting stuff out there.
link |
And I had this similar kind of fascination
link |
with technical playing, both on piano and guitar.
link |
You know, one of the first,
link |
one of the reasons that I started learning guitar
link |
is from Ozzy Osbourne, Mr. Crowley's solo.
link |
And one of the first solos I learned is that,
link |
there's a beauty to it.
link |
There's a lot of beauty to it.
link |
It's tapping, right?
link |
Yeah, there's some tapping, but it's just really fast.
link |
Beautiful, like arpeggios.
link |
Yeah, arpeggios, yeah.
link |
But there's a melody that you can hear through it,
link |
but there's also build up.
link |
It's a beautiful solo,
link |
but it's also technically just visually the way it looks
link |
when a person's watching, you feel like a rockstar playing.
link |
But it ultimately has to do with technical.
link |
You're not developing the part of your brain
link |
that I think requires you to generate beautiful music.
link |
It is ultimately technical in nature.
link |
And so that took me a long time to let go of that
link |
and just be able to write music myself.
link |
And that's a different journey, I think.
link |
I think that journey is a little bit more inspired
link |
in the blues world, for example,
link |
where improvisation is more valued,
link |
obviously in jazz and so on.
link |
But I think ultimately it's a more rewarding journey
link |
because you get your relationship with the guitar
link |
then becomes a kind of escape from the world
link |
where you can create, I mean, creating stuff is.
link |
And it's something you work with,
link |
because my relationship with my guitar was like,
link |
it was something to tame and defeat.
link |
Yeah, it's a challenge.
link |
Which was kind of what my whole personality was back then.
link |
I was just very like, as I said, very competitive,
link |
very just like must bend this thing to my will.
link |
Whereas writing music, it's like a dance, you work with it.
link |
But I think because of the competitive aspect,
link |
for me at least, that's still there,
link |
which creates anxiety about playing publicly
link |
or all that kind of stuff.
link |
I think there's just like a harsh self criticism
link |
within the whole thing.
link |
It's really tough.
link |
I wanna hear some of your stuff.
link |
I mean, there's certain things that feel really personal.
link |
And on top of that, as we talked about poker offline,
link |
there's certain things that you get to a certain height
link |
in your life, and that doesn't have to be very high,
link |
but you get to a certain height
link |
and then you put it aside for a bit.
link |
And it's hard to return to it
link |
because you remember being good.
link |
And it's hard to, like you being at a very high level
link |
in poker, it might be hard for you to return to poker
link |
every once in a while and enjoy it,
link |
knowing that you're just not as sharp as you used to be
link |
because you're not doing it every single day.
link |
That's something I always wonder with,
link |
I mean, even just like in chess with Kasparov,
link |
some of these greats, just returning to it,
link |
it's almost painful.
link |
And I feel that way with guitar too,
link |
because I used to play every day a lot.
link |
So returning to it is painful
link |
because it's like accepting the fact
link |
that this whole ride is finite
link |
and that you have a prime,
link |
there's a time when you were really good
link |
and now it's over and now.
link |
We're on a different chapter of life.
link |
I was like, oh, but I miss that.
link |
But you can still discover joy within that process.
link |
It's been tough, especially with some level of like,
link |
as people get to know you, and people film stuff,
link |
you don't have the privacy of just sharing something
link |
with a few people around you.
link |
That's a beautiful privacy.
link |
That's a good point.
link |
With the internet, it's just disappearing.
link |
Yeah, that's a really good point.
link |
But all those pressures aside,
link |
if you really, you can step up
link |
and still enjoy the fuck out of a good musical performance.
link |
What do you think is the meaning of this whole thing?
link |
What's the meaning of life?
link |
It's in your name, as we talked about.
link |
You have to live up.
link |
Do you feel the requirement
link |
to have to live up to your name?
link |
No, because I don't see it.
link |
I mean, my, oh, again, it's kind of like,
link |
Because my full name is Olivia.
link |
So I can retreat in that and be like,
link |
oh, Olivia, what does that even mean?
link |
No, I can't say I do,
link |
because I've never thought of it that way.
link |
And then your name backwards is evil.
link |
That's what we also talked about.
link |
I mean, I feel the urge to live up to that,
link |
to be the inverse of evil or even better.
link |
Because I don't think, you know,
link |
is the inverse of evil good
link |
or is good something completely separate to that?
link |
I think my intuition says it's the latter,
link |
Anyway, again, getting in the weeds.
link |
What is the meaning of all this?
link |
explore, have fun and understand
link |
and make more of here and to keep the game going.
link |
More of this, whatever this is.
link |
More of experience.
link |
Just to have more of experience
link |
and ideally positive experience.
link |
And more complex, you know,
link |
I guess, try and put it into a sort of
link |
vaguely scientific term.
link |
But make it so that the program required,
link |
the length of code required to describe the universe
link |
is as long as possible.
link |
And, you know, highly complex and therefore interesting.
link |
Because again, like,
link |
I know, you know, we bang the metaphor to death,
link |
but like, tiled with X, you know,
link |
tiled with paperclips,
link |
doesn't require that much of a code to describe.
link |
Obviously, maybe something emerges from it,
link |
but that steady state, assuming a steady state,
link |
it's not very interesting.
link |
Whereas it seems like our universe is over time
link |
becoming more and more complex and interesting.
link |
There's so much richness and beauty and diversity
link |
And I want that to continue and get more.
link |
I want more diversity.
link |
And the very best sense of that word
link |
is to me the goal of all this.
link |
And somehow have fun in the process.
link |
Because we do create a lot of fun things along,
link |
instead of in this creative force
link |
and all the beautiful things we create,
link |
somehow there's like a funness to it.
link |
And perhaps that has to do with the finiteness of life,
link |
the finiteness of all these experiences,
link |
which is what makes them kind of unique.
link |
Like the fact that they end,
link |
there's this, whatever it is,
link |
falling in love or creating a piece of art
link |
or creating a bridge or creating a rocket
link |
or creating a, I don't know,
link |
just the businesses that build something
link |
or solve something.
link |
The fact that it is born and it dies
link |
somehow embeds it with fun, with joy
link |
for the people involved.
link |
I don't know what that is.
link |
The finiteness of it.
link |
Some people struggle with the,
link |
I mean, a big thing I think that one has to learn
link |
is being okay with things coming to an end.
link |
And in terms of like projects and so on,
link |
people cling onto things beyond
link |
what they're meant to be doing,
link |
beyond what is reasonable.
link |
And I'm gonna have to come to terms
link |
with this podcast coming to an end.
link |
I really enjoyed talking to you.
link |
I think it's obvious as we've talked about many times,
link |
you should be doing a podcast.
link |
You should, you're already doing a lot of stuff publicly
link |
to the world, which is awesome.
link |
And you're a great educator.
link |
You're a great mind.
link |
You're a great intellect.
link |
But it's also this whole medium of just talking
link |
It really is good.
link |
And it's just, it's nothing but like,
link |
oh, it's just so much fun.
link |
And you can just get into so many,
link |
yeah, there's this space to just explore
link |
and see what comes and emerges.
link |
Yeah, to understand yourself better.
link |
And if you're talking to others,
link |
to understand them better and together with them.
link |
I mean, you should do your own podcast,
link |
but you should also do a podcast with C
link |
as we've talked about.
link |
The two of you have such different minds
link |
that like melt together in just hilarious ways,
link |
fascinating ways, just the tension of ideas there
link |
is really powerful.
link |
But in general, I think you got a beautiful voice.
link |
So thank you so much for talking today.
link |
Thank you for being a friend.
link |
Thank you for honoring me with this conversation
link |
and with your valuable time.
link |
Thanks for listening to this conversation with Liv Marie.
link |
To support this podcast,
link |
please check out our sponsors in the description.
link |
And now let me leave you with some words
link |
from Richard Feynman.
link |
I think it's much more interesting to live not knowing
link |
than to have answers, which might be wrong.
link |
I have approximate answers and possible beliefs
link |
and different degrees of uncertainty about different things,
link |
but I'm not absolutely sure of anything.
link |
And there are many things I don't know anything about,
link |
such as whether it means anything to ask why we're here.
link |
I don't have to know the answer.
link |
I don't feel frightened not knowing things
link |
by being lost in a mysterious universe without any purpose,
link |
which is the way it really is as far as I can tell.
link |
Thank you for listening and hope to see you next time.