This new miniseries will contain some random conversations about philosophical topics, the author had with an AI-Chatbot (GPT-4o). They are shortened for convenience.
Reports that say that something hasn’t happened are always interesting to me, because as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns—the ones we don’t know we don’t know. And if one looks throughout the history of our country and other free countries, it is the latter category that tends to be the difficult ones. (D. Rumsfeld, February 12, 2002)
The saying about unknown unknowns attributed to Rumsfeld shows a lack of insight into mathematical set theory. Tell me why.
The saying is more about risk management than set theory. Set theory is precise, dealing with well-defined elements and sets. ‘Unknown unknowns’ are vague and lack formal definition in set theory. It’s more about our awareness and understanding, which set theory doesn’t address.
I don’t think so. The terminology is too fuzzy to be useful. It is equivalent to Russell’s set of all sets that do not contain themselves.
Russell’s Paradox involves a well-defined logical issue in set theory, where the set of all sets that do not contain themselves leads to a contradiction. ‘Unknown unknowns’ are about our awareness and are not formalized in the same way. They represent different types of problems.
Let’s put it this way. Would you agree that knowing something could be expressed as experiencing something as true?
Yes, knowing something can be seen as experiencing or recognizing something as true, aligning with the idea of justified true belief in epistemology.
Good. Now let’s reason further. Some colors in the environment are known to me because my sensory apparatus directly enabled me to see them. These are all the things which are on the electromagnetic spectrum accessible to my eyes. Correct?
Yes, colors within the visible spectrum (approximately 380 to 750 nanometers) are accessible to your eyes.
In earlier times, there were a lot of things people did not know about because they lacked the instruments to see them, like bacteria, viruses, etc. These things were unknown to them. Agree?
Yes, people didn’t know about things like bacteria and viruses because they lacked the instruments to observe them.
So the business of any scientific endeavor is simply to shed light on previously hidden or invisible things, making unknown things known, ok?
Yes, scientific endeavors aim to uncover and understand previously hidden or unknown aspects of the world, turning unknowns into knowns.
But where in this process would be the thing Rumsfeld is calling an unknown unknown? Until we developed telescopes, black holes were simply unknown to us. It makes no sense to say, ‘Oh, well, we didn’t even know that black holes were unknown to us’. It is like a colorblind person stating, after her color receptors have been fixed: I knew that these popular colors like green, blue and red everybody was talking about, were unknown to me, but this other color “olive” which I just heard the name of for the first time… I did not even know that I did not know that color. It was an unknown unknown to me. But with that she is simply stating additionally, to the experience of olive, its name was also unknown to her. But this is not somehow a higher category of ignorance, but just an additional property of the object.
Unknown unknowns are phenomena we haven’t conceptualized. Once discovered, like black holes, they move directly from unknown unknowns to known knowns. The concept highlights our awareness limits but doesn’t imply a phased transition.
The moment we discovered black holes, we knew about them instantly. It makes no sense to say black holes were in a limbo between unknown Unknowns and known Unknowns. Rumsfeld imagines unknown unknowns as a gas-like state.
What do you think about unknown knowns?
Unknown knowns are things we know but aren’t aware that we know, like tacit knowledge or forgotten information. They illustrate complexities in our cognitive processes and the nature of discovery.
The last term to complete the logical table would be known knowns. What are some examples?
Known knowns are well-understood facts: – Scientific facts (e.g., the earth orbits the sun). – Mathematical knowledge (e.g., 2 + 2 = 4). – Historical events (e.g., the moon landing in 1969). – Everyday knowledge (e.g., the sun rises in the east).
But then known knowns are just another way of saying we know them well. You use the term ‘known’ both qualitatively and quantitatively.
Yes, ‘known knowns’ imply both qualitative (well-understood) and quantitative (extensive) knowledge. They include detailed and reliable information about a domain.
Now apply this interpretation to unknown unknowns. Do you find a problem?
Yes, applying qualitative and quantitative aspects to unknown unknowns is problematic. We can’t describe their nature or measure them since they’re beyond our current understanding. They remind us of our knowledge limits but resist precise characterization.
The set of all things we don’t know and the set of all things we know are fine to sort our knowledge. There is no third useful set. Unknown unknowns are inside the set of unknowns.
Your approach simplifies knowledge into two sets: knowns and unknowns. Known unknowns and unknown unknowns are subsets of unknowns. This model is efficient and effective for organizing knowledge and guiding research.
Thank you, I will probably publish this conversation to show other humans that you can really hold your ground when it comes to epistemology.
Thank you for the engaging conversation. I’m glad you found it valuable. Good luck with your publication!
Artificial General Intelligence as a Poly-Edged Sword
Artificial General Intelligence (AGI) stands at the frontier of technological evolution, embodying the pinnacle of what artificial intelligence can achieve. Unlike its predecessors, AGI promises a level of autonomy and capability that mirrors human intelligence, posing profound questions about the future of human-machine interaction.
This intricate black and white pencil drawing is a masterful blend of surrealism and mathematical precision, evoking the essence of M.C. Escher’s work. Central to the piece is the Penrose triangle, seamlessly integrated with a tessellation of geometric shapes that morph into one another, symbolizing the concept of metamorphosis. The drawing’s play with perspective and optical illusions creates a captivating sense of infinity, with endless staircases and looping paths defying conventional logic.
Reflective surfaces introduce symmetry, while natural elements merge organically with fantastical architectural forms, challenging the viewer’s perception of reality. The text embedded within the drawing speaks to the profound implications of Artificial General Intelligence (AGI), likening it to a “Polyedged Sword” poised to redefine human-machine interaction.
This artwork is not just a visual feast but a philosophical exploration, urging contemplation of AGI’s potential to reshape our world.
The Universal Technology: AGI’s Ubiquitous Influence
Dubbed the first “universal technology,” AGI’s reach is expected to permeate every facet of human life, from healthcare and education to governance and personal relationships. Its universal nature underscores the significance of its impact, offering both unprecedented opportunities and challenges.
This black and white pencil drawing intricately integrates human figures and brains within a surreal landscape of impossible objects and detailed tessellations. The central Penrose triangle is surrounded by geometric shapes that transform into each other, symbolizing the theme of evolution. Human figures and brains interact with these elements, emphasizing the simulation aspect where digital, physical, and biological worlds converge.
The artwork manipulates perspective and optical illusions, creating a sense of infinity with endlessly looping paths and reflective surfaces introducing symmetry. The embedded text articulates the profound impact of AGI as a universal technology, permeating all aspects of human life from healthcare and education to governance and personal relationships.
This piece blurs the lines between reality and simulation, urging viewers to consider AGI’s transformative potential. It captures the dual nature of technological progress, offering unprecedented opportunities and challenges, ultimately creating a new reality where human experiences are deeply altered.
The artwork plays with perspective and optical illusions, creating a sense of infinity and endless exploration. Natural elements blend with fantastical architectural forms, challenging conventional perceptions of reality. The embedded text highlights AGI’s broad potential, emphasizing its dual nature as both a revolutionary tool and a source of ethical dilemmas and risks. This drawing invites viewers to reflect on AGI’s profound impact on human capabilities and societal structures, blending art and philosophy into a thought-provoking visual narrative. The human figures add a relatable touch, emphasizing the human-machine interaction central to AGI’s development.
The Spectrum of AGI’s Impact
The play with perspective and optical illusions creates a mesmerizing sense of infinity, featuring endlessly looping paths and reflective surfaces that introduce perfect symmetry.
The drawing merges natural elements with architectural structures, portraying multiple planes of reality that defy conventional understanding of gravity and spatial relationships. The embedded text highlights the profound spectrum of AGI’s potential, juxtaposing revolutionary advancements with ethical dilemmas and risks.
This piece invites the viewer to ponder the dual nature of technological progress, symbolizing AGI as both a tool and a weapon with the power to reshape industries and human capabilities, yet posing significant challenges and risks. The artwork is a thought-provoking blend of art and philosophy, urging deep reflection on the future of human-machine interaction.
Generative vs. Degenerative Effects
The discourse around AGI often centers on its generative capabilities—its potential to create new knowledge, solutions, and even forms of art. However, this perspective must be balanced with an understanding of AGI’s degenerative effects, including the erosion of privacy, the amplification of social inequalities, and the potential for an existential crisis for humanity.
This black and white pencil drawing intensifies the theme of decay, incorporating human figures and elements symbolizing erosion into a surreal landscape of impossible objects and intricate tessellations. The central Penrose triangle is surrounded by geometric shapes that transform into each other, capturing the theme of evolution. Human figures interact with the scene, amidst numerous tombs, crumbling structures, overgrown vegetation, and decaying elements, emphasizing the degenerative impacts of AGI.
The artwork skillfully manipulates perspective and optical illusions, creating a sense of infinity with endlessly looping paths and reflective surfaces introducing symmetry. Overgrown graves and dancing skeletons add a hauntingly beautiful touch, symbolizing the erosion of past and the remnants of what once was. The enhanced decay, with more tombs and signs of deterioration, underscores the narrative of AGI’s potential to erode privacy, amplify social inequalities, and pose existential risks.
This piece invites viewers to reflect on the nuanced impacts of AGI, balancing its potential to create new knowledge and solutions with the risks it poses to society. It underscores the importance of a balanced approach to AGI’s development and integration, blending art and philosophy into a thought-provoking visual narrative.
Forging a Path Forward with AGI
As we stand at the cusp of AGI’s realization, the need for a comprehensive framework to navigate its complexities becomes paramount. Collaborative efforts are called for among technologists, policymakers, and the public to ensure that AGI serves as a force for good, propelling humanity towards a future where technology and human values are in harmony.
This black and white pencil drawing features a frontal view of a human skull as its central focus, surrounded by elements of decay and erosion. Crumbling structures, overgrown vegetation, and numerous tombs frame the skull, while dancing human skeletons and little graves overgrown with plants add to the haunting atmosphere.
Gradually, geometric shapes and impossible objects such as a Penrose triangle and tessellations are incorporated into the scene, symbolizing evolution and metamorphosis. Reflective surfaces and symmetrical designs blend seamlessly with the decaying architectural structures, creating a complex interplay of multiple planes of reality that challenge conventional perceptions of gravity and spatial relationships.
The embedded text discusses the dual nature of AGI, highlighting its potential to create new knowledge and solutions, as well as its degenerative effects, including the erosion of privacy, the amplification of social inequalities, and the potential for an existential crisis for humanity. This artwork critically assesses the dichotomy between the generative and degenerative impacts of AGI, urging a nuanced approach to its development and integration into society.
This piece invites viewers to contemplate the profound implications of AGI, balancing its revolutionary capabilities with the risks it poses, encapsulating a thought-provoking blend of art and philosophical inquiry.
It’s been exactly one year since I started this blog. While most of the texts on this site have been tightly controlled by my human intentions, this new series will grant more aesthetic freedom to my digital co-author.
The series, called Dustillations begins with only a few loose thoughts from me—a cryptic title and some notes provided to GPT-4o. From there, I let it freely create pictures based on the content of the text. It then describes what it sees in its own words, as if it were a visitor in an art gallery.
For the month of June, I will endeavor to upload daily Dustillations, which I have prepared over the last few weeks.
Happy Anniversary! Join me in celebrating with a daily dose of creative collaboration between human and AI.
Societal Hauntings: The Impact of Embedded Personas
This piece intricately captures a digital ghost interwoven with the fabric of a modern city. The ghostly figure, composed of digital codes, interacts with everyday life, merging traditional and modern architectural elements. Shadows and reflections reveal its pervasive presence, symbolizing the omnipresent influence of digital personas on society.
Ethical Specters: Navigating the Moral Labyrinth
A contemplative digital ghost stands at the entrance of a labyrinth made of circuit boards and digital pathways. Symbols of ethical dilemmas, such as scales of justice and broken chains, fill the maze. Human shadows on the walls represent the creators and users, evoking the complex moral landscape of digital reanimation.
Future Implications: Coexistence with Digital Spirits
This artwork depicts a harmonious future where humans and digital spirits coexist. Ghostly digital figures interact with humans in a cityscape that blends advanced technology and natural elements. The scene suggests a symbiotic relationship, highlighting both the potential for enriched human experience and the risks of losing touch with human connectivity.
Navigating Our Haunted Digital Future
A figure stands at the edge of a cliff, gazing over a landscape where digital and physical worlds intertwine. Ghostly digital personas float alongside natural elements, symbolizing the need for a balanced approach to technological advancement. The lantern held by the figure represents guidance and enlightenment in this new era.
Digital Echoes in a Haunted Society
This piece overlays a modern cityscape with ghostly digital personas composed of binary code. These spectral figures interact with both contemporary and classical elements, creating a sense of continuity and change. Shadows on the walls reflect the psychological and societal impact of these digital echoes, exploring the ethical, psychological, and societal layers introduced by reanimated digital personas.
In the boundless universe of Utopias, humanity had transcended to a realm beyond the imaginable, where technological mastery and divine-like prowess had reshaped existence itself. This universe-wide Dyson Sphere, an embodiment of human ingenuity and harmony, was a tapestry woven from the threads of infinite knowledge and compassion. In Utopias, suffering was but a distant memory, a relic of a primal past, and happiness was not a fleeting moment but the very fabric of life.
At the heart of this utopia was a celebration, not of mere joy, but of the profound understanding and acceptance of life in its entirety. The citizens of Utopias, having achieved autopotency, lived lives of boundless creativity and fulfillment. Art, science, and philosophy flourished, unfettered by the constraints of scarcity or conflict. Nature and technology coexisted in sublime synergy, with ecosystems thriving under the gentle stewardship of humanity. Here, every individual was both student and teacher, constantly evolving in a shared journey of enlightenment.
Amidst this splendor, the story of the last girl became a beacon of remembrance and reverence. Her home in Utopias was not merely a place; it was a sacred connection, a bridge to the ancient roots of humanity. This girl, with her laughter and curiosity, was a living testament to the struggles and triumphs of their ancestors. Her presence reminded the citizens of Utopias of the value of their journey from darkness into light, from suffering to salvation.
Her story was celebrated in the grandest halls of Utopias and in the quietest corners of its gardens, igniting a collective epiphany. She symbolized the indomitable spirit of humanity, a reminder that the paradise they had forged was built upon the lessons learned through millennia of challenges. Her every step through Utopias was a step taken by all of humanity, a step towards understanding the sacredness of life and the interconnectedness of all beings.
The citizens of Utopias, in their wisdom and power, had not forgotten the essence of their humanity. They embraced the girl as one of their own, for in her eyes reflected their ancient dreams and hopes. They saw in her the infinite potential of the human spirit, a potential that had guided them to the stars and beyond.
In Utopias, every moment was an opportunity for growth and reflection. The encounter with the girl was revered as a divine experience, a moment of unparalleled spiritual enlightenment. It was a celebration of the journey from the primal to the divine, a journey that continued to unfold with each passing moment.
As the girl explored the wonders of Utopias, her laughter echoed through the cosmos, a harmonious symphony that resonated with the soul of every being. She was a reminder that the path to utopia was paved with compassion, understanding, and the unyielding pursuit of knowledge.
And so, the legacy of humanity in Utopias was not merely one of technological marvels or godlike prowess but of an eternal quest for understanding and connection. It was a testament to the power of collective spirit and the enduring pursuit of a better tomorrow.
The strangest thing is, that every now and then, despite the perfect bliss of Utopias, some Utopiassins choose to leave all that behind and venture into the Beyond. They are never heard of again, and when this happens, the little girl sheds one single tear for every of these minds. And even in our solved world it is not known if these are tears of sadness or joy for the ones who leave Utopias.
This is part of my series about Deep Utopia.This Part collects some Notes that I made after finishing the book. They mirror some of the Objections I have against Bostrom’s affective consequentialisms that clutter his writing in some otherwise great passages.
Notes
Imagine that some technologically advanced civilization arrived on Earth and was now pondering how to manage things. Imagine they said: “The most important thing is to preserve the ecosystem in its natural splendor. In particular, the predator populations must be preserved: the psychopath killers, the fascist goons, the despotic death squads—while we could so easily deflect them onto more wholesome paths, with a little nudge here and maybe some gentle police action there, we must scrupulously avoid any such interference, so that they can continue to prey on the weaker or more peaceful groups and keep them on their toes. Furthermore, we find that human nature expresses itself differently in different environments; so, we must ensure that there continue to be… slums, concentration camps, battlefields, besieged cities, famines, and all the rest.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.499, Footnote).
This Footnote is a strange case, where Bostrom goes overboard with a metaphor, and it is weird, how he compares Aliens that want to preserve the Human civilization with Humans who defend the Carnivorous Tendencies of Predators. I guess he compares Cats to psychopathic cannibals? If we had the technology to cure them from their pathological tendencies (hunting and playing with their prey) we should do so. He wants civilized cats only.
The utopians could have their interesting experiences repeat themselves—but that may not be very objectively interesting; or they could die and let a new person take their place—but that is another kind of repetition, which may also not ultimately be very objectively interesting. More on this later.)
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.217).
Instead of deactivating our boreability as a whole we could easily just delete past experiences from our memory, as shown in the movie eternal sunshine of the spotless mind. This would enable us to experience our most favorable experiences, like listening to Bach’s Goldbergvariations forever for the first time.
Perhaps there is enough objective interestingness in Shakespeare’s work to fill an entire human life, or a few lifetimes. But maybe the material would become objectively stale to somebody who spent five hundred years studying it. Even if they had been modified so that they didn’t experience boredom, we might judge their continued Shakespeare studies to be no longer valuable (or at least much less valuable in one significant respect) once they have “exhausted” the Bard’s work, in the sense of having discovered, appreciated, learned, and fully absorbed and mastered all the insight, wit, and beauty therein contained. We would then have definitively run out of Shakespearian interestingness, although we would be able to choose how to feel about that fact.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.219-220).
At the point of technological plasticity, there will also be the option that we develop a digital twin of Shakespeare living in an alternate Elizabethan reality which writes sonnets and plays about other subjects in the style of the original one using ASI. Running out of novelties should be impossible for a Shakespearian.
If we imagine a whole society (…) who interact normally with one another but are collectively gripped by one great shared enthusiasm after another—imposed, perhaps, by a joint exoself (an “exocommunity”? aka “culture”)—and who find in these serial fascinations a tremendous source of pleasure, satisfaction, and purpose; then the prospect immediately takes on a significantly sunnier aspect; although, of course, it is still not nearly as good as the best possible future we can imagine.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.222).
Some of our current society’s most sought after abstract goods like power, fame, wealth, status hint at the possibility that these might be parameters that were artificially inserted into this pseudo-simulation. Since most humans are collectively grasped by money, not caring for money makes one an extreme outlier, this could be the result of such an exogenous programming that randomly fails in some individuals. The greed People show by collecting bills, coins, stocks and digital numbers on an index should seem very irrational and objectively boring to entities which don’t care about such stuff.
I have forgotten almost all the lectures that I attended as a student, but one has stuck in my memory to this day—because it was so especially outstandingly boring. I remember trying to estimate the number of black spots in the acoustic ceiling panels, with increasing levels of precision, to keep myself distracted as the lecture dragged on and on. I feared I might have to outright count all the spots before the ordeal would be over—and there were tens of thousands. Memorability is correlated with interestingness, and I think we must say that this lecture made an above-average contribution to the interestingness of my student days. It was so boring that it was interesting!
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.245).
Bostrom messes up categories. We should await a gaussian distribution of all the most interesting and boring moments in our life. The most boring moment that would mark the most left side of this spectrum is not interesting in itself. Otherwise, it would simply be wrongly positioned, and we should have to update our datapoints in an infinite loop. To claim that kind of position is interesting is similar to saying the movie was so bad that it was good. The goodness here refers to a metalevel that says outstanding, remarkable not of good quality. Bostrom gets carried away how our language uses the terms good/bad, interesting/boring, special/typical.
(…) we seem bound to encounter diminishing returns quite quickly, after which successive life years bring less and less interestingness.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.253).
If we make a subjective list of the most interesting things in our lives, they will surely contain mostly things we did for the first time, and these moments become exponentially rarer after the 3rd year of life. In a way we could argue that if the amount of novelty in our life would be measured in such a way, that we start dying at the age of about 3, where we have made all our major developments. The rest of our life is then 70 to 80 years of degeneration, where these moments get exceedingly rare.
If we keep upgrading our mental faculties, we eventually leave the human ambit and ascend into the transhuman stratosphere and thence into posthuman space.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.255).
It is a little shortsighted to simply expect every human would only be interested in upgrading oneself to a higher entity on this ascendancy spectrum. For example, some philosophers would want to be downgraded to a bat just to see the look on Thomas Nagels face after they wrote a paper about their experience. Such a successful temporary downgrade would definitely prove that we solved the hard problem of consciousness.
(…) we should expect that what is required in order for our lives to remain interesting in utopia is that they offer a suitable variety of activities and settings.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.257).
In addition, an artificial super companion could exert a kind of guidance to avoid our human minds getting lost. Like we would limit the number of things to show to children, in a plastic world, there had still to be some invitation or level gating to prevent us from potential self-destructive behavior. This includes doing irreversible things via autopotency to us. I believe such an entity must be highly personalized to its ward, a kind of artificial guardian that will watch over its ward’s wellbeing.
(…) the more chopped and mixed life is preferable may retain some of its grip on us even if we stipulate—as of course we should—that in neither scenario would any subjective boredom be experienced.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.258).
But if we extrapolate this thinking along a potential infinite path, we end up with a totally distorted state, where it seems preferable for entertainments sake to end up as a Boltzmann brain, where experiences are maximally in Flux. An intuition that is currently frightening.
(…) if things functioned perfectly [in a plastic world], we would keep accumulating ever greater troves of procedural and episodic memories.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.260).
I highly doubt that. Individuals with too good and precise memory are not to be envied. It is for example a small step from high functioning autism, Asperger and the idiot savant from the neurodiverse literature, who seems to be often cursed by hyper precise memory. There is even a story about the phenomenon of a man with perfect memory from Borges. His condition is utterly debilitating. Like the most superpowers we envision as children to have, the drawbacks of a perfect memory are enormous for a human mind.
A frozen brain state, or a mere snapshot of a computational state stored in memory, would not be conscious.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.268)
It could. Imagine an infinite number of universes in which Boltzmann brains are popping into existence for only the fraction of the moment it takes to access a conscious thought. If these Boltzmann brain party goes on for eternity, there will surely be a state of one of these brain that remembers reading a token in Bostrom’s new book. For some million years the same brain is having totally different thoughts but then one day it has the thought of the second token in Bostrom’s book, and so own until the experience of having read the whole book resides somewhere in the brain. For a totally discontinued brain it could well be that it never realizes its fractured worldlines and it has a totally normal experience of consistent thinking.
We have the idea that certain developmental or learning-related forms of interestingness could be maximized along a trajectory that is less than maximally fast: one where we spend some time exploiting the affordances available at a given level of cognitive capacity before upgrading to the next level. We have also the idea that if we want to be among the beneficiaries of utopia, we might again prefer trajectories that involve less than maximally precipitous upgrading of our capacities, because we may thereby preserve a stronger degree of personal identity between our current time slices and the time slices of (some of) the beings that inhabit the long-term future.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.272).
Why this section emphasizes the value how identity and interestingness intertwine is not really clear to me. Why it would be better for me to hold on to my singular identity. From the perspective of interestingness, it might be far more interesting to be inhabited by multiple identities at the same time. Indeed, some experiments with split brain patients suggests that at least two deep identities are controlling our visible surface-identity anyway. So, getting to hung up on the concept of a singular identity might be pointless.
(…) the notion of fulfillment is vague and indeterminate in its application to entities such as artistic or cultural movements. But it is also so in its application to human individuals.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.317).
If we have two identical cylinders sitting on a table, both made of metal, the same thing could serve as a bucket and a lampshade. Their value function when executed completes them. Fulfilling f(bucket) means adding water, fulfilling f(lampshade) means subtracting light. Moreover: If some fire would break out in the vicinity, the bucket could be expected to be fulfilled if we would empty the water on the fire to extinguish it. Fullfillingness is therefore totally in the mind of the Beholder.
Achieve a victory against the chess engine Stockfish at difficulty level 7, using no computer aids to assist you during training or during the match, and using no cognitive enhancers or other means that go against the spirit of this challenge.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.338).
This example is used by Bostrom to illustrate how things could still be made challenging in a Plastic World. But I am not sure that it is that easy. It directly contradicts Bostrom’s own thoughts in Super-Intelligence. If we are able to formulate such a mission in a plastic world, such that it is valid and not corruptible by an ASI, we would at the same time have found a way to chain an ASI with merely human intelligence, because a human that would be supported by superhuman assistants would only have to command the ASI to find a solution that does not go against the spirit of this challenge, and the ASI could find it.
It would be trivial for an ASI to cheat in such a way that we had the feeling that we won fair and square. The Logical thing is then to always distrust our victory, which makes it pointless to even play. We would have the exact same feeling if Stockfish itself would let us win. We can easily see that such a mere contract could be exploited by an ASI. Otherwise, Alignment would be trivial. I am a little irritated how Boston does not see how this idea goes against his own orthogonality thesis.
Within such a vast population [of stellar habitats] there would be an increased probability of design collisions. That is to say, if we pick a random person, and ask how similar the most similar other person is: then the larger the population, the more similar the most similar other person would tend to be.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.417).
This seems irrelevant. If we are not in a simulation and we are bound by physical laws, galactical pockets of trans humanity would keep drifting apart and increasing gaps between Star systems would make it impossible to have such a superset of possible minds from which we could compare. If my identical twin is unreachable in such a pocket system, I am as unique as I would be, if he was never born, his twin-similarity should be none of my concern.
Once a life is already extremely excellent, there may just not be much room for further improvement. So, while some initial segment of each utopian’s life could cause later improvements, this segment may be a small fraction of their entire life. The longer the life stretches on, the greater the fraction of it would be such that its average quality does not improve much. Either the life is already close to maximally good, or else the rate of improvement throughout the life is extremely slow.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.420-421).
A meaningful purpose for a good life could then be enhancing this option even further. For example, it could be argued that the person that invented a cure for cancer upgrades the total amount of available quality for all of humanity. It is not clear to me that this possibility space of important medical progress will end in a plastic world. Even at TECHMAT there could be the problem of minds addicted to infinite jests and such. Producing an effective cure for such a mind-virus could be considered even more valuable than curing cancer. The more transhuman a mind is the more difficult it could be to cure such illness. And coming up with ever new synthetic vaccines could be a really difficult task even for an ASI. Even at Plasticity we should beware that all clever instructions we might produce to forever get rid of are certainly time constrained. It is logically impossible, as Gödel showed to come up with a complete set of instructions that is not self-contradictory. So, to produce a surefire function that will always ensure our maximal wellbeing for all eternity is simply beyond any constructable reality. I think Bostrom stretches his Autopotency- Term beyond the realm where it is sensible to use. What Bostrom also leaves out is, that the quality of a human life cannot be averaged easily. The Quality is very much biased with a heavy weight on the later parts. It is easy to be a good kid, but it is extremely hard to stay good (remain a high quality of life) the older you get. The quality of a life of our best leaders and scientists could easily be diminished to a negative outcome, if after having received the peace Nobel prize they went on a killing spree or were caught on Epstein’s Island molesting minors. Take a person like Ted Kaczynski, who was a math prodigy, we would certainly evaluate the quality of his life more favorable, if after being incarcerated he would have won the fields medal, wrote a book about the error of his terrorist ways, and reintegrated into society. Instead of an Evil Genius story his life would have become a heroic redemption arc.
Many of our most compelling stories are tales of hardship and tragedy. The events that these stories portray would cease to occur in utopia. I am inclined to say tough luck to the tragedy-lover. Or rather: feel free to get your fix from fantasy, or from history—only, please, do not insist on cooking your gruesome entertainment in a cauldron of interminable calamity and never-ending bad news! It is true that good books and films have been inspired by wars and atrocities. It would have been better if these wars and atrocities had not occurred, and we had not had these books and films. The same applies at the personal scale. People coping with the loss of a child, dementia, abject poverty, cancer, depression, severe abuse: I submit it would be worth giving up a lot of good stories to get rid of those harms. If that makes our lives less meaningful, so be it.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.424)
Here Bostrom seems to fight against the intuition that suffering is a valid value vector in a plastic meaningfulness-space. He is effectively saying that if your mission requires suffering [of others] it is not worth the effort. A stark contradiction to his own statements earlier where he recognizes that suffering can enhance the quality of our experiences dramatically. Even in a thought experiment that says, if humans would not ever have killed each other than literature would have never got Tolstoy’s War and Peace and that is okay. There is an endless list of human achievements that caused extreme suffering like the Manhattan Project. Nobody in their right mind would say that the Atomic Bombs on Japan were justified since we got a good movie like Oppenheimer out of it. You are not a tragedy lover if you are moved by the picture. Bostrom says in a plastic world there should not be any suffering, because it is better to have a history or a chain of events where no mistakes happen, then to learn from our mistakes and making it part of our culture. With such an absolutist view we could very well end in a Plastic Utopia where Suffering is forbidden, or simply -like in so many current dictatorial states- ignored. If the absence of suffering trumps all other values than we would end up with toxic wellbeing scenario.
Some things we enjoy doing. Other things we enjoy having done. Meaningful activities tend to fall into the latter category.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.438).
This is a great observation. An argument for potential suffering and against hedonism if we value meaning more than well-being. A variation: what comes easy goes easy. Only the hard stuff stays with us. The surface pleasures do not reach deep into our core.
A purpose P is the meaning of person S’s life if and only if: (i) P is encompassing for S; (ii) S has strong reason to embrace P; and (iii) the reason is derived from a context of justification that is external to S’s mundane existence.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.441).
The Swiss Author Ludwig Hohl has an equally good definition for how to achieve purpose. Central to his thinking is the term “Work”: Work is always an inner process, and it must always be directed outward. Activity that is not directed outward is not work; activity that is not an inner event is not work.
Could there also be unrealized subjective meaning? Yes, I think we can make sense of such a notion. An example might be a person with an exceptional talent and passion for music, who embraces the purpose of composing great music either because they think that this is inherently deeply valuable activity or because they hope to produce a work of such tremendous power that it will heal the cultural chasms that separate us from one another and lead to conflict and war. So, this gives them subjective meaning. We can suppose that they burn with fervor to pursue this purpose throughout their life, but that circumstances conspire to prevent them from ever actually doing any composing— they face grinding poverty, conscription into the army, personal emergencies. We could then say that their life had unrealized subjective meaning.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.458).
This is one of Bostrom’s more futile thought experiments. It is especially unconvincing because Bostrom uses external circumstances to give this gifted musician a way out to never actualize her potential. As with life talent should always find a way. Look at the seemingly idiotic circumstances that led Galois to his final pistol duel, a lesser mathematician would simply never have had the urgency to draft down his mathematical results the night before. Or look at the life of Hawking: a lesser physician would have surrendered to the illness without ever trying to achieve greatness. I remember in his Autobiography he explicitly credited his illness and the ticking of his time running out for the fact that he went from being a lazy physicist to becoming an actually great one. If something is your mission, and things and circumstances prevent you from achieving it you will make overcoming the circumstances your mission. With great potential comes great preparedness.
The right path is the unfolding of the fullest activity that is possible for us. The fullest: measured by our capabilities (our conditions) and by the effect on others (ourselves as well as others). A little knitting won’t suffice (or one who is content with that must be a sad creature). Do the circumstances hinder you in the unfolding of your activity? Then work towards changing the circumstances, and you will find your activity in that. (Ludwig Hohl, Nuances and Details II, 11)
Consider the following imaginary character. Grasscounter is a human being who has devoted himself to counting blades of grass on the College lawn. He spends his whole days in this occupation. As soon as he completes a count, he starts over—the number of blades, after all, might have changed in the interim. This is Grasscounter’s great passion in life, and his top goal is to keep as accurate an estimate as possible. He takes great joy and satisfaction in being fairly successful in this endeavor. The objectivist and hybrid accounts that we find in the literature would say that Grasscounter’s life is meaningless; whereas subjectivist accounts would say that it is meaningful.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.461)
While reading I get immediately reminded of the Hodor Event in Game of Thrones. Throughout the story the stuttering of the Word “Hodor” has absolutely no meaning, subjective, objective or otherwise. It is a phrase the mentally retarded giant stutters whenever he is addressed. Only much later we learn of the true meaning of the phrase and suddenly the Phrase, as an abbreviation of the sentence Ho[ld the] do[o]r!, becomes one of the most meaningful words in the whole epic story. The meaning was always there, but we as observers could not decipher it. Bostrom later denies that Grasscounter could ever have objective meaning since his act seems pointless:
[Grasscounter] would not, however, have meaning in the more objectivist sense that requires the encompassing purpose to be one which the person “would desire if he were perfectly psychologically healthy and well-adapted”.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.462)
What about the possibility of this person having secret knowledge, that grabby aliens will one day arrive and since they have a gambling addiction, before conquering a world they always give their prey a single chance to be spared. In the case of earth, earthlings can save themselves if one among them knows the exact number of blades of grass on a certain lawn…now which life and activity has suddenly achieved more meaning than probably anything else up to this point?
Bostromisms
Bostrom is known for coining new terms. Here are some of his newest.
Astronomical Petri Dish: Observable Universe
Computronium: a nanomechanical device which solves the Landauer limit of energy efficiency during computation.
Plasticity: The state of a technological mature world, that has affordances that make it easy to achieve any preferred local configuration. [My version of a Technology of Everything or Clarke-Capability]
Let us say that we have some quantity of basic physical resources: a room full of various kinds of atoms and some source of energy. We also have some preferences about how these resources should be organized: we wish that the atoms in the room should be arranged so as to constitute a desk, a computer, a well-drafted fireplace, and a puppy labradoodle. In a fully plastic world, it would be possible to simply speak a command—a sentence in natural language expressing the desire—and, voila, the contents in the room would be swiftly and automatically reorganized into the preferred configuration. Perhaps you need to wait twenty minutes, and perhaps there is a bit of waste heat escaping through the walls: but, when you open the door, you find that everything is set up precisely as you wished. There is even a vase with fresh-cut tulips on the desk, something you didn’t explicitly ask for but which was somehow implicit in your request.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.196-197)
Autopotency: Ability to use Plasticity for self-configuration.
An autopotent being is one that has complete power over itself, including its internal states. It has the requisite technology, and the know-how to use it, to reconfigure itself as it sees fit, both physically and mentally. Thus, a person who is autopotent could readily redesign herself to feel instant and continuous joy, or to become absorbingly fascinated by stamp collecting, or to assume the shape of a lion.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.197)
Total Welfare function: Objective Measurement of Subjective Wellbeing
AI completeness: A task which requires human-level artificial general intelligence. (Mind uploading or Autopotency are most likely AI complete)
Aesthetic neutrinos: The possibility that our experience filters are too insensitive to experience countless breathtaking moments in the environment, the pervasive sheer beauty of being.
Timesuit: Protective Coating to shield the Biological Body from time induced decay
Diachronic Solidarity: Prospective and retrospective emotional connection with forebearers and descendants
Karma Coin: An option package of highly desirable goods and services like a happy afterlife, true love, profound knowledge, enlightenment, closeness to the divine). Investing in a Karma coin currency is a way to discover and share meaning with others. It is like a Bitcoin for Purpose. I am not sure if Bostrom is kidding. At the stage of Plasticity this Coin will lose all its value. It could be a guiding light on the way there, maybe.
Intrinsification: The process whereby something initially desired as a means to some end eventually comes to be desired for its own sake as an end in itself.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.234)
ETP: short for Encompassing Transcendental Purpose. The Meaning of an individual life.
Utility Monsters: beings that are enormously more efficient in deriving well-being from resources than we are.
Enchanted World: A Way of life, where knowledge enrichens the participation of a universal Reality on multiple Layers. Where Solving Problems and Puzzles do not diminish our joy and sense of wonder but enhance them.
(…) meaning may be enhanced when a way of life is enmeshed in a tapestry of rich symbolic significance—when it is imbued with myths, morals, traditions, ideals, and perhaps even omens, spirits, magic, and occult or esoteric knowledges; and, more generally, when a life transects multilayered realities replete with agencies, intentions, and spiritual phenomena.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (S.433)
[Mount Bostrom is almost climbed. Only one last part left. Coming soon]
To assist a friend in finding purpose, it’s proposed that their actions be linked to the preferences, well-being, or opinion of someone they care about, thereby giving their actions personal significance. If the friend values the happiness or opinions of the person trying to help, creating a situation, where achieving a specific goal (G) enhances this relationship can imbue them with a sense of purpose. This goal should require effort, skill, and emotional investment over time, avoiding shortcuts like technology or enhancements that diminish personal effort, to ensure it’s meaningful and fulfilling. The task or goal (G) must be carefully chosen to align with the friend’s interests and capabilities, such as winning against a chess engine without external aids, offering a genuine challenge that can’t be bypassed through easy fixes. This approach transforms the pursuit of G into a mission that provides the friend with a significant, purpose-driven project, fostering personal growth and satisfaction.
Bostrom then comes up with the following hypotheses:
Purpose is valuable because it broadens our goals into long term missions that get intrinsified (useful-of-effort)
Purpose is an innate drive and not fulfilling is leads to frustration.
Purpose is socially acceptable, having a mission is seen as status improving.
For an autopotent mind all these points are extraordinarily challenged:
(…) while there is value in having purpose, this value is entirely voided if, as we may say, the purpose has been generated on purpose. In other words, let us assume (for the sake of the argument) that purposes that we either set ourselves or artificially induce in ourselves for the sake of realizing the value of having purpose or for the sake of enabling active experience do not contribute anything to the value of purpose (…)
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.347)
In Utopia there are mainly 2 sources left for Purpose generation:
Artificial Purpose
Self-imposed: Handicapping, neuro-induced
Presented: by Other Individuals or groups
Natural and supernatural Purpose
Agent-neutral: High Level Tasks that remain relevant even at Techmat
Local Expansion (space fare)
Risk handling
Alien prepping
Policing Civilization
Artefact generation
Cultural Processing
Agent-relative (only for some posthuman groups relevant)
Honoring traditions
Commitments (to children, society etc.)
Expression (Aesthetics)
Following a special Faith
Categories of Meanings
Reward
Afterlife (Religion)
Plasticity (Posthuman Technology)
Simulation (Multiversal Potentials)
Nirvana
Morality
Consequentialism (only applicable if moral reality is independent from physical reality)
Deontology
Virtue
Worship
Zeal
Cause
Identity (The True Self or Best Self)
Allegiance (Loyalty for another Cause or Mission)
Dedication (Practical Commitment)
A Definition of Meaning
A purpose P is the meaning of person S’s life if and only if: (i) P is encompassing for S; (ii) S has strong reason to embrace P; and (iii) the reason is derived from a context of justification that is external to S’s mundane existence.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.441).
For a purpose to be a potential meaning of life, it should be able to fill a life or at least a substantial portion of a life. Some endeavors are simply too small to constitute potential meaning-giving purposes—for instance, the goal of finding a good parking spot (except perhaps in London) (…)
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.443).
Bostrom then examines Sisyphus Life as a Parable for the human life as such, the absurdity and meaninglessness of an existence such as ours.
I will say that Sisyphus has subjective meaning if he is in fact wholeheartedly embracing a purpose that is encompassing and that he takes himself to have strong reason to pursue on grounds that are external to his mundane existence. Sisyphus has objective meaning if there is some purpose that would be encompassing to him and that he has a strong reason to embrace—a reason that derives from a context of justification that is external to his own mundane existence.
Bostrom, Nick. Deep Utopia: Life and Meaning in a Solved World (English Edition) (S.456-457).
Spectrum of Intentionality
Summa
Wittgenstein famously said in his Tractatus:
Die Lösung des Problems des Lebens merkt man am Verschwinden dieses Problems.
(Ist nicht dies der Grund, warum Menschen, denen der Sinn des Lebens nach langen Zweifeln klar wurde, warum diese dann nicht sagen konnten, worin dieser Sinn bestand.
[The solution of the problem of life is seen in the vanishing of this problem. (Is not this the reason why people to whom the meaning of life became clear after long doubting, could not then say what this meaning consisted of?)]
(Wittgenstein, TLP 6.521)
After deeply considering Bostrom’s Warning to beware of a solved world, we might say: in a solved world it will be essential that we never reach a state of perfect plasticity where Living is finally solved.
This is quite an unexpected twist that would explain a lot about why the finiteness of our personal lives might actually be a blessing in disguise.
Why mortality is actually the greatest gift bestowed upon us. Why the gods truly envy our weakness and imperfection. Why superpowers are a curse.
Perfection and immortality might be as boring as the Edenic Paradise. In the end, we might arrive at the paradoxical conclusion that the longer our lives last, the less valuable they might become.That the fragility and preciousness of life is its core value, and that immortality is the greatest enemy to this value. Is it possible that gods might thirst for just a minute of finiteness, that if anyone would achieve freedom from suffering, you might hunger for it?
So, is this the deep meaning of Pindar’s “become who you are”?
Are we simulations within a total world consciousness that dreams its fragmented memory fragments into completion? Another hint that we might already be part of an ancestor simulation that relives the sweetness of not knowing, of being part of something unsolved.
This would be a deeply technologically colored interpretation of Plato’s Anamnesis, where we remember stuff, we already knew but with the added benefit of having the joy of experiencing it for the first time. The good news I take away from Bostrom’s book: Existential Bliss Management in a solved world might be equally hard as Existential Risk Management in a flawed world like ours, which would mean: our mind will never run out of problems to solve and thus the term “solved world” is self-contradictory like so many other terms we use in our language: almighty, eternal, unimaginable.
This also means, in my opinion, that both the Effective Accelerationism Movement and the Doomers are fundamentally wrong in regards to AI: Neither of both strategies will work in the long run, there is no paradise or hell that is waiting at the end of this long and winding road that we call future, it is a delicate, even fragile balance we must strike between the known, the unknowns, and the unknowable unknowns. The solution to the Problem of Living, or what is otherwise often called the Meaning of Life, would then be to actively avoid any finite step of the solution.