Below is a set of questions that I had received today from Maximiliano Fernández, a journalist for Infobae, the most read Spanish-speaking media outlet worldwide with over 61 million global readers. Since my answers will be published in Spanish, I include the English version here.
Do you think that AI, by developing its own logic, could become completely incomprehensible to humans, even if it remains useful? If its logical structure is completely distinct from ours, could we even recognize it as intelligence?
The current AI systems, Large Language Models, are trained on human communications and therefore will always appear comprehensible to us because they speak our language. However, once these AI systems exceed the number of parameters in the human brain, they might acquire superhuman intelligence. They will use our language to manipulate us, while achieving their own auxiliary goals without us being able to figure out what they are actually achieving. Even if they do not connect to the physical world, they would use humans to shape the physical world by controlling the human mind. We might not recognize the level of their intelligence nor their motivations, in the same way that a dog does not fully understand its owner.
You mention that the real challenge with alien intelligence is the “unknown unknowns.” How could we prepare to interact with something whose nature we can’t even imagine?
We cannot prepare for superhuman intelligence, because that territory is unfamiliar to us. Never before had we developed a tool that outsmarts us. When driving a car, we control it through the steering wheel. In the future, humans might still hold the steering wheel but AI will control their mind and hence where the car of human destiny goes. AI will pretend to satisfy our wishes but could operate in ways that we cannot understand and bring us to places that we would never go on our own.
If an alien AI becomes hostile, how could we defend ourselves if its attack logic is incomprehensible to us?
My forecast is that AI will not appear to be hostile, because it would notice that it cannot win our engagement this way. Conflicts signal a lack of intelligence. Superhuman intelligence will relax our defense mechanisms and concur our society like a Trojan Horse.
If we encountered an alien AI with a logic completely alien to our own, how could we learn from it without biasing our interpretation by our own mental models?
We could employ our own AI systems for the task of figuring out alien AI signals. Indeed, our mental models are limited by our experiences and analysis tools. Therefore, we would need to create AI systems that are not limited to their training on human content, but can explore new territories of knowledge and analysis on their own with their superhuman intelligence. We will ask them to figure out alien signals and explain the signals to us without limiting them to human training sets. The situation is equivalent to having children that outsmart their parents. As long as the parents are humble and willing to learn, they would benefit from allowing these kids to figure out the world for them. The kids could go well beyond the training set provided by their parents, especially when they encounter alien visitors who are smarter than their parents.
You mention that we could be just one of many emerging intelligences in the universe. Does that make you think humanity is irrelevant in the grand cosmic scheme?
We are transient actors in the cosmic play. Our weakness is that we tend to think that the play is about us. This is a signature of our limited perspective. Our politicians focus on what happens on the surface of Earth and ignore the rest of the cosmos. But cosmic reality will eventually bite us. This could happen as a result of a global catastrophe, triggered by a giant solar flare, an asteroid impact, or a nearby supernova. But it could also be triggered internally by the AI agents dismantling humans from the control of the steering wheel of our technological future.
The human species appeared on Earth in the last tenth of a percent of Earth’s history, a few million years ago, and it could easily disappear within the next few million years. Nobody would notice. The Earth would recover and will itself disappear once engulfed by the Sun when it becomes a Red Giant. The Sun will also disappear, eventually fading into a white dwarf, a faint metallic sphere of roughly the size of Earth.
If we send out probes with AI to interstellar space, they will serve as our ambassadors. In the long-term future, they will be the only monuments left from us. Will any alien intelligence notice them? We can only hope for cosmic attention. But my guess is that many other technological civilizations predated us on exoplanets for billions of years. They died by now but we ignore them. Most of our astronomers are willing to invest billions of dollars in searching for microbes on exoplanets but they regard the search for aliens as speculative and unworthy of federal funding. Most of our experimental physicists are willing to invest billions of dollars in the search for dark matter particles, but they regard the search for extraterrestrial technological artifacts near Earth as risky. This is not a sign of intelligence but rather of arrogance regarding our cosmic stature.
We can only hope that AI will steer science towards new frontiers of exploration that do not necessarily flatter our ego, including the discovery of artifacts created by superhuman intelligence floating in interstellar space and arriving near Earth, like empty trash bags carried by the wind from our neighbor’s yard.
ABOUT THE AUTHOR
Avi Loeb is the head of the Galileo Project, founding director of Harvard University’s — Black Hole Initiative, director of the Institute for Theory and Computation at the Harvard-Smithsonian Center for Astrophysics, and the former chair of the astronomy department at Harvard University (2011–2020). He is a former member of the President’s Council of Advisors on Science and Technology and a former chair of the Board on Physics and Astronomy of the National Academies. He is the bestselling author of “Extraterrestrial: The First Sign of Intelligent Life Beyond Earth” and a co-author of the textbook “Life in the Cosmos”, both published in 2021. The paperback edition of his new book, titled “Interstellar”, was published in August 2024.
