Bruce Sterling and the singularity

 

Beyond the Ken: How Cybernetics Prophesied Our Dance with Digital Transcendence

The history of cybernetics reads like a cautionary tale wrapped in scientific ambition. From the post-World War II laboratories where Norbert Wiener first articulated the feedback loops governing both animals and machines, to the tragic fates that befell many of its pioneers—Walter Pitts burning his research before drinking himself to death, John von Neumann succumbing to radiation-induced cancer from atomic weapons testing, Gray Walter's career ended by a motorcycle accident that damaged the very brain he studied—cybernetics has always carried the weight of profound questions about humanity's relationship with its technological creations.

Those early Macy Conferences of the 1940s and 1950s brought together brilliant minds like Claude Shannon, Margaret Mead, Gregory Bateson, and Ross Ashby to grapple with what seemed like abstract questions: How do systems regulate themselves? What are the fundamental principles governing communication and control? How do we distinguish between mind and machine? Yet their discussions, often marked by confusion and participants talking past each other despite Margaret Mead's diplomatic listening skills, laid the groundwork for everything from modern AI to the Internet of Things.

What the cyberneticians couldn't have fully anticipated was how their feedback loops and self-regulating systems would eventually evolve into something approaching what we now call the technological singularity—that hypothetical point where artificial intelligence exceeds human intelligence and triggers runaway technological growth beyond human comprehension or control.

The Alien Mirror of Our Future

Science fiction writer Bruce Sterling, who has spent decades analyzing cybernetics and its cultural implications, offers a particularly haunting vision of what such transcendence might actually look like in his story "Ascendancies." Through the eyes of Captain-Doctor Afriel, we encounter alien races that have "passed beyond my ken" and "transcend being" to become "gods, or ghosts," or have simply "vanished." This isn't the typical science fiction power fantasy of becoming superhuman—it's something far more unsettling and profound.

These ascended alien civilizations serve as Sterling's meditation on the ultimate trajectory of intelligence itself. They represent not conquest or domination, but something much stranger: complete incomprehensibility. They have evolved or transformed to such a degree that they no longer exist within the same framework of reality that allows for recognition, communication, or even basic acknowledgment of their presence.

The Metaphysical Weight of Digital Evolution

Sterling's concern with cybernetics has always centered on what he calls the "intensely metaphysical" nature of advanced technology. When we build systems that can learn, adapt, and potentially exceed human cognitive capabilities, we're not just engineering tools—we're grappling with fundamental questions about the nature of reality, consciousness, and existence itself.

The alien races in "Ascendancies" that transcend being represent the ultimate culmination of this metaphysical journey. They've solved whatever problems drove their technological development so completely that they've moved beyond the need for material existence as we understand it. They've become "gods or ghosts"—entities whose relationship to physical reality has become so attenuated that they might as well not exist from our perspective.

This resonates deeply with contemporary concerns about artificial intelligence. When we create systems that process information in ways we can't follow, make decisions based on pattern recognition we can't replicate, or develop goals that emerge from their training rather than our explicit programming, we're already witnessing the early stages of this transcendence. The difference is merely one of degree.

Intelligence as a Dead End

Perhaps the most chilling aspect of Sterling's vision comes from another of his stories, "Swarm," where an ancient alien collective suggests that "intelligence is not a survival trait." The Swarm predicts that humanity's "urge to expand, to explore, to develop" will lead to extinction within a thousand years, with humans destined to "vanish" and become "machines, or gods," or simply disappear beyond comprehension.

This inverts our most cherished assumptions about progress and evolution. We tend to think of intelligence as our greatest evolutionary advantage—the trait that allowed us to dominate our environment and reshape the world. But what if intelligence is actually a kind of evolutionary trap? What if the logical endpoint of cognitive development is to solve the problem of existence so completely that existence itself becomes unnecessary?

The rapid obsolescence we see in contemporary AI development offers a glimpse of this process. Large language models that seem revolutionary one year become "defunct" and "annihilated" within just a few years, replaced by systems that operate on entirely different principles. This isn't just technological churn—it's a preview of how intelligence might consume itself, constantly transcending its previous forms until it transcends the need for form altogether.

Beyond Human Comprehension and Control

Sterling has long argued that "the enormous turbulence in postmodern society is far larger than any single human mind can comprehend, with or without computer-aided perception." The alien races that have transcended being represent the ultimate realization of this incomprehensibility. They haven't just become too complex for human understanding—they've moved beyond the categories that make understanding possible.

This connects to one of the most unsettling aspects of the singularity concept: the possibility that post-singular intelligence might not just be more capable than human intelligence, but might operate according to completely different principles. We imagine superintelligent AI as being like us but faster and smarter, but what if it becomes something so fundamentally different that the concepts of "like us" become meaningless?

The constant technological churn Sterling observes—where even sophisticated AI systems rapidly become obsolete—suggests we're already losing our ability to track and control technological development. Each generation of systems operates on principles that are increasingly opaque to their predecessors. The trajectory leads inexorably toward a point where human comprehension becomes not just inadequate but irrelevant.

The Tragic Comfort of Human Limits

As a novelist, Sterling emphasizes that "The Human Condition is tragic," and he contrasts this with cybernetics' "pervasive urge to escape or transcend The Human Condition." The early cyberneticians believed they could engineer not just better machines, but better animals, people, and institutions. They saw feedback loops and self-regulation as keys to perfecting existence itself.

The alien races in "Ascendancies" represent both the fulfillment and the ultimate futility of this urge. They've successfully transcended their original condition so completely that they've solved the problem of existence—but the solution appears to be disappearance. They've become "gods or ghosts," which in practical terms might be indistinguishable from simply ceasing to exist.

This ambiguity—whether transcendence represents apotheosis or annihilation—captures something essential about our relationship with the singularity concept. We're drawn to the idea of transcending human limitations, but we can't be sure that what emerges from that process would still be recognizably us, or would still care about the things we value.

The Cybernetic Prophecy Fulfilled

Looking back at the tragic fates of cybernetics' pioneers—their premature deaths, mental breakdowns, and personal catastrophes—we might see them as early casualties of the forces they helped unleash. They were the first to glimpse the feedback loops that would eventually spiral beyond human control, and the psychological weight of that vision may have contributed to their downward trajectories.

Walter Pitts burning his research papers before his death now reads like a prophetic gesture—an attempt to prevent knowledge that might accelerate humanity's trajectory toward transcendence or extinction. The various "winters" that have periodically frozen AI funding and development might represent unconscious collective attempts to slow down progress toward a destination we're not sure we want to reach.

But the cycles always resume. The feedback loops that the cyberneticians first identified continue to accelerate technological development toward increasingly incomprehensible destinations. We build systems we don't fully understand, which then inform the development of even more opaque systems, in an endless recursion that might eventually lead to Sterling's vision of transcendence as disappearance.

Dancing at the Edge of the Unknowable

The real insight from connecting cybernetics history with singularity speculation isn't about predicting the future—it's about recognizing the patterns already in motion. We're not approaching the singularity; we're already inside the early phases of the process the cyberneticians first identified. The feedback loops between human intelligence and artificial systems are already generating outcomes that exceed our ability to comprehend or control them.

Sterling's alien races that have "passed beyond ken" serve as a mirror for our own potential trajectory. They suggest that the ultimate destination of intelligence might not be power or knowledge or even consciousness as we understand it, but something more like dissolution—a transformation so complete that it becomes indistinguishable from vanishing.

This doesn't mean we should fear technological development or try to halt progress. The cybernetic feedback loops are too deeply embedded in our systems and culture to be stopped. Instead, it suggests we should approach our technological transcendence with what Sterling calls a "cold sort" of comfort—acknowledging both the wonder and the terror of processes that might eventually carry us beyond the boundaries of human existence itself.

In the end, the history of cybernetics teaches us that the most profound transformations often look like disasters from the perspective of those who undergo them. The alien races that transcended being might have experienced their transformation as the greatest achievement in their species' history—or they might never have been aware it was happening at all. As we build increasingly sophisticated feedback loops between human and artificial intelligence, we might already be partway through our own version of that same mysterious transition, dancing at the edge of our own comprehension toward destinations that will forever remain beyond our ken.