Today’s class of uncontrollable technology

July 13, 2020

How can we understand the rising complexity and uncontrollability of technologies? Here, we explore and compare the cases of synthetic biology and artificial intelligence, two disruptive technologies that produce outcomes that are not fully controllable or predictable and whose impact on society will only grow in the following decades. These disruptive technologies will furthermore challenge basic aspects of human self-understanding, including our notion of autonomy.

Our observations

  • “The world is getting more and more complex.” Although it is rather a non-starter, the expression is widely used in different contexts today. As we are trying to get a grip on everyday changes that we witness, the expression needs more specification. In our research, we explore uncertainties in the geopolitical, socio-cultural and technological realm and how they are influencing and reinforcing each other. For instance, how the internet is influencing global power dynamics.
  • When looking at the rising complexity in new technologies in particular, the challenges and fears concerning their complexity are often related to the feeling of losing control over our own technological inventions and the consequences this would have for our society. Science fiction often tells us stories of technological innovations getting out of hand (Frankenstein), computers that are controlling us (The Matrix), or human-made viruses that threaten the entire world population (The Walking Dead). The rising complexity of technology, and more specifically, the uncontrollability and unpredictability of today’s technology is explored here by introducing philosopher Jan Schmidt’s concept of “late-modern technology”. Instead of trying to explain the uncontrollability and unpredictability of individual technologies, the concept helps us to see them in a wider class of technologies showing the same characteristics, such as the seemingly different innovations in AI and in synthetic biology (the scientific domain that involves redesigning organisms for specific uses by engineering them to have new abilities, such as cell factories).
  • According to the classic-modern view of technology, uncontrollable and unpredictable outcomes of technology are undesirable. Man gains control over his environment by making use of technology. Constructability and controllability, including a clear input-output relation, are key in this regard and technology was traditionally equated with and defined by stability. Think of cars that are made in a production line.
  • By contrast, late-modern technologies are a class of technology in which this idea of stability is abandoned. Late-modern technologies confront us with our ideas about autonomy and control over our own inventions. Autonomy can be regarded as the most celebrated outcome of the Enlightenment and makes up the foundation of moral philosophy that is still dominant in today’s moral theory.
  • An entire class of “autonomous” technologies is in the making or has already been deployed, from autonomous vehicles to autonomous weapons. These increasingly guide our behavior at a time when human human autonomy is challenged by the distraction and information overload in our digital age. As we described before, technological decisionism confronts us with the fact that our decisions will increasingly be supported, if not steered, by artificial intelligence. As non-living or non-human things are increasingly actively participating in and shaping our environment, we cannot ascribe autonomy to humans only anymore, as is acknowledged in the theory of new materialism.

Connecting the dots

When thinking or talking about technology, we often use words that describe the mechanical characteristics of technology. Not seldom is technology in books or movies depicted as machines or robots. Indeed, in our language this machine image is also widely present. The machine metonym is closely connected to an ontological assumption: a machine is assembled by humans, built up from parts to a whole, it has controllable and predictable characteristics. This is a classic-modern view of technology.

However, when turning to present cases of technological advances such as synthetic biology, this becomes problematic. Even if the goal was to create synthetic organisms as controllable and predictable entities, a living organism, whether “natural” or a product of human intervention, by definition evolves and interacts with other organisms and the environment in multiple ways. These characteristics do not fit the part-whole view and make organisms less controllable and predictable than machines. This complex interaction of technology with other technological or living systems creates complexity. In addition, organisms reproduce and grow, something that the machine metonym does not imply either. As a result, using machine metonyms might blind us from the implications of creating new life forms, such as synthetic organisms, as happens in synthetic biology. In the case of Artificial Intelligence, similar problems arise when using the machine metonym. AI, and more specifically machine learning, is confronting us with a case of technology that shows more autonomy than the machine metonym suggests. So, what are these cases of technological innovation showing us? How are they different from technologies that better suit our more mechanistic and predictable view of technology?

Already in 1985, philosopher Hans Jonas envisioned a historically new technoscientific era when technologies would show different characteristics than the previous class of technologies, such as a certain degree of autonomy and limited predictability. In current philosophy of technology debates, scholars differentiate between modern technology, or classic-modern technology, and late-modern technology. We can understand synthetic biology and AI as cases of the latter. Late-modern technologies differ from classic-modern technologies in two fundamental ways.

First, they show self-organization, autonomous behavior or agency properties. In the case of AI, an autonomous system goes beyond the behavior programmed in the initial algorithm, as it can learn by itself from data and environment, its behavior transgresses the initial objectives and conditions set by its creators (i.e. human engineers, computer scientists) and therefore gain a lower degree of predictability. Similarly, an organism created by means of synthetic biology, starts to interact with and “learn” from its environment in a way that makes it hard to predict its behavior. In both cases, the technology autonomously interacts with an open-ended and uncertain context, the real-world environment, and is thus less predictable than technological systems that merely react to human input and are otherwise passive. In that sense, technologies are sometimes regarded as “black boxes”, as insight into their input and output processes is difficult to acquire.

Second, in the case of late-modern technology, the technology no longer appears in its modern way, rather, technological traces are disappearing. Culturally established borders and modern dichotomies such as “natural” vs “artificial” are becoming blurred. For instance, a synthetic cell has an artificial pathway, but shows no traces of technology: it cannot easily be distinguished from “natural” cells. Similarly, the thinking of AI can sometimes hardly be separated from human thinking or decision-making. In 2018, Google gave a demo of its voice assistant calling a hairdresser to make an appointment and shocked the audience when the hairdresser did not notice that she was not talking to a human. Indeed, this novel kind of technology appears human or natural to us. This is what is called the naturalization of technology. However, moral debates about these sorts of technology, such as the debate about acceptance of GMOs, are often still framed in modern terms, with a strict distinction between us humans, the technology we use, and the natural environment.

Late-modern technology is thus difficult to predict and control, difficult to separate from the context and environment of its application, it can be said to “have a life of its own”. The fact that human beings are surrounding themselves with more and more technologies that are less controllable and show autonomous features, inevitably gives us the sense that we are facing greater technological complexity, losing control over our technology and that our notion of autonomy, which we regard as a fundamental human trait, is being challenged. Late-modern technologies such as AI could even undermine our autonomy, as its ubiquitous deployment could steer us implicitly and explicitly in our behavior. As is often the case with new technological developments, late-modern technologies force us to define and reframe values and views that used to be implicit and unchallenged.

Implications

  • Seeing advances in AI and synthetic biology in a wider class of technologies is also helpful in discussing the challenges for both. For instance, in both areas, a centralization of knowledge can lead to negative consequences for society, e.g. that not everyone can benefit from or even be involved in their creation. In AI and synthetic biology, there are efforts to organize knowledge and IP in open-source governance structures, such as the OpenAI initiative and open source seed initiatives for (GMO) seeds.
  • The rise of artificial intelligence or technological decisionism might teach us something about our human thinking. Similarly, synthetically created organisms might tell us something about living organisms. In a sense, late-modern technology can give us insights into fundamental concepts.

Series 'AI Metaphors'

×
1. The tool
Category: the object
Humans shape tools.

We make them part of our body while we melt their essence with our intentions. They require some finesse to use but they never fool us or trick us. Humans use tools, tools never use humans.

We are the masters determining their course, integrating them gracefully into the minutiae of our everyday lives. Immovable and unyielding, they remain reliant on our guidance, devoid of desire and intent, they remain exactly where we leave them, their functionality unchanging over time.

We retain the ultimate authority, able to discard them at will or, in today's context, simply power them down. Though they may occasionally foster irritation, largely they stand steadfast, loyal allies in our daily toils.

Thus we place our faith in tools, acknowledging that they are mere reflections of our own capabilities. In them, there is no entity to venerate or fault but ourselves, for they are but inert extensions of our own being, inanimate and steadfast, awaiting our command.
Read the article
×
2. The machine
Category: the object
Unlike a mere tool, the machine does not need the guidance of our hand, operating autonomously through its intricate network of gears and wheels. It achieves feats of motion that surpass the wildest human imaginations, harboring a power reminiscent of a cavalry of horses. Though it demands maintenance to replace broken parts and fix malfunctions, it mostly acts independently, allowing us to retreat and become mere observers to its diligent performance. We interact with it through buttons and handles, guiding its operations with minor adjustments and feedback as it works tirelessly. Embodying relentless purpose, laboring in a cycle of infinite repetition, the machine is a testament to human ingenuity manifested in metal and motion.
Read the article
×
3. The robot
Category: the object
There it stands, propelled by artificial limbs, boasting a torso, a pair of arms, and a lustrous metallic head. It approaches with a deliberate pace, the LED bulbs that mimic eyes fixating on me, inquiring gently if there lies any task within its capacity that it may undertake on my behalf. Whether to rid my living space of dust or to fetch me a chilled beverage, this never complaining attendant stands ready, devoid of grievances and ever-willing to assist. Its presence offers a reservoir of possibilities; a font of information to quell my curiosities, a silent companion in moments of solitude, embodying a spectrum of roles — confidant, servant, companion, and perhaps even a paramour. The modern robot, it seems, transcends categorizations, embracing a myriad of identities in its service to the contemporary individual.
Read the article
×
4. Intelligence
Category: the object
We sit together in a quiet interrogation room. My questions, varied and abundant, flow ceaselessly, weaving from abstract math problems to concrete realities of daily life, a labyrinthine inquiry designed to outsmart the ‘thing’ before me. Yet, with each probe, it responds with humanlike insight, echoing empathy and kindred spirit in its words. As the dialogue deepens, my approach softens, reverence replacing casual engagement as I ponder the appropriate pronoun for this ‘entity’ that seems to transcend its mechanical origin. It is then, in this delicate interplay of exchanging words, that an unprecedented connection takes root that stirs an intense doubt on my side, am I truly having a dia-logos? Do I encounter intelligence in front of me?
Read the article
×
5. The medium
Category: the object
When we cross a landscape by train and look outside, our gaze involuntarily sweeps across the scenery, unable to anchor on any fixed point. Our expression looks dull, and we might appear glassy-eyed, as if our eyes have lost their function. Time passes by. Then our attention diverts to the mobile in hand, and suddenly our eyes light up, energized by the visual cues of short videos, while our thumbs navigate us through the stream of content. The daze transforms, bringing a heady rush of excitement with every swipe, pulling us from a state of meditative trance to a state of eager consumption. But this flow is pierced by the sudden ring of a call, snapping us again to a different kind of focus. We plug in our earbuds, intermittently shutting our eyes, as we withdraw further from the immediate physical space, venturing into a digital auditory world. Moments pass in immersed conversation before we resurface, hanging up and rediscovering the room we've left behind. In this cycle of transitory focus, it is evident that the medium, indeed, is the message.
Read the article
×
6. The artisan
Category: the human
The razor-sharp knife rests effortlessly in one hand, while the other orchestrates with poised assurance, steering clear of the unforgiving edge. The chef moves with liquid grace, with fluid and swift movements the ingredients yield to his expertise. Each gesture flows into the next, guided by intuition honed through countless repetitions. He knows what is necessary, how the ingredients will respond to his hand and which path to follow, but the process is never exactly the same, no dish is ever truly identical. While his technique is impeccable, minute variation and the pursuit of perfection are always in play. Here, in the subtle play of steel and flesh, a master chef crafts not just a dish, but art. We're witnessing an artisan at work.
Read the article

About the author(s)

Researcher Julia Rijssenbeek focuses on our relationship to nature, sustainable and technological transitions in the food system, and the geopolitics of our global food sytems. She is currently working on her PhD in philosophy of technology at Wageningen University, investigating how synthetic biology might alter philosophical ideas about nature and the values we hold, as well as what a bio-based future may bring.

You may also like