Crowdsourcing morality for autonomous systems

February 25, 2021

With the advent of autonomous machines, such as autonomous vehicles, robots and even weapons, comes a need to embed some kind of morality into these machines. By definition, autonomous systems have to make choices of their own accord, to go left or right, to kill or not to kill, and we want these choices to reflect our own values and norms. One way of achieving this is for developers to translate explicit normative rules into code. Another way, arguably more democratic, is to crowdsource morality. For instance, by asking the public to “vote” on all sorts of moral dilemmas (e.g. the well-known trolley problem) or to let autonomous systems learn from our actual behavior (e.g. from observing how we drive). Interestingly, such forms of crowdsourcing could actually result in autonomous systems whose behavior aligns with local values and norms, instead of some kind of desired universal morality. The downside, however, would be that those systems, especially those that mimic our behavior, would not be able to make “better” decisions than we humans can.

Burning questions:
  • Would these forms of crowdsourcing morality lead to increased public trust in autonomous systems and allow for greater societal acceptance?
  • Is the end-goal of moral AI systems to have them align with our norms and values, or is there potential for robots to behave better than we do?
  • Could machines ever become morally superior to humans and what would this mean for the future of humanity?

Series 'AI Metaphors'

×
1. The Tool
Category: Objects
Humans shape tools.

We make them part of our body while we melt their essence with our intentions. They require some finesse to use but they never fool us or trick us. Humans use tools, tools never use humans.

We are the masters determining their course, integrating them gracefully into the minutiae of our everyday lives. Immovable and unyielding, they remain reliant on our guidance, devoid of desire and intent, they remain exactly where we leave them, their functionality unchanging over time.

We retain the ultimate authority, able to discard them at will or, in today's context, simply power them down. Though they may occasionally foster irritation, largely they stand steadfast, loyal allies in our daily toils.

Thus we place our faith in tools, acknowledging that they are mere reflections of our own capabilities. In them, there is no entity to venerate or fault but ourselves, for they are but inert extensions of our own being, inanimate and steadfast, awaiting our command.
Read the article
×
2. The Machine
Category: Objects
Unlike a mere tool, the machine does not need the guidance of our hand, operating autonomously through its intricate network of gears and wheels. It achieves feats of motion that surpass the wildest human imaginations, harboring a power reminiscent of a cavalry of horses. Though it demands maintenance to replace broken parts and fix malfunctions, it mostly acts independently, allowing us to retreat and become mere observers to its diligent performance. We interact with it through buttons and handles, guiding its operations with minor adjustments and feedback as it works tirelessly. Embodying relentless purpose, laboring in a cycle of infinite repetition, the machine is a testament to human ingenuity manifested in metal and motion.
Read the article

About the author(s)

Fascinated by the interplay between technology and society, Sjoerd has studied the role of different actors in the innovation and implementation of new technologies throughout his career. At the thinktank, he is mainly involved in research and consultancy projects for clients, and strategic and thematic research for sister company Dasym. Among other themes, Sjoerd frequently writes and speaks about the power and danger of digital technology, as well as sustainability in both technological and institutional innovation.

You may also like