The Trolley Problem Goes to Silicon Valley

Ethics for the Autonomous Age

Pre-Reading Discussion

1. The Classic Dilemma

A runaway trolley will kill five people unless you pull a lever, diverting it to kill one person. Should you pull the lever? Why or why not?

2. Active vs. Passive

Does it matter whether you cause harm through action or inaction? Is letting five die different from actively killing one?

3. Programming Morality

Can we program ethical decision-making into machines? Should autonomous vehicles have programmed sacrificial protocols?

The Dilemma Becomes Algorithm

The trolley problem, conceived by philosopher Philippa Foot and subsequently elaborated by Judith Jarvis Thomson, constitutes one of ethics' most enduring pedagogical tools. The classical formulation presents an exquisite moral impasse: a runaway trolley hurtles toward five workers on the track. A bystander may pull a lever, diverting the trolley to an alternate track where it will kill a single worker. The problem proves philosophically generative because it isolates the variable of active versus passive harm, testing whether the distinction between commission and omission fundamentally alters moral calculation. The majority of respondents indicate willingness to pull the lever, suggesting that most moral intuitions privilege utilitarian calculus—maximizing lives saved—over the constraint against active killing.

Yet when the scenario mutates—the bystander must now push a large person off a bridge to stop the trolley—moral intuitions reverse, despite identical utilitarian mathematics. This variation, called "the footbridge problem," reveals that agents possess deep, often inarticulate commitments distinguishing direct bodily contact from remote leverage, immediate agency from instrumental consequence. Deontological frameworks grounded in rules and the categorical imperative suggest that using a person as mere means to save others violates a fundamental moral boundary, regardless of aggregate outcomes. The apparent contradiction between the lever case and the bridge case demonstrates that human moral cognition is not purely consequentialist; it incorporates incommensurable moral considerations.

The MIT Media Lab's Moral Machine project crowdsourced millions of responses to driving versions of the dilemma, from people in more than two hundred countries, and the results revealed striking cultural patterns. Respondents everywhere preferred to save more lives rather than fewer, and humans rather than animals. Beyond that, the clusters diverged: participants in many Asian countries showed a weaker preference for sparing the young over the old, while those in parts of Latin America showed a far stronger one. Some societies placed more weight on the social status of the people in the road than others. The data confute the assumption of universal moral intuitions, suggesting instead that culturally embedded frameworks deeply structure ethical judgment. Autonomous vehicle designers face an excruciating bind: programming cars to maximize lives saved might violate cultural values; programming cars to respect cultural preferences renders vehicles incapable of consistent decision-making across jurisdictions.

Perhaps the trolley problem's persistence as a philosophical construct indicates not its capacity to illuminate moral truth but rather the fundamental inadequacy of abstract principle to govern real-world ethical circumstances. Actual emergencies involve uncertainty, complexity, and morally relevant particularities absent from thought experiments. A self-driving car's decision tree cannot account for the specific individuals involved, their relationships, their moral histories. Yet we cannot leave such decisions to chance. The dilemma transcends the philosophical sphere, demanding that engineers, ethicists, and policymakers confront the uncomfortable reality that algorithms embodying any coherent principle will inevitably violate someone's moral framework.

Key Vocabulary

Pedagogical Related to teaching or education
Impasse A deadlock or situation in which no progress is possible
Generative Capable of producing or creating; productive
Calculus A system of calculation; in ethics, utilitarian computation of consequences
Deontological Ethical framework based on duties and rules rather than consequences
Categorical Imperative Kant's principle that one should act only on principles one could will as universal law
Incommensurable Unable to be compared or measured against a common standard
Confute To prove wrong; to refute convincingly

Multiple Choice Questions

Question 1

The trolley problem is valuable pedagogically because it:

A) has a clear correct answer that applies universally

B) isolates the moral distinction between active and passive harm

C) demonstrates the superiority of utilitarian ethics

D) applies directly to real-world emergency situations

Question 2

The reversal of moral intuitions in the footbridge problem suggests that:

A) people are generally irrational about ethics

B) utilitarian math is the only valid moral framework

C) humans have moral commitments beyond utilitarian calculation

D) pushing someone is always worse than pulling a lever

Question 3

The MIT Moral Machine project's findings about cultural differences in moral judgment imply that:

A) some cultures are more moral than others

B) moral intuitions are culturally embedded rather than universal

C) self-driving cars cannot be programmed in multicultural societies

D) East Asian ethics is superior to Western ethics

Question 4

The passage characterizes the "excruciating bind" faced by autonomous vehicle designers as:

A) a problem solvable through better engineering

B) an impossible conflict between utilitarian and cultural values

C) a minor technical issue

D) evidence that autonomous vehicles should be prohibited

Question 5

The final paragraph suggests that the trolley problem's enduring philosophical significance reveals:

A) that abstract principles cannot fully govern complex ethical circumstances

B) that there is no such thing as objective morality

C) that philosophy is irrelevant to real-world problems

D) that the problem should be abandoned by ethicists

Question 6

The passage uses the trolley problem to illustrate a broader challenge in algorithmic ethics: that

A) algorithms are more moral than humans

B) no coherent algorithm can satisfy all moral frameworks

C) self-driving cars require human pilots

D) ethics should not be programmed into machines

10:00

Discussion & Extension

Question 1: Real-World Complexity

The passage argues that actual emergencies involve "uncertainty, complexity, and morally relevant particularities" missing from thought experiments. Can abstract ethical frameworks ever be adequate for programming real-world decisions?

Question 2: Transparency and Opacity

Should autonomous vehicles have transparent, public ethical frameworks that users can know and potentially object to? Or should decision-making algorithms remain proprietary?

Question 3: Degrees of Harm

The trolley problem assumes binary outcomes (death or survival). How does uncertainty about consequences (probability of harm rather than certainty) change your ethical calculations?

Question 4: Beyond Utilitarian Calculation

If maximizing lives saved is morally insufficient, what other factors should autonomous systems consider? How would you program an algorithm to respect non-utilitarian values?

Speaking/Writing Task

Option A (Speaking): Design an ethical framework for autonomous vehicles that respects cultural diversity without becoming inconsistent across jurisdictions. Explain your reasoning.

Option B (Writing): Write a 400-word essay on whether the trolley problem remains relevant as a tool for understanding real-world ethical dilemmas in an age of algorithmic decision-making.