Nicole Badstuber and I have a chapter in this new open access book. It’s about public dialogue and learning from the European controversy around genetically modified crops.
An edited version of this review was published in the Guardian, 16 July 2020
Maurice Gatsonides was one of the world’s first professional rally drivers. He won the 1953 Monte Carlo rally, but made his fortune and his name with an invention that would torment other motorists. The Gatso was the first speed camera. Using a combination of flash photography, radar and road sensors, the machine was able to enforce speed limits more effectively than any traffic cop. Gatsonides himself lamented: “I am often caught by my own speed cameras and find hefty fines on my doormat. Even I can’t escape my own invention because I love speeding.” Ever since there have been speed limits, there have been attempts to evade them. The Automobile Association was created in 1905 specifically to warn motorists about speed traps. Speed cameras make our roads safer, and when we are caught it is almost always a fair cop, but they generate intense anger. During the gilets jaunes protests that began in 2018, more than 60% of France’s speed cameras were vandalised.
Matthew Crawford would have huge respect for Gatsonides, while despising his invention. Bruno Latour wrote that “no human is as relentlessly moral as a machine”. A speed camera brooks no argument, and Crawford loves to argue. In Why We Drive, he recalls being clocked doing 86mph on his motorbike in a 55 zone and explaining to the traffic cop how the laws of physics should trump arbitrary speed limits. He is delighted when the case reaches court and he can go full Atticus Finch. He imagines the judge’s delight at his presence: “What they rarely get in traffic court is an argument, or an attempt at rhetoric – the stuff that presumably made them want to go to law school.” He then declares, as though it was someone else’s fault: “A couple of months later, it happened again.”
Crawford’s project is to build a conservative philosophy of technology to meet what he calls “the challenge of remaining human against technologies that tend to enervate, and claim cultural authority in doing so”. Why We Drive follows his bestselling Shop Class as Soulcraft (published in the UK as The Case for Working with Your Hands) and The World Beyond Your Head in making the case for freedom in a technological society. This time, he takes aim at the new digital technologies that threaten his relationship with the old technologies he loves: cars and motorbikes. The book contains some terrific moments – an explanation of how human and machine contrived to crash two Boeing 737s; a description of the suck-squeeze-bang-blow four-stroke that happens a billion times in an engine’s life – but its big and important argument is muddied by the author’s prejudices.
The book’s middle is like being taken for a drive by a hyperactive, unreliable uncle. You’re going a way you don’t recognise and you’ve been told not to put on your seatbelt because seatbelts are for squares. As you cling to the sides of your seat, he takes you past a stock car rally, then an off-road race course in the desert. Just as you’re approaching something familiar, there’s a handbrake turn and off you go down a detour on the Nazis, a bit on utilitarianism, then a lesson on how to drift. He rolls down the window to shout something at some “bicycle moralists”. There is a merciless digression about rebuilding a VW Beetle and some of the author’s drawings of gears. His justification for all of this is what he calls “philosophical anthropology”, but its real purpose is to tell you what he approves of – mechanics, motorsports, motorbikes, the autobahn, real men and old-fashioned women – and what he doesn’t like: bicycles, the pencil pushers at the DMV, “safetyism” and the town of Portland, Oregon.
He is selective in his nostalgia and romanticises bits of the present that other freedom-loving individuals would object to. In his view, it’s fine to destroy speed cameras, but it’s not fine for grown-ups to ride bicycles. His description of the traffic in Rome having an “improvisation and flow that is beautiful to behold” suggests he has never tried to cross the road there. He admires London’s taxi drivers for their Knowledge and their enthusiasm for Brexit (see the subtitle, “take back control”) and mourns their slow death by GPS. (Just wait until the Brexiteers find out about the EU laws, which Britain has signed up to, mandating ‘intelligent speed assistance’ in new cars from 2022).
We do not have to see cabbies as heroes to critique Uber’s data-hoarding gig economy. Nor do we have to admire rule-breaking in general to see that some of the devices that constrain our driving are counterproductive. The “shared space” movement in Europe has been making the case for decades that roads need more uncertainty, not more rules, in order to slow down cars. Crawford would appreciate their motto – “unsafe is safe” – but he isn’t much interested in shared space. He wants his own space. If, as he argues, “the road is a place of mutual trust”, what should we think of a motorcyclist doing 86 through a 55mph speed limit?
On the road, individual freedoms do not add up to the public good. Traffic is a collective action problem, and individual risk assessments are notoriously unreliable. Crawford sees driving as a “skilled human activity” and would like more drivers to become as skilled and confident as he is. But “expert” drivers – the sort who palm the steering wheel as they reverse – are part of the problem, not least because they despise other drivers. A survey conducted by a Swedish researcher found that, of his compatriots, who are among the world’s safest drivers, 69% thought they were better than average drivers. In the US, where road death rates are more than four times Sweden’s, the figure was 93%.
The benefits of cars come with an extraordinary potential to do harm. We can be legitimately horrified that more than a million people a year die on the world’s roads, while being also surprised that most of us, most of the time, do not get into danger. Crawford hates what he calls the “safety industrial complex” that has taken all the joy out of driving. Here he is at odds with historians and activists such as Ralph Nader who have catalogued the US car industry’s opposition to regulations and safety innovations that aim to protect drivers from their own delusions.
Cars, for Crawford, are liberty: “The gas pedal and the steering wheel are wired directly to your will, via the seat of your pants, and there is no committee involved.” But it takes a lot of staging to maintain the performance of freedom. Driving, even in rural America, requires a byzantine arrangement of infrastructures and rules, in addition to the common sense that Crawford admires. The German philosopher Max Horkheimer wrote as long ago as 1947 that “It is as if the innumerable laws, regulations and directions with which we must comply were driving the car, not we.”
‘The gas pedal and the steering wheel are wired directly to your will, via the seat of your pants’ … Matthew Crawford Photograph: Colin McConnell/Toronto Star/Getty Images
Many of us do not share Crawford’s need for speed. We want our cars to be safe and we are slaves to, rather than masters of, this technology. Cars enable freedom of movement but they also homogenise our lives. So many of our lives and places are structured around the car and we collectively find it hard to build the alternative forms of mobility that would allow us to escape traffic, pollution and danger. Are self-driving cars the answer?
Crawford is understandably worried that the same tech companies that have taken over navigation, devaluing the cab drivers’ Knowledge overnight, are now coming for the rest of the world’s drivers. It’s not that simple. Having generated huge hype, self-driving evangelists are now starting to admit that their challenge is harder than they first made it seem. Teaching a computer to drive is not like teaching a computer to win at chess. However, there is a risk that, as with the car a hundred years ago, the rules of the road will eventually be changed to suit a new technology and, in doing so, will impede other ways of getting around. Freeing us from driving could require enormous digital infrastructures and monopolistic control. The people selling “autonomous vehicles” should heed, and be worried by, Crawford’s argument for autonomous people.
Car culture, as with many traditions invoked by conservatives, is a relatively recent invention, propped up by powerful industrial interests. Arguments against the claims of new technologies need not be as reactionary as Crawford’s. In the space between a souped-up vintage Beetle and a speculative self-driving Uber, we can imagine a range of progressive possibilities. Nostalgia may not be a good guide.
Warren Buffet once said that it’s only when the tide goes out that you see who’s swimming naked. It’s a phrase that is being repeated a lot at the moment, despite it being nonsensical: who swims until the tide goes out around them? Regardless, the gist is that a company that may be able to survive while the economy is rising will have its flaws revealed when a recession hits. Self-driving car companies have benefited from huge investments in the last five years or so. Covid and its accompanying recession are likely to lead to bankruptcies, consolidations and corporate fire sales. However, I wonder if Buffet’s maxim is holding. Maybe the companies that survive will not be those with the best swimwear, but those who are most self-confident, regardless of their nudity. (Sorry. The analogy may have already snapped). This could be bad for innovation and bad for local transport.
We have already seen the demise of Starsky Robotics, a company that was trying to make self-driving technology safe and effective in a well-defined context: trucks on big roads. Other companies are now feeling the heat. A recent Venturebeat piece describes some of the troubles faced by May Mobility, whose approach to AV innovation I have admired for a while.
A year ago, I took a train from Boston to Providence, Rhode Island to ride in one of May Mobility’s prototype self-driving shuttles. ‘Little Roady’ was a year-long collaboration with the Rhode Island Department of Transportation to provide a free shuttle running a five-mile, ten-stop lap of the town. The body of the vehicle was a sort of low-speed, electric stretch golf cart. The brain and the sensors were added by May Mobility with the hope of eventually enabling driverless transport.
The publicity describes this as an autonomous vehicle, with the person in the driving seat there to monitor things, talk to passengers and take over if needs be. The reality is more complicated. The two shuttles I tried – one out, one back – revealed plenty about the possibilities and the limits of self-driving technology.
Station to station
The shuttle stop is right outside the train station. I only have to wait a couple of minutes. The first shuttle is far from autonomous. Our driver stays in manual mode, steering the thing with its handlebars. She seems uninterested in pushing the envelope and is keen to talk about what the vehicle can’t yet do. It can’t turn across traffic and it can’t enter a road at a junction without traffic lights. A few hundred yards away from the train station, we have to stop because there’s a street parade. Self-driving car engineers call such things ‘edge cases’ – new experiences, unaccounted for in their model.
I hop off near Olneyville Square, get some lunch and take a wander. I check the web site to see when the next shuttle is on its way.
Shuttle two is a bit closer to the technological sublime. This driver lets me ride up front with him. He puts the car in ‘auto’ and shows me the little green ‘A’ lighting up on his screen. He says the aim is to keep it in auto as much as possible, to train as well as test the machine. The company is hungry for data, not least to show the Rhode Island department of transportation how well they’re doing.
When we come to a four-way stop junction, he doesn’t have to take over. He tells me that the sensors can see the other cars’ indicators. The computer identifies a gap and the vehicle takes its opportunity with aplomb. He admits that the system finds things easier in light Saturday traffic. Maybe the four-way stop would have been trickier in rush hour.
He says the system is getting better all the time. It used to overreact when someone was tailgating or be disabled when a road sign was partly obscured by a tree branch. He says it still isn’t great with bicycles. The last bit of the loop was covered in roadworks, so the driver switches to manual before we get there.
Just as we approach the train station, which marks the end of the loop, a picture of red traffic light appears on screen. I ask whether the vehicle sees the colour or detects it in some other way. The driver points to a box on a lamppost that transmits the signal from the light to the vehicle. ‘Autonomous’ vehicles, we should remember, are never completely autonomous.
Learning by doing
The Little Roady pilot has been cut short by Covid. This is a shame, as it seemed to be a genuine public experiment. In many cases, ‘trials’ of self-driving vehicles are not real tests of the technology; they are tests of public acceptance or just public displays of a technology. If failure is not an option, then little can be learnt. Other companies have tightly choreographed their ‘trials’, protecting them from technical and social complexity with safety marshals for pedestrians or non-disclosure agreements for passengers. (Noortje Marres and Declan Mcdowell-Naylor have been studying the sociology of self-driving car trials).
May Mobility were trying something different. They were trying to see if they could make an early technology work in the real world, for a real use case, with real people. No good deed, it seems, goes unpunished. The company found that some of its most frustrating glitches were with old rather than new tech. In hot weather the shuttles’ air conditioning had problems and in cold weather their batteries failed. Venturebeat criticised May for targetting “fixed-route transportation needs in geofenced, easily mappable business districts, campuses, and closed residential communities.” The criticism that “not a single one of the company’s commercial routes approached full autonomy” prompts us to ask what would count as “full autonomy”. May was attempting to serve two masters: a local transportation service with a set of requirements about air conditioning and a Wizard of Oz public discourse about autonomous vehicles. At some point, other companies will face similar reckonings. For now, however, I worry that companies will take the wrong lesson from May Mobility and keep telling grand stories rather than trying modest experiments.
I was once in a band called ‘It’s a Race!’ The daft name seemed to fit. It captured the carefree pointlessness of our music. We were guilty of some of the worst jam-band excesses. Our improvised, 10-minute songs could not cover for our lack of rehearsal or musical mediocrity. We didn’t know where we were going. To say we split up due to artistic differences is to give us too much credit.
A lot of self-driving car journalism uses the metaphor of a ‘race’. In a recent episode of the Autonocast, Ed Niedermeyer (a recent and welcome addition to Partners for Automated Vehicle Education) calls it horse-race journalism. He is rightly critical of this style. There is no point talking about a race if we don’t know where the finish line is.
Niedermeyer’s target is a recent Bloomberg piece on the “The State of the Self-Driving Car Race 2020”. This gets off to a bad start, with an analogy to the space race and a quote from a consultant:
I mean, it’s literally like putting somebody on the moon. It’s that complex
It literally isn’t like putting somebody on the moon. Putting somebody on the moon, ironically, was not rocket science. That problem was hard, but it was not complex. According to Brenda Zimmerman and colleagues, some problems are simple, like following a recipe; some are complicated, like rocketry; others, like raising a child, are complex. The easy things about putting a person on the moon were that most people agreed on what success would look like and that there was nothing in the way. The hard thing – how to take an object containing a person such a vast distance and bring it back – could be solved with enough brains and enough money. Many terrestrial problems, including climate change, obesity and mobility, are wicked. Their is little agreement on the definition of problems, approaches or metrics for success and there are lots of organisations, interests and structures standing in the way.
For systems comprising self-driving cars to work effectively, safely and fairly in a range of different places, much of what needs to happen lies beyond the control of the competitors in the self-driving car ‘race’. This is one reason why the technology’s success will take far longer than the hype currently suggests.
The trouble with the Bloomberg piece, as with so much self-driving car journalism, is that it presumes the finish line is clear. If we are to make good decisions about this technology, we must first recognise that there are many different possible directions. We need to start talking about the desirable directions and working out how to bend current approaches to fit.
On April 8th 2020, ICTC (the Canadian Information and Communications Technology Council) spoke with Dr. Jack Stilgoe, Senior Lecturer in the Department of Science & Technology Studies at University College London, where he researches and teaches the governance of emerging technologies. Dr. Stilgoe is the Principal Investigator of the Driverless Futures? Project, a three-year social science project looking at the governance of self-driving cars.
This article was originally published by Pando Daily
New technologies do not just change the world on their own. They need users, they need infrastructures and they need a lot of political support.
The invention of driving
At the Victoria and Albert Museum in London, in the middle of an exhibition on car culture, sits a grid of sepia photographs from the early Twentieth Century. The pictures, taken by travelling salesmen from Michelin, show places from Cape Town to Clermont-Ferrand (the company’s home town). Some are of smooth highways. Others show tracks dotted with potholes and boulders.
In 1921 André Michelin and his brother Édouard had turned their expertise in bicycle tires towards the motor car, a technology that was exploding in popularity. The Michelin Roulement Universale was a tire designed to be sold around the world, but the world’s roads were of varying quality. Their road photography project was an exercise in market research, but it was also an act of lobbying. Michelin wanted improvements to the world’s highways, and they wanted them fast.
The Michelin brothers were never just rubbersmiths. While Edouard managed the practical side of the business, André handled the public relations. For French motorists and people the world over, they did something more profound than invent tires; they invented the road trip. Andre’s genius was to manufacture demand for the technology that would take his company forward. According to the historian Georges Ribeill, it was André who “first understood the technical system of the automobile which was to result from the “automobile revolution,” and of which tires were only one of the elementary working parts.” This system included the machines, fuel, maps, road networks, habits and rules that would allow for the dramatic expansion in people’s horizons in the early Twentieth Century. In 1900, André created the guide that would make his company famous and become the yardstick against the world’s restaurants were judged. Even though there were fewer than 3,000 automobiles in the whole of France at the time, 35,000 Michelin guides were produced and handed out for free. The company made the first civilian maps and gave away route guides to motorists and road signs to local road-builders. Michelin did more than anyone to standardise the world’s roads and make driving what it is today.
100 years on, we are told that we are on the brink of a new transport revolution. The hype surrounding self-driving cars is huge, and there is investment to match. The aim is to solve a problem that bedevils transport: humans. Humans are inefficient, easily distracted and accident prone. The self-driving car will, we are told, bring efficient, convenient and safe travel to all. Waymo is aiming to build the ‘World’s Most Experienced Driver’ using artificial intelligence. The UK start-up Oxbotica is promising ‘Universal Autonomy’. In 2017, Tesla customers could pay an extra $8,000 for ‘Full self-driving capability’ in their new cars, based on Elon Musk’s promise that, by the end of the year, a Tesla would be able to drive ‘from a parking lot in California to a parking lot in New York, no controls touched at any point during the entire journey’. Three years on, ‘Full Self-Driving’ and the promised coast-to-coast drive seem even less realistic than they did in 2017. If policymakers do not approach such hype with due scepticism, it could lead to some decisions that exacerbate rather than solve the problems of car dependence.
The invention of jaywalking
New technologies do not just change the world on their own. They need users, they need infrastructures and they need a lot of political support. The historian Peter Norton has explained how, in the early Twentieth Century, streets in American cities were systematically given over to motor cars. Infrastructure such as traffic lights was introduced to regulate the movements of road users. Pedestrians were compelled or persuaded away from roads except in designated crosswalks. Public transit schemes were excised or allowed to atrophy. The world was upgraded, at great cost, to suit a technology that promised everything. A trade magazine at the dawn of the motor age repeated some of the claims:
‘Streets will be cleaner, jams and blockades less likely to occur, and accidents less frequent, for the horse is not so manageable as a mechanical vehicle.’
The Horseless Age, 1896
The benefits were admittedly huge. Motor cars were transformative across the social spectrum. But the costs were only realised later. Some places became dependent upon, and defined by, the motor car. Realisation of the costs of technology – hazards, congestion and pollution as well as the wider effects on the places and ways in which people live – lagged behind excitement about the benefits. Norton gives us a warning from history: ‘If we rebuild the landscape for autonomous vehicles, we may make it unsuitable for anything else — including walking.’
The reinvention of the self-driving car
Proponents of new technologies get attention by making promises. In some places, the promise of the self-driving car is already proving to be compelling. In 2017, Nashville voters took against one light rail and bus scheme following a campaign by libertarians and tech enthusiasts. Nashville Council member Robert Swope said some months before the key vote:
‘In 15 years, no one will own a car anymore… I can show you places around this world I have been to where Level 5 autonomous vehicles are in operation today… Why are we not embracing this?’
‘Level 5’ refers to a self-driving car that can operate autonomously in any circumstances. They do not exist and, if we take the definition literally, never will. Nevertheless, Swope advocated ‘autonomous vehicle systems that will replace the need for large, costly mass transportation’ with little consideration of what else would be required. In Florida, Republican state senator Jeff Brandes has claimed self-driving cars will make buses and trains obsolete in a matter of years, saying, ‘It’s like they’re designing the pony express in the world of the telegraph.’
As the claims surrounding new technologies start to be believed, a switch typically happens. Promises become demands. The people selling technologies initially promise to change the world without changing the world. They then admit that, if the technology’s potential is to be realised, the world will need to adapt.
In the case of the motor car, this meant jaywalking laws, traffic lights, car parks and interstates. For the self-driving car, it could mean dedicated lanes, digital high definition maps, smart infrastructure and new rules for pedestrians. The story currently being told by self-driving car developers downplays these aspects. The car, we are told, will be smart so that the world around it does not have to be; artificial intelligence will do everything a human driver can do and more. This story, which David Mindell calls the “myth of autonomy”, will, if swallowed whole, lead to some bad decisions. Unless we understand the full self-driving car system, the rules being created by today’s algorithms could become tomorrow’s rules of the road.
2020 could be the year that hype comes back to bite the developers of self-driving cars. After a flurry of excitement, start-ups are starting to admit that the task is harder than they thought. This is partly because they were focussing on narrow questions of software and intentionally not asking the difficult questions about how other road users, highway engineers, police officers and citizens might need to adapt to a self-driving future. Tech developers should not just be left to their own devices. Policymakers urgently need to find ways to democratise the development of self-driving cars.
Following our workshop in London before Christmas, we are now planning a special issue of the open access social science journal Palgrave Communications focussed on the politics of autonomous vehicles.
The politics of autonomous vehicles
Editors: Dr Jack Stilgoe (Science and Technology Studies, University College London) and Dr Milos Mladenovic (Department of Built Environment, Aalto University)
‘Self-driving’, ‘driverless’ or ‘autonomous’ vehicles promise to change the world in profound ways. The suggested benefits include safety, efficiency, accessibility and improved urban environments. However, researchers and others have been quick to raise questions about responsibility for crashes, safe testing and possible wider ramifications for transport systems. In a discussion that has been dominated by science, engineering and narrow questions of ethics, there is a need to draw attention to the old questions of politics: Who wins? Who loses? Who decides? Who pays?
This collection (special issue) will publish original research that helps anticipate the politics of autonomous vehicles. The focus could be on the road, where vehicles are being tested and interactions with other road users are being worked out, on the lab, where rapid developments in machine learning and simulation are generating new possibilities, on discourses about possible and desirable futures, or somewhere else.
Despite the ‘autonomous vehicle’ terminology, these technologies, when considered through social science lenses, look far from autonomous. They will be shaped by human interests and expectations, and future sociotechnical systems will be entangled in social worlds (infrastructures, rules, norms, behaviours, institutions and more) in complex and possibly unpredictable ways.
We invite contributions from researchers on the following themes as they relate to self-driving vehicles:
- Infrastructures of ‘autonomy’
- Connectivity and sociotechnical systems
- Algorithms and AI
- Data ownership, control and privacy
- The rules of the road
- Public vs private control
- Patterns of transport use, e.g. shared, active etc.
- Competing for road space
- Urban design, including ‘shared space’
- Lessons from other mobility technologies
- Histories of self-driving futures
- Testing AV technologies
- Sustainable technological transitions
- Participation and democratic governance
This article collection is an initiative of the UKRI Driverless Futures? project.
Prospective authors should submit a 200-word abstract and a short biography to the Collection Editors in the first instance. Authors whose proposals are deemed suitable will be invited to submit full papers at any point up until the end of June 2021.
John Thornhill, the FT’s tech editor, has a comment piece today on trust in AI, discussing the recent NTSB investigation of the latest Tesla Autopilot crash. He starts by quoting NTSB chair Robert Summwalt:
“The lessons from this investigation are as much about people as they are about the limitations of emerging technologies,”
He then mentions my argument that “advances in machine learning must be accompanied by social learning.” Even though my new book is pretty short, he makes the argument far more concise than I could manage:
…what is essential, he suggests, is to create a collective societal capacity to understand emerging technologies and decide on the appropriate regulatory framework. We cannot leave all this to powerful private corporations.
I’ve just published a new book with Palgrave. It’s a short, provocative introduction to debates about new technologies, which takes self-driving cars as its case study. It’s available here, and I would love to know what readers think of it.
Free Thinking on Radio 3 is a great indulgence – an opportunity for long-form conversation, steered by expert broadcasters. I’ve been fortunate to appear twice recently. First, in a programme on cars, parking and motorways; second, in a discussion of whether Isaac Asimov’s psychohistory might help us understand the current enthusiasm for data and AI.