1 # SOME DESCRIPTIVE TITLE
2 # Copyright (C) YEAR Cory Doctorow
3 # This file is distributed under the same license as the How to Destroy Surveillance Capitalism package.
4 # FIRST AUTHOR <EMAIL@ADDRESS>, YEAR.
8 "Project-Id-Version: How to Destroy Surveillance Capitalism n/a\n"
9 "POT-Creation-Date: 2020-09-07 22:34+0200\n"
10 "PO-Revision-Date: 2020-09-20 22:04+0000\n"
11 "Last-Translator: Petter Reinholdtsen <pere-weblate@hungry.com>\n"
12 "Language-Team: Norwegian Bokmål <https://hosted.weblate.org/projects/"
13 "rms-personal-data-safe/how-to-destroy-surveillance-capitalism/nb_NO/>\n"
16 "Content-Type: text/plain; charset=UTF-8\n"
17 "Content-Transfer-Encoding: 8bit\n"
18 "Plural-Forms: nplurals=2; plural=n != 1;\n"
19 "X-Generator: Weblate 4.3-dev\n"
21 #. type: Attribute 'lang' of: <book>
25 #. type: Content of: <book><chapter><title>
26 msgid "How to Destroy Surveillance Capitalism"
27 msgstr "Hvordan knuse overvåkningskapitalismen"
29 #. type: Content of: <book><bookinfo><authorgroup><author><firstname>
33 #. type: Content of: <book><bookinfo><authorgroup><author><surname>
37 #. type: Content of: <book><bookinfo><publisher><address>
39 msgid "<city>Oslo</city>"
40 msgstr "<city>Oslo</city>"
42 #. type: Content of: <book><bookinfo>
44 "<publisher> <publishername>Petter Reinholdtsen</publishername> <placeholder "
45 "type=\"address\" id=\"0\"/> </publisher> <copyright> <year>2020</year> "
46 "<holder>Petter Reinholdtsen</holder> </copyright>"
48 "<publisher> <publishername>Petter Reinholdtsen</publishername> <placeholder "
49 "type=\"address\" id=\"0\"/> </publisher> <copyright> <year>2020</year> "
50 "<holder>Petter Reinholdtsen</holder> </copyright>"
52 #. type: Content of: <book><bookinfo><legalnotice><para>
53 msgid "How to Destroy Surveillance Capitalism by Cory Doctorow."
54 msgstr "Hvordan knuse overvåkningskapitalismen av Cory Doctorow."
56 #. type: Content of: <book><bookinfo><legalnotice><para>
57 msgid "Published by Petter Reinholdtsen."
58 msgstr "Gitt ut av Petter Reinholdtsen."
60 #. type: Content of: <book><bookinfo><legalnotice><para><inlinemediaobject>
62 "<imageobject> <imagedata fileref=\"images/cc.png\" contentdepth=\"3em\" "
63 "width=\"100%\" align=\"center\"/> </imageobject> <imageobject> <imagedata "
64 "fileref=\"images/cc.svg\" contentdepth=\"3em\" width=\"100%\" align=\"center"
67 "<imageobject> <imagedata fileref=\"images/cc.png\" contentdepth=\"3em\" "
68 "width=\"100%\" align=\"center\"/> </imageobject> <imageobject> <imagedata "
69 "fileref=\"images/cc.svg\" contentdepth=\"3em\" width=\"100%\" align=\"center"
72 #. type: Content of: <book><bookinfo><legalnotice><para><inlinemediaobject><textobject><phrase>
73 msgid "Creative Commons, Some rights reserved"
74 msgstr "Creative Commons, noen rettigheter forbeholdt"
76 #. type: Content of: <book><bookinfo><legalnotice><para>
77 msgid "<placeholder type=\"inlinemediaobject\" id=\"0\"/>"
78 msgstr "<placeholder type=\"inlinemediaobject\" id=\"0\"/>"
80 #. type: Content of: <book><bookinfo><legalnotice><para>
82 "This book is licensed under a Creative Commons license. This license permits "
83 "any use of this work, so long as attribution is given and no derivatived "
84 "material is distributed. For more information about the license visit "
85 "<ulink url=\"https://creativecommons.org/licenses/by-nd/4.0/\"/>."
87 "Denne boken er lisensiert med en Creative Commons-lisens. Denne lisensen "
88 "tillater all bruk av dette arbeidet, så lenge opphavet navngis og intet "
89 "avledet materiale distribueres. Hvis du vil ha mer informasjon om lisensen, "
90 "besøk <ulink url=\"https://creativecommons.org/licenses/by-nd/4.0/\"/>."
92 #. type: Content of: <book><bookinfo><legalnotice><para>
93 msgid "ISBN 978-82-93828-05-1 (hard cover)"
94 msgstr "ISBN 978-82-93828-05-1 (innbundet)"
96 #. type: Content of: <book><bookinfo><legalnotice><para>
97 msgid "ISBN 978-82-93828-06-8 (paperback)"
98 msgstr "ISBN 978-82-93828-06-8 (heftet)"
100 #. type: Content of: <book><bookinfo><legalnotice><para>
101 msgid "ISBN 978-82-93828-07-5 (ePub)"
102 msgstr "ISBN 978-82-93828-07-5 (ePub)"
104 #. type: Content of: <book><chapter><sect1><title>
105 msgid "The net of a thousand lies"
106 msgstr "Nettverket av tusen løgner"
108 #. type: Content of: <book><chapter><sect1><para>
110 "The most surprising thing about the rebirth of flat Earthers in the 21st "
111 "century is just how widespread the evidence against them is. You can "
112 "understand how, centuries ago, people who’d never gained a high-enough "
113 "vantage point from which to see the Earth’s curvature might come to the "
114 "commonsense belief that the flat-seeming Earth was, indeed, flat."
116 "Den mest overraskende momentet med tilbakekomsten av flatjordtilhengere i "
117 "det 21. århundre er hvor viden tilgjengelig bevisene mot dem er. En kan "
118 "forstå hvordan folk, for noen århundrer siden, som aldri hadde tilgang på et "
119 "høyt nok utsiktspunkt til å se jordens krumning, kunne ende opp med en "
120 "rimelig fornuftig tro på at den tilsynelatende flate jorden, rent faktisk "
123 #. type: Content of: <book><chapter><sect1><para>
125 "But today, when elementary schools routinely dangle GoPro cameras from "
126 "balloons and loft them high enough to photograph the Earth’s curve — to say "
127 "nothing of the unexceptional sight of the curved Earth from an airplane "
128 "window — it takes a heroic effort to maintain the belief that the world is "
131 "Men idag, når grunnskoler rutinemessig henger GoPro-kamera fra ballonger og "
132 "sender dem høyt nok til å fotografere jordens krumning, for ikke å snakke om "
133 "det lite eksepsjonelle synet av en krummet jord fra vinduet på et fly. Det "
134 "kreves en heroisk innsats for å holde på troen om at jorden er flat."
136 #. type: Content of: <book><chapter><sect1><para>
138 "Likewise for white nationalism and eugenics: In an age where you can become "
139 "a computational genomics datapoint by swabbing your cheek and mailing it to "
140 "a gene-sequencing company along with a modest sum of money, <quote>race "
141 "science</quote> has never been easier to refute."
143 "På samme måten er det med hvit nasjonalisme og eugenikk. I en tidsalder der "
144 "du kan bli et datamaskinberegnet genomdatapunkt ved å sveipe innsiden av "
145 "munnhulen og sende resultatet til et gensekvensieringsselskap sammen med en "
146 "beskjeden sum penger, så har <quote>rasevitenskap</quote> aldri vært enklere "
149 #. type: Content of: <book><chapter><sect1><para>
151 "We are living through a golden age of both readily available facts and "
152 "denial of those facts. Terrible ideas that have lingered on the fringes for "
153 "decades or even centuries have gone mainstream seemingly overnight."
155 "Vi lever i en gullalder både med hensyn til enkel faktatilgang og "
156 "fornektelse av dem. Forferdelige idéer som har svevd i utkanten i tiår eller "
157 "til og med århundrer har blitt allemannseie tilsynelatende over natten."
159 #. type: Content of: <book><chapter><sect1><para>
161 "When an obscure idea gains currency, there are only two things that can "
162 "explain its ascendance: Either the person expressing that idea has gotten a "
163 "lot better at stating their case, or the proposition has become harder to "
164 "deny in the face of mounting evidence. In other words, if we want people to "
165 "take climate change seriously, we can get a bunch of Greta Thunbergs to make "
166 "eloquent, passionate arguments from podiums, winning our hearts and minds, "
167 "or we can wait for flood, fire, broiling sun, and pandemics to make the case "
168 "for us. In practice, we’ll probably have to do some of both: The more we’re "
169 "boiling and burning and drowning and wasting away, the easier it will be for "
170 "the Greta Thunbergs of the world to convince us."
172 "Når obskure idéer får fotfeste, er det kun to ting som kan forklare at de "
173 "kommer til overflaten: Enten har personen som uttrykker idéen forbedret sin "
174 "formidling av den, eller så har forgodtbefinnendet blitt vanskeligere å "
175 "fornekte i lys av mer bevis. Med andre ord, hvis vi ønsker at folk skal ta "
176 "klimaendringer seriøst, kan vi få et utall Greta Thunberg til å gi "
177 "velformulerte, oppofrende argumenter fra talerstoler, til hjertets og "
178 "sinnets dyst, eller vi kan vente på floden, den stekende sol, og pandemier "
179 "lager argumentene for oss. I praksis må vi antagelig gjøre litt av begge "
180 "deler: Desto mer vi steker, brenner, drukner og forvitrer, dess enklere vil "
181 "det være for dem av oss som Greta Thunberg å overbevise oss."
183 #. type: Content of: <book><chapter><sect1><para>
185 "The arguments for ridiculous beliefs in odious conspiracies like anti-"
186 "vaccination, climate denial, a flat Earth, and eugenics are no better than "
187 "they were a generation ago. Indeed, they’re worse because they are being "
188 "pitched to people who have at least a background awareness of the refuting "
191 "De iboende argumentet for ting som eksempelvis teorien om flat jord har ikke "
192 "blitt bedre i den vordende generasjonen. Faktisk har ting blitt verre, fordi "
193 "folk uten bakgrunn i kildekritikk er gjenstand for dem."
195 #. type: Content of: <book><chapter><sect1><para>
197 "Anti-vax has been around since the first vaccines, but the early anti-"
198 "vaxxers were pitching people who were less equipped to understand even the "
199 "most basic ideas from microbiology, and moreover, those people had not "
200 "witnessed the extermination of mass-murdering diseases like polio, smallpox, "
201 "and measles. Today’s anti-vaxxers are no more eloquent than their forebears, "
202 "and they have a much harder job."
204 "Idéen om en flat jord er like gammel som idéene og forståelsen av dem. De "
205 "første presentasjonene av denne teorien kom folk for øre som ikke forstod "
206 "selv grunnleggende geometri. De hadde til gode å se tilbake på det "
207 "heliosentrikere og storsirkelnavigasjon bragte siden. Dagens tilhengere er "
208 "mer finslepne enn tidligere tiders religiøse verdensanskuelse, og de har en "
209 "mye vanskeligere jobb."
211 #. type: Content of: <book><chapter><sect1><para>
213 "So can these far-fetched conspiracy theorists really be succeeding on the "
214 "basis of superior arguments?"
216 "Er det tilfelle at disse konspiratorikerne lykkes med utgangspunkt i bedre "
219 #. type: Content of: <book><chapter><sect1><para>
221 "Some people think so. Today, there is a widespread belief that machine "
222 "learning and commercial surveillance can turn even the most fumble-tongued "
223 "conspiracy theorist into a svengali who can warp your perceptions and win "
224 "your belief by locating vulnerable people and then pitching them with A.I.-"
225 "refined arguments that bypass their rational faculties and turn everyday "
226 "people into flat Earthers, anti-vaxxers, or even Nazis. When the RAND "
227 "Corporation <ulink url=\"https://www.rand.org/content/dam/rand/pubs/"
228 "research_reports/RR400/RR453/RAND_RR453.pdf\">blames Facebook for "
229 "<quote>radicalization</quote></ulink> and when Facebook’s role in spreading "
230 "coronavirus misinformation is <ulink url=\"https://secure.avaaz.org/campaign/"
231 "en/facebook_threat_health/\">blamed on its algorithm</ulink>, the implicit "
232 "message is that machine learning and surveillance are causing the changes in "
233 "our consensus about what’s true."
235 "Noen synes å tro det. I dag er troen hengitt at maskinlæring og kommersiell "
236 "overvåkning kan gjøre selv en konspirasjonsteoretiker uten taleevner til "
237 "trådtrekker med KI-refinerte argumenter som verktøy til et omvendt "
238 "dukketeater som omgår alle kritiske fakulteter. Når RAND <ulink url=\"https"
239 "://www.rand.org/content/dam/rand/pubs/research_reports/RR400/RR453/RAND_RR453"
240 ".pdf\">beskylder Facebook for <quote>radikalisering</quote></ulink> og når "
241 "Facebook sin rolle i å spre coronavirus-misinformasjon <ulink url=\"https"
242 "://secure.avaaz.org/campaign/en/facebook_threat_health/\"> blir bortforklart "
243 "i deres algoritme</ulink>, er det underforstått at maskinlæring og "
244 "overvåkning endrer vår oppfattelse av hva som sant er."
246 #. type: Content of: <book><chapter><sect1><para>
248 "After all, in a world where sprawling and incoherent conspiracy theories "
249 "like Pizzagate and its successor, QAnon, have widespread followings, "
250 "<emphasis>something</emphasis> must be afoot."
252 "I en verden der enhver konspirasjonsteori har sine ihuga tilhengere, må "
253 "<emphasis>noe</emphasis> være i gjerde."
255 #. type: Content of: <book><chapter><sect1><para>
257 "But what if there’s another explanation? What if it’s the material "
258 "circumstances, and not the arguments, that are making the difference for "
259 "these conspiracy pitchmen? What if the trauma of living through "
260 "<emphasis>real conspiracies</emphasis> all around us — conspiracies among "
261 "wealthy people, their lobbyists, and lawmakers to bury inconvenient facts "
262 "and evidence of wrongdoing (these conspiracies are commonly known as "
263 "<quote>corruption</quote>) — is making people vulnerable to conspiracy "
266 "Hva om det har sin naturlige forklaring? Er det kanskje ikke argumentene som "
267 "utgjør tyngden på vektskåla for dem? Hva om <emphasis>de ekte "
268 "konspirasjonene</emphasis> vi omgås hvordan det daglige stormaktsspillet og "
269 "i kapitalerværvelsen mellom fut og fogd gravlegger ubeleilig fakta og bevis "
270 "på mislighold? Slike ting som i beste fall kalles korrupsjon, gjør de folk "
271 "sårbare for fiktive konspirasjonsteorier?"
273 #. type: Content of: <book><chapter><sect1><para>
275 "If it’s trauma and not contagion — material conditions and not ideology — "
276 "that is making the difference today and enabling a rise of repulsive "
277 "misinformation in the face of easily observed facts, that doesn’t mean our "
278 "computer networks are blameless. They’re still doing the heavy work of "
279 "locating vulnerable people and guiding them through a series of ever-more-"
280 "extreme ideas and communities."
282 "Hvis det er slagskade og ikke smitte – materielle forhold og ikke ideologi – "
283 "som utgjør forskjellen i dag og gjør økningen i frastøtende feilinformasjon "
284 "mulig, i møte med lett observerte fakta, så betyr det ikke at "
285 "datanettverkene vår ikke kan lastes. De gjør fortsatt grovarbeidet med å "
286 "spore opp sårbare mennesker og lede dem gjennom en rekke av stadig mer "
287 "ekstreme ideer og lokalsamfunn."
289 #. type: Content of: <book><chapter><sect1><para>
291 "Belief in conspiracy is a raging fire that has done real damage and poses "
292 "real danger to our planet and species, from epidemics <ulink url=\"https://"
293 "www.cdc.gov/measles/cases-outbreaks.html\">kicked off by vaccine denial</"
294 "ulink> to genocides <ulink url=\"https://www.nytimes.com/2018/10/15/"
295 "technology/myanmar-facebook-genocide.html\">kicked off by racist "
296 "conspiracies</ulink> to planetary meltdown caused by denial-inspired climate "
297 "inaction. Our world is on fire, and so we have to put the fires out — to "
298 "figure out how to help people see the truth of the world through the "
299 "conspiracies they’ve been confused by."
301 "Troen på fiktive konspirasjoner har gjort skade og utgjør en fare for "
302 "planeten. Fornektelse av kunstig vaksinasjon kan medføre epidimier, og "
303 "rasisme fører gjerne til folkemord. Det kan tenkes man kan hjelpe folk å se "
304 "sannheten gjennom konspirasjonsteoriene de har blitt forvirret av."
306 #. type: Content of: <book><chapter><sect1><para>
308 "But firefighting is reactive. We need fire <emphasis>prevention</emphasis>. "
309 "We need to strike at the traumatic material conditions that make people "
310 "vulnerable to the contagion of conspiracy. Here, too, tech has a role to "
313 "Brannslokking er reaksjonært. Det trengs <emphasis>forebygging</emphasis>. "
314 "Den materielle tilværelsen hvis innvirken på folks svakhet for den, smitter "
315 "over i handling. Her kan også teknologi ha noe å si."
317 #. type: Content of: <book><chapter><sect1><para>
319 "There’s no shortage of proposals to address this. From the EU’s <ulink url="
320 "\"https://edri.org/tag/terreg/\">Terrorist Content Regulation</ulink>, which "
321 "requires platforms to police and remove <quote>extremist</quote> content, to "
322 "the U.S. proposals to <ulink url=\"https://www.eff.org/deeplinks/2020/03/"
323 "earn-it-act-violates-constitution\">force tech companies to spy on their "
324 "users</ulink> and hold them liable <ulink url=\"https://www.natlawreview.com/"
325 "article/repeal-cda-section-230\">for their users’ bad speech</ulink>, "
326 "there’s a lot of energy to force tech companies to solve the problems they "
329 "Det skorter ikke på tilsvarsforslag. Fra EU sin <ulink url=\"https://edri."
330 "org/tag/terreg/\">Terroristinnhold-regulering</ulink> som krever at "
331 "plattformer håndhever og fjerner <quote>ekstremistisk</quote>-innhold, til "
332 "USAs forslag om å <ulink url=\"https://www.eff.org/deeplinks/2020/03/earn-it-"
333 "act-violates-constitution\">tvinge teknologiselskaper til å spionere på sine "
334 "brukere</ulink> og holde dem ansvarlige <ulink url=\"https://www.natlawreview"
335 ".com/article/repeal-cda-section-230\">for brukernes ytringsfrihet</ulink>. "
336 "Det er mange krefter i sving som kan svinge tilbake slik at "
337 "teknologiselskaper må løse problemene de utgjør."
339 #. type: Content of: <book><chapter><sect1><para>
341 "There’s a critical piece missing from the debate, though. All these "
342 "solutions assume that tech companies are a fixture, that their dominance "
343 "over the internet is a permanent fact. Proposals to replace Big Tech with a "
344 "more diffused, pluralistic internet are nowhere to be found. Worse: The "
345 "<quote>solutions</quote> on the table today <emphasis>require</emphasis> Big "
346 "Tech to stay big because only the very largest companies can afford to "
347 "implement the systems these laws demand."
349 "Her mangler en kritisk del av debatten. Alle disse løsningene antar at "
350 "teknologiselskaper er en bruksgjenstand, at deres dominanse over Internett "
351 "er evig. Forslag til endring av storteknologien til et mer finmasket, "
352 "mangeslynget Internett lar vente på seg. <quote>Løsningene</quote> som "
353 "forefinnes <emphasis>krever</emphasis> at storteknologien skal forbli "
354 "storartet smålig, fordi kun de største selskapene får råd til å sette i verk "
355 "systemene disse lovene krever."
357 #. type: Content of: <book><chapter><sect1><para>
359 "Figuring out what we want our tech to look like is crucial if we’re going to "
360 "get out of this mess. Today, we’re at a crossroads where we’re trying to "
361 "figure out if we want to fix the Big Tech companies that dominate our "
362 "internet or if we want to fix the internet itself by unshackling it from Big "
363 "Tech’s stranglehold. We can’t do both, so we have to choose."
365 "Løsningen på hva teknologien skal være er svaret på hva som skal til for å "
366 "komme oss ut av knipa. I dag er vi på perrongen og prøver å finne ut hva "
367 "tabellen storteknologien har lagt fore skal bety for vårt Internett i "
368 "fortsettelsen, eller om det går noen tog andre veien. Enveisbilletten har vi "
371 #. type: Content of: <book><chapter><sect1><para>
373 "I want us to choose wisely. Taming Big Tech is integral to fixing the "
374 "internet, and for that, we need digital rights activism."
376 "Velg med omhu. Temming av storteknologien er iboende viktig for løsningen på "
377 "Internett. Hvorfra vi setter ut i det, en digital rettighetsaktivisme til."
379 #. type: Content of: <book><chapter><sect1><title>
380 msgid "Digital rights activism, a quarter-century on"
381 msgstr "Digital rettighetsaktivisme, et kvart århundre senere"
383 #. type: Content of: <book><chapter><sect1><para>
385 "Digital rights activism is more than 30 years old now. The Electronic "
386 "Frontier Foundation turned 30 this year; the Free Software Foundation "
387 "launched in 1985. For most of the history of the movement, the most "
388 "prominent criticism leveled against it was that it was irrelevant: The real "
389 "activist causes were real-world causes (think of the skepticism when <ulink "
390 "url=\"https://www.loc.gov/law/foreign-news/article/finland-legal-right-to-"
391 "broadband-for-all-citizens/#:~:text=Global%20Legal%20Monitor,-Home%20%7C"
392 "%20Search%20%7C%20Browse&text=(July%206%2C%202010)%20On,connection"
393 "%20100%20MBPS%20by%202015.\">Finland declared broadband a human right in "
394 "2010</ulink>), and real-world activism was shoe-leather activism (think of "
395 "Malcolm Gladwell’s <ulink url=\"https://www.newyorker.com/"
396 "magazine/2010/10/04/small-change-malcolm-gladwell\">contempt for "
397 "<quote>clicktivism</quote></ulink>). But as tech has grown more central to "
398 "our daily lives, these accusations of irrelevance have given way first to "
399 "accusations of insincerity (<quote>You only care about tech because you’re "
400 "<ulink url=\"https://www.ipwatchdog.com/2018/06/04/report-engine-eff-shills-"
401 "google-patent-reform/id=98007/\">shilling for tech companies</ulink></"
402 "quote>) to accusations of negligence (<quote>Why didn’t you foresee that "
403 "tech could be such a destructive force?</quote>). But digital rights "
404 "activism is right where it’s always been: looking out for the humans in a "
405 "world where tech is inexorably taking over."
407 "Digital rettighetsaktivisme er eldre enn Internett. GNU-prosjektet er fra "
408 "1983. Elektronisk forpost fra 1990. I brorparten av tiden denne har "
409 "eksistert, var hovedkritikken rettet mot dens formål at det hele var "
410 "irrelevant: De sanne aktivistparolene var blitt virkelighet i lys av "
411 "skepsis. Tenk over hva som ble sagt da <ulink url=\"https://www.loc.gov/law/"
412 "foreign-news/article/finland-legal-right-to-broadband-for-all-citizens/#:~:te"
413 "xt=Global%20Legal%20Monitor,-Home%20%7C%20Search%20%7C%20Browse&text=(Jul"
414 "y%206%2C%202010)%20On,connection%20100%20MBPS%20by%202015.\">Finland snudde "
415 "kjæringa og erklærte breiband en mennskerett i 2010</ulink>. Sann aktivisme "
416 "var for smørkrise å regne den gang. Tenk over Malcolm Gladwell sin <ulink "
417 "url=\"https://www.newyorker.com/magazine/2010/10/04/small-change-malcolm-"
418 "gladwell\">forakt for at Finland gjorde resten av verden til skamme i 2010</"
419 "ulink> da han kalte det <quote>klikktivisme.</quote>. Etter at "
420 "storteknologien har blitt sentral i våre liv, om ikke erstattet noen av dem "
421 "helt, har disse uverdige kritikkene blitt kritikk verdige. Først lød pipa av "
422 "at <quote>Du bryr deg kun om teknologi fordi du <ulink url=\"https://www."
423 "ipwatchdog.com/2018/06/04/report-engine-eff-shills-google-patent-reform/id="
424 "98007/\">er en undersått av et teknologiselskap</ulink></quote>. Så ble "
425 "lyden tonelydende <quote>Hvorfor forutså du ikke at teknologi kom til å bli "
426 "en så destruktiv kraft?</quote>. Digital rettighetsaktivisme er riktig der "
427 "det alltid har vært rett: voktende over menneskene i en verden der teknologi "
428 "ubønnhørlig tar grep."
430 #. type: Content of: <book><chapter><sect1><para>
432 "The latest version of this critique comes in the form of <quote>surveillance "
433 "capitalism,</quote> a term coined by business professor Shoshana Zuboff in "
434 "her long and influential 2019 book, <emphasis>The Age of Surveillance "
435 "Capitalism: The Fight for a Human Future at the New Frontier of Power</"
436 "emphasis>. Zuboff argues that <quote>surveillance capitalism</quote> is a "
437 "unique creature of the tech industry and that it is unlike any other abusive "
438 "commercial practice in history, one that is <quote>constituted by unexpected "
439 "and often illegible mechanisms of extraction, commodification, and control "
440 "that effectively exile persons from their own behavior while producing new "
441 "markets of behavioral prediction and modification. Surveillance capitalism "
442 "challenges democratic norms and departs in key ways from the centuries-long "
443 "evolution of market capitalism.</quote> It is a new and deadly form of "
444 "capitalism, a <quote>rogue capitalism,</quote> and our lack of understanding "
445 "of its unique capabilities and dangers represents an existential, species-"
446 "wide threat. She’s right that capitalism today threatens our species, and "
447 "she’s right that tech poses unique challenges to our species and "
448 "civilization, but she’s really wrong about how tech is different and why it "
449 "threatens our species."
451 "Siste versjon av kritikken plystrer til takten av "
452 "<quote>overvåkningskapitalismen</quote>, et begrep Shoshana Zuboff førte i "
453 "pennen i sin innflytelsesrike og lange bok fra 2019, <emphasis>Tidsalderen "
454 "overvåkningskapitalismen: Kampen om en human fremtid i maktens nye "
455 "frontlinjer</emphasis>. Zuboff argumenterer at "
456 "<quote>overvåkningskapitalisme</quote> er en unik funksjon av teknologi-"
457 "industrien, og at til forskjell fra andre skadeinnvirkende kommersielle "
458 "gesjefter i historiens løp, at denne <quote>skriver seg fra uventede og "
459 "illegale mekanismer for utnyttelse, verdiskapning og kontroll som effektivt "
460 "sett løsriver folk fra deres adferd, mens den lager nye markeder for å "
461 "forutsi oppførselsforutsigbarhet og endring av den. Overvåkningskapitalisme "
462 "utfordrer demokratiske normer, og tar avskjed med århundrers "
463 "markedskapitalisme på sentrale punkter.</quote> Det er en ny og dødlig form "
464 "for kapitalisme, en <quote>løsrevet kapitalisme,</quote> og vår "
465 "forståelsesmangel i dens unike muligheter og farer representerer en "
466 "eksistensiell, artsomfattende trussel. Hun skal ha rett i at dagens "
467 "kapitalisme truer vårt artsmangfold, og hun framfører riktig nok at vår art "
468 "og sivilisasjon har utfordringer. Dog tar hun kanskje virkelig feil av "
469 "hvordan teknologi er forskjellig, og hvordan det truer vår art."
471 #. type: Content of: <book><chapter><sect1><para>
473 "What’s more, I think that her incorrect diagnosis will lead us down a path "
474 "that ends up making Big Tech stronger, not weaker. We need to take down Big "
475 "Tech, and to do that, we need to start by correctly identifying the problem."
477 "En slik feildiagnostisering vil forlede oss inn på et spor der "
478 "storteknologien har penset inn allerede. Ned med storteknologien, er ikke en "
479 "avsporing av problemet."
481 #. type: Content of: <book><chapter><sect1><title>
482 msgid "Tech exceptionalism, then and now"
483 msgstr "Teknologieksepsjonalisme, da og nå"
485 #. type: Content of: <book><chapter><sect1><para>
487 "Early critics of the digital rights movement — perhaps best represented by "
488 "campaigning organizations like the Electronic Frontier Foundation, the Free "
489 "Software Foundation, Public Knowledge, and others that focused on preserving "
490 "and enhancing basic human rights in the digital realm — damned activists for "
491 "practicing <quote>tech exceptionalism.</quote> Around the turn of the "
492 "millennium, serious people ridiculed any claim that tech policy mattered in "
493 "the <quote>real world.</quote> Claims that tech rules had implications for "
494 "speech, association, privacy, search and seizure, and fundamental rights and "
495 "equities were treated as ridiculous, an elevation of the concerns of sad "
496 "nerds arguing about <emphasis>Star Trek</emphasis> on bulletin board systems "
497 "above the struggles of the Freedom Riders, Nelson Mandela, or the Warsaw "
500 "Tidligere kritikere av bevegelsen av og for digitale rettigheter—kanskje "
501 "best representert ved organisasjoner som GNU-prosjektet, Elektronisk "
502 "forpost, Public Knowledge, og andre som fokuserer på ivaretagelse og "
503 "forbedring av grunnleggende rettigheter fra og i den digitale sfære—ble kalt "
504 "aktivister for å praktisere <quote>teknologieksepsjonalisme</quote>. Rundt "
505 "tusenårets slutt drev seriøse mennesker gjøn og påstod at teknologi-praksis "
506 "ikke hadde innvirkning på den <quote>virkelige verden</quote>. Påstander om "
507 "at teknologiregler hadde innvirkning på talefrihet, assosiasjonsfrihet, "
508 "personvern, ransakelsesordrer, og fundamentale rettigheter og verdier ble "
509 "antatt for latterlige å være, en videre trist fabulering om <emphasis>Star "
510 "Trek</emphasis> på digitale oppslagstavler istedenfor Nelson Mandela."
512 #. type: Content of: <book><chapter><sect1><para>
515 "In the decades since, accusations of <quote>tech exceptionalism</quote> have "
516 "only sharpened as tech’s role in everyday life has expanded: Now that tech "
517 "has infiltrated every corner of our life and our online lives have been "
518 "monopolized by a handful of giants, defenders of digital freedoms are "
519 "accused of carrying water for Big Tech, providing cover for its self-"
520 "interested negligence (or worse, nefarious plots)."
522 "I årtiene som fulgte, har anklagene om <quote>teknologieksepsjonalisme</"
523 "quote> økt etter som teknologi har fått en større rolle i folks hverdagslige "
524 "liv. Nå som teknologi har infiltrert hver krink av våre liv, og våre "
525 "nettbaserte liv kun har kommet et knippe monopolister i hende, blir digitale "
526 "rettighetsforkjempere anklaget for å gjøre storteknologiens ærende, i å "
527 "tjene som nyttige idioter for dens tilforlatelighet (eller verre, "
528 "forbryterske hensikter)."
530 #. type: Content of: <book><chapter><sect1><para>
532 "From my perspective, the digital rights movement has remained stationary "
533 "while the rest of the world has moved. From the earliest days, the "
534 "movement’s concern was users and the toolsmiths who provided the code they "
535 "needed to realize their fundamental rights. Digital rights activists only "
536 "cared about companies to the extent that companies were acting to uphold "
537 "users’ rights (or, just as often, when companies were acting so foolishly "
538 "that they threatened to bring down new rules that would also make it harder "
539 "for good actors to help users)."
541 "Fra eget perspektiv har bevegelsen for digitale rettigheter forholdt seg der "
542 "den startet, mens resten av verden har flyttet seg. Helt fra dens tidligste "
543 "dager, var det dens brukere også dem som skrev koden fra tanke til "
544 "fundamentale verktøy. Digitale rettighetsaktivister brød seg kun om "
545 "selskaper i den grad de brydde seg om brukernes rettigheter (eller, vel så "
546 "ofte, når selskaper gjorde så tåpelige ting at det truet med nye regelsett "
547 "som også gjorde det vanskeligere for rasjonelle aktører å hjelpe brukere)."
549 #. type: Content of: <book><chapter><sect1><para>
551 "The <quote>surveillance capitalism</quote> critique recasts the digital "
552 "rights movement in a new light again: not as alarmists who overestimate the "
553 "importance of their shiny toys nor as shills for big tech but as serene deck-"
554 "chair rearrangers whose long-standing activism is a liability because it "
555 "makes them incapable of perceiving novel threats as they continue to fight "
556 "the last century’s tech battles."
558 "<quote>Overvåkningskapitalisems</quote> kritiker kommer så med en ny "
559 "vinkling mot bevegelsen for digitale rettigheter: Ikke som varslere som "
560 "overdriver hvor viktig de nye leketøyene deres er, ei heller som "
561 "håndtlangere for storteknologien, men som velmenende stolflyttere hvis "
562 "langvarige aktivisme er en belastning fordi det gjør det ute av stand til å "
563 "oppfatte nye truslene som finnes fordi de er opptatt med forrige århundres "
566 #. type: Content of: <book><chapter><sect1><para>
567 msgid "But tech exceptionalism is a sin no matter who practices it."
568 msgstr "Men teknologieksepsjonalisme er en synd, uavsett hvem som bedriver den."
570 #. type: Content of: <book><chapter><sect1><title>
571 msgid "Don’t believe the hype"
572 msgstr "Ikke fest din lit til oppstuss"
574 #. type: Content of: <book><chapter><sect1><para>
576 "You’ve probably heard that <quote>if you’re not paying for the product, "
577 "you’re the product.</quote> As we’ll see below, that’s true, if incomplete. "
578 "But what is <emphasis>absolutely</emphasis> true is that ad-driven Big "
579 "Tech’s customers are advertisers, and what companies like Google and "
580 "Facebook sell is their ability to convince <emphasis>you</emphasis> to buy "
581 "stuff. Big Tech’s product is persuasion. The services — social media, search "
582 "engines, maps, messaging, and more — are delivery systems for persuasion."
584 "Du har antagelig hørt at <quote>om du ikke betaler for noe, er det du som er "
585 "produktet</quote>. Som vi ser nedenfor, er det riktig, men ikke hele bildet. "
586 "Det som er <emphasis>helt</emphasis> riktig om reklamefinansiert "
587 "storteknologi, er at dens kunder er de som reklamerer, og det selskaper som "
588 "Google og Facebook selger, er deres evne til å overbevise <emphasis>deg</"
589 "emphasis> om å kjøpe ting. Tjenestene—sosiale media, søkemotorer, kart, "
590 "meldingstjenester, med mer—er leveringssystemer for overbeviselse."
592 #. type: Content of: <book><chapter><sect1><para>
594 "The fear of surveillance capitalism starts from the (correct) presumption "
595 "that everything Big Tech says about itself is probably a lie. But the "
596 "surveillance capitalism critique makes an exception for the claims Big Tech "
597 "makes in its sales literature — the breathless hype in the pitches to "
598 "potential advertisers online and in ad-tech seminars about the efficacy of "
599 "its products: It assumes that Big Tech is as good at influencing us as they "
600 "claim they are when they’re selling influencing products to credulous "
601 "customers. That’s a mistake because sales literature is not a reliable "
602 "indicator of a product’s efficacy."
604 "Frykten for overvåkningskapitalismen utgår fra den (korrekte) antagelsen om "
605 "at alt Storteknologien sier om seg selv antagelig er løgn. Men kritikken av "
606 "overvåkningskapitalismen gjør unntak fra påstandene Storteknologien kommer "
607 "med i salgsmateriellet sitt - overdrivelsene som tar pusten fra deg i "
608 "salgsfremstøtene til potensielle annonsekjøpere på nettet og i deres "
609 "reklameteknologiseminarer om effekten av produktene. Den antar at "
610 "Storteknologien er så god til å påvirke oss som de påstår de er når de "
611 "selger påvirkningsprodukter til pålitelige kunder. Dette er en tabbe, da "
612 "salgsmateriell ikke er en pålitelig indikator på et produkts "
613 "gjennomføringsevne."
615 #. type: Content of: <book><chapter><sect1><para>
617 "Surveillance capitalism assumes that because advertisers buy a lot of what "
618 "Big Tech is selling, Big Tech must be selling something real. But Big Tech’s "
619 "massive sales could just as easily be the result of a popular delusion or "
620 "something even more pernicious: monopolistic control over our communications "
623 "Overvåkningskapitalismen antar det at det kjøpes mye av markedsføringen som "
624 "Storteknologien selges, så må Storteknologien selge noe som virker. Men det "
625 "enorme salget til Storteknologien kan like gjerne være et resultat av en "
626 "felles vrangforestilling eller noe enda mer skadelig, monopolistisk kontroll "
627 "over kommunikasjonen og handelen vår."
629 #. type: Content of: <book><chapter><sect1><para>
631 "Being watched changes your behavior, and not for the better. It creates "
632 "risks for our social progress. Zuboff’s book features beautifully wrought "
633 "explanations of these phenomena. But Zuboff also claims that surveillance "
634 "literally robs us of our free will — that when our personal data is mixed "
635 "with machine learning, it creates a system of persuasion so devastating that "
636 "we are helpless before it. That is, Facebook uses an algorithm to analyze "
637 "the data it nonconsensually extracts from your daily life and uses it to "
638 "customize your feed in ways that get you to buy stuff. It is a mind-control "
639 "ray out of a 1950s comic book, wielded by mad scientists whose "
640 "supercomputers guarantee them perpetual and total world domination."
642 "Du endrer oppførsel når noen ser på deg, og ikke til det bedre. Det skaper "
643 "risiko for vår sosiale fremgang. Zuboffs bok inneholder vakkert formulerte "
644 "forklaringer av disse fenomenene. Men Zuboff påstår også at overvåkning "
645 "bokstavlig talt fjerner vår frie vilje, at når våre personlige data blandes "
646 "med maskinlæring, så oppstår et overtalelsessystem så ødeleggende at vi er "
647 "helt hjelpeløse i møte med det. Det vil si at Facebook med en algoritme til "
648 "å analysere data som det henter ut fra ditt daglige liv uten samtykke, "
649 "tilpasser feeden din slik at du kjøper ting. Det er en tankekontrollstråle "
650 "rett ut av en femtitalls-tegneserie, der brukt av gale forskere hvis "
651 "superdatamaskiner garanterer dem evigvarende og total verdensherredømme."
653 #. type: Content of: <book><chapter><sect1><title>
654 msgid "What is persuasion?"
655 msgstr "Hva er overtalelse?"
657 #. type: Content of: <book><chapter><sect1><para>
659 "To understand why you shouldn’t worry about mind-control rays — but why you "
660 "<emphasis>should</emphasis> worry about surveillance <emphasis>and</"
661 "emphasis> Big Tech — we must start by unpacking what we mean by "
662 "<quote>persuasion.</quote>"
664 "For å forstå hvorfor du ikke bør bekymre deg over tankekontrollstråler, men "
665 "hvorfor du <emphasis>bør</emphasis> bekymre deg over overvåkning "
666 "<emphasis>og</emphasis> Storteknologi, så må vi starte ved å se på hva vi "
667 "mener med <quote>overtalelse</quote>."
669 #. type: Content of: <book><chapter><sect1><para>
671 "Google, Facebook, and other surveillance capitalists promise their customers "
672 "(the advertisers) that if they use machine-learning tools trained on "
673 "unimaginably large data sets of nonconsensually harvested personal "
674 "information, they will be able to uncover ways to bypass the rational "
675 "faculties of the public and direct their behavior, creating a stream of "
676 "purchases, votes, and other desired outcomes."
678 "Google, Facebook, og andre overvåkningskapitalister lover sine kunder (de "
679 "som markedsfører) at hvis de bruker maskinlæringsverktøy opptrent på "
680 "ufattelig store datasett av personinformasjon høstet inn uten samtykke, så "
681 "vil de være i stand til å finne måter å overstyre de rasjonale evnene til "
682 "folket og styre deres oppførsel, og slik skape en strøm av kjøp, stemmer og "
683 "andre ønskede resultater."
685 #. type: Content of: <book><chapter><sect1><blockquote><para>
687 "The impact of dominance far exceeds the impact of manipulation and should be "
688 "central to our analysis and any remedies we seek."
690 "Effekten av dominans er mye større enn effekten av manipulering og bør "
691 "derfor være hovedfokus i vår analyse og bestemmende for hvilke avhjelpende "
694 #. type: Content of: <book><chapter><sect1><para>
696 "But there’s little evidence that this is happening. Instead, the predictions "
697 "that surveillance capitalism delivers to its customers are much less "
698 "impressive. Rather than finding ways to bypass our rational faculties, "
699 "surveillance capitalists like Mark Zuckerberg mostly do one or more of three "
702 "Men det finnes få indiser på at det er dette som skjer. I stedet er "
703 "forutsigelsene som overvåkningskapitalismen leverer til sine kunder mye "
704 "mindre imponerende. I stedet for å finne måter å omgå våre rasjonelle "
705 "egenskaper, så gjør overvåkningskapitaliser som Mark Zuckerberg i hovedsak "
706 "en eller flere av tre ting:"
708 #. type: Content of: <book><chapter><sect1><sect2><title>
709 msgid "1. Segmenting"
710 msgstr "1. Segmentering"
712 #. type: Content of: <book><chapter><sect1><sect2><para>
714 "If you’re selling diapers, you have better luck if you pitch them to people "
715 "in maternity wards. Not everyone who enters or leaves a maternity ward just "
716 "had a baby, and not everyone who just had a baby is in the market for "
717 "diapers. But having a baby is a really reliable correlate of being in the "
718 "market for diapers, and being in a maternity ward is highly correlated with "
719 "having a baby. Hence diaper ads around maternity wards (and even pitchmen "
720 "for baby products, who haunt maternity wards with baskets full of freebies)."
722 "Hvis du selger bleier, så er det større sjanse for et salg hvis du forsøker "
723 "å selge dem til folk på fødeavdelinger. Slett ikke alle som ankommer eller "
724 "forlater en fødeavdeling har nettopp fått en baby, og ikke alle som har fått "
725 "en baby er i markedet etter bleier. Men det å ha en baby er svært nært "
726 "knyttet til det å være ute etter å kjøpe bleier, og det å være på en "
727 "fødestue er svært nært knyttet til det å ha en baby. Dermed er det "
728 "bleiereklamer i nærheten av fødeavdelinger (samt selgere av babyprodukter, "
729 "som henger rundt fødeavdelinger med favnen full av gratispakker)."
731 #. type: Content of: <book><chapter><sect1><sect2><para>
733 "Surveillance capitalism is segmenting times a billion. Diaper vendors can go "
734 "way beyond people in maternity wards (though they can do that, too, with "
735 "things like location-based mobile ads). They can target you based on "
736 "whether you’re reading articles about child-rearing, diapers, or a host of "
737 "other subjects, and data mining can suggest unobvious keywords to advertise "
738 "against. They can target you based on the articles you’ve recently read. "
739 "They can target you based on what you’ve recently purchased. They can target "
740 "you based on whether you receive emails or private messages about these "
741 "subjects — or even if you speak aloud about them (though Facebook and the "
742 "like convincingly claim that’s not happening — yet)."
744 "Overvåkningskapitalisem er segmentering ganger en milliard. "
745 "Bleieprodusenter kan langt overgå å fokusere på folk på fødestuer (selv om "
746 "de også kan gjøre slikt, ved å bruke stedsbaserte mobilreklager). De kan "
747 "rette reklamen mot deg basert på om du leser artikler om barneoppdragelse, "
748 "bleier, eller en hel rekke andre tema, og datautvinningen kan foreslå ikke-"
749 "åpenbare nøkkelord å rette reklamen mot. De kan rette reklamen mot deg "
750 "basert på artikler du nylig har lest. De kan rette reklamen mot deg baser "
751 "på det du nylig har kjøpt. De kan rette reklamen mot deg basert på om du har "
752 "mottatt epost eller private meldinger om disse temaene — eller til og med om "
753 "du snakker høyt om dem (selv om Facebook og dets like overbevisende påstår "
754 "at dette ikke gjøres — ennå)."
756 #. type: Content of: <book><chapter><sect1><sect2><para>
757 msgid "This is seriously creepy."
758 msgstr "Dette er veldig ekkelt."
760 #. type: Content of: <book><chapter><sect1><sect2><para>
761 msgid "But it’s not mind control."
762 msgstr "Men det er ikke tankekontroll."
764 #. type: Content of: <book><chapter><sect1><sect2><para>
765 msgid "It doesn’t deprive you of your free will. It doesn’t trick you."
766 msgstr "Det fratar deg ikke din frie vilje. Det lurer deg ikke."
768 #. type: Content of: <book><chapter><sect1><sect2><para>
771 "Think of how surveillance capitalism works in politics. Surveillance "
772 "capitalist companies sell political operatives the power to locate people "
773 "who might be receptive to their pitch. Candidates campaigning on finance "
774 "industry corruption seek people struggling with debt; candidates campaigning "
775 "on xenophobia seek out racists. Political operatives have always targeted "
776 "their message whether their intentions were honorable or not: Union "
777 "organizers set up pitches at factory gates, and white supremacists hand out "
778 "fliers at John Birch Society meetings."
780 "Se på på hvordan overvåkningskapitalisem virker i politikken. "
781 "Overvåkningskapitalistselskapene selger til politiske aktører evnen til å "
782 "spore opp folk som er mottakelige for deres argumenter. Kandidater som "
783 "kjører valgkamp på korrupsjon i finansbransjen leter etter folk som sliter "
784 "med gjeld. Kandidater som kjører valgkamp på fremmedfrykt leter etter "
785 "rasister. Politiske aktører har alltid rettet sine budskap uansett om "
786 "intensjonene var hederlige eller ikke. De som danner fagforeninger sprer "
787 "budskapet ved fabrikkportene, og forkjemperne for hvit overherredømme deler "
788 "ut foldere på møter i John Birch Society (FIXME bedre med norsk analogi?)."
790 #. type: Content of: <book><chapter><sect1><sect2><para>
792 "But this is an inexact and thus wasteful practice. The union organizer can’t "
793 "know which worker to approach on the way out of the factory gates and may "
794 "waste their time on a covert John Birch Society member; the white "
795 "supremacist doesn’t know which of the Birchers are so delusional that making "
796 "it to a meeting is as much as they can manage and which ones might be "
797 "convinced to cross the country to carry a tiki torch through the streets of "
798 "Charlottesville, Virginia."
801 #. type: Content of: <book><chapter><sect1><sect2><para>
803 "Because targeting improves the yields on political pitches, it can "
804 "accelerate the pace of political upheaval by making it possible for everyone "
805 "who has secretly wished for the toppling of an autocrat — or just an 11-term "
806 "incumbent politician — to find everyone else who feels the same way at very "
807 "low cost. This has been critical to the rapid crystallization of recent "
808 "political movements including Black Lives Matter and Occupy Wall Street as "
809 "well as less savory players like the far-right white nationalist movements "
810 "that marched in Charlottesville."
813 #. type: Content of: <book><chapter><sect1><sect2><para>
815 "It’s important to differentiate this kind of political organizing from "
816 "influence campaigns; finding people who secretly agree with you isn’t the "
817 "same as convincing people to agree with you. The rise of phenomena like "
818 "nonbinary or otherwise nonconforming gender identities is often "
819 "characterized by reactionaries as the result of online brainwashing "
820 "campaigns that convince impressionable people that they have been secretly "
824 #. type: Content of: <book><chapter><sect1><sect2><para>
826 "But the personal accounts of those who have come out tell a different story "
827 "where people who long harbored a secret about their gender were emboldened "
828 "by others coming forward and where people who knew that they were different "
829 "but lacked a vocabulary for discussing that difference learned the right "
830 "words from these low-cost means of finding people and learning about their "
834 #. type: Content of: <book><chapter><sect1><sect2><title>
838 #. type: Content of: <book><chapter><sect1><sect2><para>
840 "Lies and fraud are pernicious, and surveillance capitalism supercharges them "
841 "through targeting. If you want to sell a fraudulent payday loan or subprime "
842 "mortgage, surveillance capitalism can help you find people who are both "
843 "desperate and unsophisticated and thus receptive to your pitch. This "
844 "accounts for the rise of many phenomena, like multilevel marketing schemes, "
845 "in which deceptive claims about potential earnings and the efficacy of sales "
846 "techniques are targeted at desperate people by advertising against search "
847 "queries that indicate, for example, someone struggling with ill-advised "
851 #. type: Content of: <book><chapter><sect1><sect2><para>
853 "Surveillance capitalism also abets fraud by making it easy to locate other "
854 "people who have been similarly deceived, forming a community of people who "
855 "reinforce one another’s false beliefs. Think of <ulink url=\"https://www."
856 "vulture.com/2020/01/the-dream-podcast-review.html\">the forums</ulink> where "
857 "people who are being victimized by multilevel marketing frauds gather to "
858 "trade tips on how to improve their luck in peddling the product."
861 #. type: Content of: <book><chapter><sect1><sect2><para>
863 "Sometimes, online deception involves replacing someone’s correct beliefs "
864 "with incorrect ones, as it does in the anti-vaccination movement, whose "
865 "victims are often people who start out believing in vaccines but are "
866 "convinced by seemingly plausible evidence that leads them into the false "
867 "belief that vaccines are harmful."
870 #. type: Content of: <book><chapter><sect1><sect2><para>
872 "But it’s much more common for fraud to succeed when it doesn’t have to "
873 "displace a true belief. When my daughter contracted head lice at daycare, "
874 "one of the daycare workers told me I could get rid of them by treating her "
875 "hair and scalp with olive oil. I didn’t know anything about head lice, and I "
876 "assumed that the daycare worker did, so I tried it (it didn’t work, and it "
877 "doesn’t work). It’s easy to end up with false beliefs when you simply don’t "
878 "know any better and when those beliefs are conveyed by someone who seems to "
879 "know what they’re doing."
882 #. type: Content of: <book><chapter><sect1><sect2><para>
884 "This is pernicious and difficult — and it’s also the kind of thing the "
885 "internet can help guard against by making true information available, "
886 "especially in a form that exposes the underlying deliberations among parties "
887 "with sharply divergent views, such as Wikipedia. But it’s not brainwashing; "
888 "it’s fraud. In the <ulink url=\"https://datasociety.net/library/data-voids/"
889 "\">majority of cases</ulink>, the victims of these fraud campaigns have an "
890 "informational void filled in the customary way, by consulting a seemingly "
891 "reliable source. If I look up the length of the Brooklyn Bridge and learn "
892 "that it is 5,800 feet long, but in reality, it is 5,989 feet long, the "
893 "underlying deception is a problem, but it’s a problem with a simple remedy. "
894 "It’s a very different problem from the anti-vax issue in which someone’s "
895 "true belief is displaced by a false one by means of sophisticated persuasion."
898 #. type: Content of: <book><chapter><sect1><sect2><title>
899 msgid "3. Domination"
902 #. type: Content of: <book><chapter><sect1><sect2><para>
904 "Surveillance capitalism is the result of monopoly. Monopoly is the cause, "
905 "and surveillance capitalism and its negative outcomes are the effects of "
906 "monopoly. I’ll get into this in depth later, but for now, suffice it to say "
907 "that the tech industry has grown up with a radical theory of antitrust that "
908 "has allowed companies to grow by merging with their rivals, buying up their "
909 "nascent competitors, and expanding to control whole market verticals."
912 #. type: Content of: <book><chapter><sect1><sect2><para>
914 "One example of how monopolism aids in persuasion is through dominance: "
915 "Google makes editorial decisions about its algorithms that determine the "
916 "sort order of the responses to our queries. If a cabal of fraudsters have "
917 "set out to trick the world into thinking that the Brooklyn Bridge is 5,800 "
918 "feet long, and if Google gives a high search rank to this group in response "
919 "to queries like <quote>How long is the Brooklyn Bridge?</quote> then the "
920 "first eight or 10 screens’ worth of Google results could be wrong. And since "
921 "most people don’t go beyond the first couple of results — let alone the "
922 "first <emphasis>page</emphasis> of results — Google’s choice means that many "
923 "people will be deceived."
926 #. type: Content of: <book><chapter><sect1><sect2><para>
928 "Google’s dominance over search — more than 86% of web searches are performed "
929 "through Google — means that the way it orders its search results has an "
930 "outsized effect on public beliefs. Ironically, Google claims this is why it "
931 "can’t afford to have any transparency in its algorithm design: Google’s "
932 "search dominance makes the results of its sorting too important to risk "
933 "telling the world how it arrives at those results lest some bad actor "
934 "discover a flaw in the ranking system and exploit it to push its point of "
935 "view to the top of the search results. There’s an obvious remedy to a "
936 "company that is too big to audit: break it up into smaller pieces."
939 #. type: Content of: <book><chapter><sect1><sect2><para>
941 "Zuboff calls surveillance capitalism a <quote>rogue capitalism</quote> whose "
942 "data-hoarding and machine-learning techniques rob us of our free will. But "
943 "influence campaigns that seek to displace existing, correct beliefs with "
944 "false ones have an effect that is small and temporary while monopolistic "
945 "dominance over informational systems has massive, enduring effects. "
946 "Controlling the results to the world’s search queries means controlling "
947 "access both to arguments and their rebuttals and, thus, control over much of "
948 "the world’s beliefs. If our concern is how corporations are foreclosing on "
949 "our ability to make up our own minds and determine our own futures, the "
950 "impact of dominance far exceeds the impact of manipulation and should be "
951 "central to our analysis and any remedies we seek."
954 #. type: Content of: <book><chapter><sect1><sect2><title>
955 msgid "4. Bypassing our rational faculties"
958 #. type: Content of: <book><chapter><sect1><sect2><para>
960 "<emphasis>This</emphasis> is the good stuff: using machine learning, "
961 "<quote>dark patterns,</quote> engagement hacking, and other techniques to "
962 "get us to do things that run counter to our better judgment. This is mind "
966 #. type: Content of: <book><chapter><sect1><sect2><para>
968 "Some of these techniques have proven devastatingly effective (if only in the "
969 "short term). The use of countdown timers on a purchase completion page can "
970 "create a sense of urgency that causes you to ignore the nagging internal "
971 "voice suggesting that you should shop around or sleep on your decision. The "
972 "use of people from your social graph in ads can provide <quote>social proof</"
973 "quote> that a purchase is worth making. Even the auction system pioneered by "
974 "eBay is calculated to play on our cognitive blind spots, letting us feel "
975 "like we <quote>own</quote> something because we bid on it, thus encouraging "
976 "us to bid again when we are outbid to ensure that <quote>our</quote> things "
980 #. type: Content of: <book><chapter><sect1><sect2><para>
982 "Games are extraordinarily good at this. <quote>Free to play</quote> games "
983 "manipulate us through many techniques, such as presenting players with a "
984 "series of smoothly escalating challenges that create a sense of mastery and "
985 "accomplishment but which sharply transition into a set of challenges that "
986 "are impossible to overcome without paid upgrades. Add some social proof to "
987 "the mix — a stream of notifications about how well your friends are faring — "
988 "and before you know it, you’re buying virtual power-ups to get to the next "
992 #. type: Content of: <book><chapter><sect1><sect2><para>
994 "Companies have risen and fallen on these techniques, and the <quote>fallen</"
995 "quote> part is worth paying attention to. In general, living things adapt to "
996 "stimulus: Something that is very compelling or noteworthy when you first "
997 "encounter it fades with repetition until you stop noticing it altogether. "
998 "Consider the refrigerator hum that irritates you when it starts up but "
999 "disappears into the background so thoroughly that you only notice it when it "
1003 #. type: Content of: <book><chapter><sect1><sect2><para>
1005 "That’s why behavioral conditioning uses <quote>intermittent reinforcement "
1006 "schedules.</quote> Instead of giving you a steady drip of encouragement or "
1007 "setbacks, games and gamified services scatter rewards on a randomized "
1008 "schedule — often enough to keep you interested and random enough that you "
1009 "can never quite find the pattern that would make it boring."
1012 #. type: Content of: <book><chapter><sect1><sect2><para>
1014 "Intermittent reinforcement is a powerful behavioral tool, but it also "
1015 "represents a collective action problem for surveillance capitalism. The "
1016 "<quote>engagement techniques</quote> invented by the behaviorists of "
1017 "surveillance capitalist companies are quickly copied across the whole sector "
1018 "so that what starts as a mysteriously compelling fillip in the design of a "
1019 "service—like <quote>pull to refresh</quote> or alerts when someone likes "
1020 "your posts or side quests that your characters get invited to while in the "
1021 "midst of main quests—quickly becomes dully ubiquitous. The impossible-to-"
1022 "nail-down nonpattern of randomized drips from your phone becomes a grey-"
1023 "noise wall of sound as every single app and site starts to make use of "
1024 "whatever seems to be working at the time."
1027 #. type: Content of: <book><chapter><sect1><sect2><para>
1029 "From the surveillance capitalist’s point of view, our adaptive capacity is "
1030 "like a harmful bacterium that deprives it of its food source — our attention "
1031 "— and novel techniques for snagging that attention are like new antibiotics "
1032 "that can be used to breach our defenses and destroy our self-determination. "
1033 "And there <emphasis>are</emphasis> techniques like that. Who can forget the "
1034 "Great Zynga Epidemic, when all of our friends were caught in "
1035 "<emphasis>FarmVille</emphasis>’s endless, mindless dopamine loops? But every "
1036 "new attention-commanding technique is jumped on by the whole industry and "
1037 "used so indiscriminately that antibiotic resistance sets in. Given enough "
1038 "repetition, almost all of us develop immunity to even the most powerful "
1039 "techniques — by 2013, two years after Zynga’s peak, its user base had halved."
1042 #. type: Content of: <book><chapter><sect1><sect2><para>
1044 "Not everyone, of course. Some people never adapt to stimulus, just as some "
1045 "people never stop hearing the hum of the refrigerator. This is why most "
1046 "people who are exposed to slot machines play them for a while and then move "
1047 "on while a small and tragic minority liquidate their kids’ college funds, "
1048 "buy adult diapers, and position themselves in front of a machine until they "
1052 #. type: Content of: <book><chapter><sect1><sect2><para>
1054 "But surveillance capitalism’s margins on behavioral modification suck. "
1055 "Tripling the rate at which someone buys a widget sounds great <ulink url="
1056 "\"https://www.forbes.com/sites/priceonomics/2018/03/09/the-advertising-"
1057 "conversion-rates-for-every-major-tech-platform/#2f6a67485957\">unless the "
1058 "base rate is way less than 1%</ulink> with an improved rate of… still less "
1059 "than 1%. Even penny slot machines pull down pennies for every spin while "
1060 "surveillance capitalism rakes in infinitesimal penny fractions."
1063 #. type: Content of: <book><chapter><sect1><sect2><para>
1065 "Slot machines’ high returns mean that they can be profitable just by "
1066 "draining the fortunes of the small rump of people who are pathologically "
1067 "vulnerable to them and unable to adapt to their tricks. But surveillance "
1068 "capitalism can’t survive on the fractional pennies it brings down from that "
1069 "vulnerable sliver — that’s why, after the Great Zynga Epidemic had finally "
1070 "burned itself out, the small number of still-addicted players left behind "
1071 "couldn’t sustain it as a global phenomenon. And new powerful attention "
1072 "weapons aren’t easy to find, as is evidenced by the long years since the "
1073 "last time Zynga had a hit. Despite the hundreds of millions of dollars that "
1074 "Zynga has to spend on developing new tools to blast through our adaptation, "
1075 "it has never managed to repeat the lucky accident that let it snag so much "
1076 "of our attention for a brief moment in 2009. Powerhouses like Supercell have "
1077 "fared a little better, but they are rare and throw away many failures for "
1081 #. type: Content of: <book><chapter><sect1><sect2><para>
1083 "The vulnerability of small segments of the population to dramatic, efficient "
1084 "corporate manipulation is a real concern that’s worthy of our attention and "
1085 "energy. But it’s not an existential threat to society."
1088 #. type: Content of: <book><chapter><sect1><title>
1090 "If data is the new oil, then surveillance capitalism’s engine has a leak"
1091 msgstr "Hvis data er den nye oljen, er motorlekkasje overvåkningskapitalismen"
1093 #. type: Content of: <book><chapter><sect1><para>
1095 "This adaptation problem offers an explanation for one of surveillance "
1096 "capitalism’s most alarming traits: its relentless hunger for data and its "
1097 "endless expansion of data-gathering capabilities through the spread of "
1098 "sensors, online surveillance, and acquisition of data streams from third "
1102 #. type: Content of: <book><chapter><sect1><para>
1104 "Zuboff observes this phenomenon and concludes that data must be very "
1105 "valuable if surveillance capitalism is so hungry for it. (In her words: "
1106 "<quote>Just as industrial capitalism was driven to the continuous "
1107 "intensification of the means of production, so surveillance capitalists and "
1108 "their market players are now locked into the continuous intensification of "
1109 "the means of behavioral modification and the gathering might of "
1110 "instrumentarian power.</quote>) But what if the voracious appetite is "
1111 "because data has such a short half-life — because people become inured so "
1112 "quickly to new, data-driven persuasion techniques — that the companies are "
1113 "locked in an arms race with our limbic system? What if it’s all a Red "
1114 "Queen’s race where they have to run ever faster — collect ever-more data — "
1115 "just to stay in the same spot?"
1118 #. type: Content of: <book><chapter><sect1><para>
1120 "Of course, all of Big Tech’s persuasion techniques work in concert with one "
1121 "another, and collecting data is useful beyond mere behavioral trickery."
1124 #. type: Content of: <book><chapter><sect1><para>
1126 "If someone wants to recruit you to buy a refrigerator or join a pogrom, they "
1127 "might use profiling and targeting to send messages to people they judge to "
1128 "be good sales prospects. The messages themselves may be deceptive, making "
1129 "claims about things you’re not very knowledgeable about (food safety and "
1130 "energy efficiency or eugenics and historical claims about racial "
1131 "superiority). They might use search engine optimization and/or armies of "
1132 "fake reviewers and commenters and/or paid placement to dominate the "
1133 "discourse so that any search for further information takes you back to their "
1134 "messages. And finally, they may refine the different pitches using machine "
1135 "learning and other techniques to figure out what kind of pitch works best on "
1139 #. type: Content of: <book><chapter><sect1><para>
1141 "Each phase of this process benefits from surveillance: The more data they "
1142 "have, the more precisely they can profile you and target you with specific "
1143 "messages. Think of how you’d sell a fridge if you knew that the warranty on "
1144 "your prospect’s fridge just expired and that they were expecting a tax "
1148 #. type: Content of: <book><chapter><sect1><para>
1150 "Also, the more data they have, the better they can craft deceptive messages "
1151 "— if I know that you’re into genealogy, I might not try to feed you "
1152 "pseudoscience about genetic differences between <quote>races,</quote> "
1153 "sticking instead to conspiratorial secret histories of <quote>demographic "
1154 "replacement</quote> and the like."
1157 #. type: Content of: <book><chapter><sect1><para>
1159 "Facebook also helps you locate people who have the same odious or antisocial "
1160 "views as you. It makes it possible to find other people who want to carry "
1161 "tiki torches through the streets of Charlottesville in Confederate cosplay. "
1162 "It can help you find other people who want to join your militia and go to "
1163 "the border to look for undocumented migrants to terrorize. It can help you "
1164 "find people who share your belief that vaccines are poison and that the "
1168 #. type: Content of: <book><chapter><sect1><para>
1170 "There is one way in which targeted advertising uniquely benefits those "
1171 "advocating for socially unacceptable causes: It is invisible. Racism is "
1172 "widely geographically dispersed, and there are few places where racists — "
1173 "and only racists — gather. This is similar to the problem of selling "
1174 "refrigerators in that potential refrigerator purchasers are geographically "
1175 "dispersed and there are few places where you can buy an ad that will be "
1176 "primarily seen by refrigerator customers. But buying a refrigerator is "
1177 "socially acceptable while being a Nazi is not, so you can buy a billboard or "
1178 "advertise in the newspaper sports section for your refrigerator business, "
1179 "and the only potential downside is that your ad will be seen by a lot of "
1180 "people who don’t want refrigerators, resulting in a lot of wasted expense."
1183 #. type: Content of: <book><chapter><sect1><para>
1185 "But even if you wanted to advertise your Nazi movement on a billboard or "
1186 "prime-time TV or the sports section, you would struggle to find anyone "
1187 "willing to sell you the space for your ad partly because they disagree with "
1188 "your views and partly because they fear censure (boycott, reputational "
1189 "damage, etc.) from other people who disagree with your views."
1192 #. type: Content of: <book><chapter><sect1><para>
1194 "Targeted ads solve this problem: On the internet, every ad unit can be "
1195 "different for every person, meaning that you can buy ads that are only shown "
1196 "to people who appear to be Nazis and not to people who hate Nazis. When "
1197 "there’s spillover — when someone who hates racism is shown a racist "
1198 "recruiting ad — there is some fallout; the platform or publication might get "
1199 "an angry public or private denunciation. But the nature of the risk assumed "
1200 "by an online ad buyer is different than the risks to a traditional publisher "
1201 "or billboard owner who might want to run a Nazi ad."
1204 #. type: Content of: <book><chapter><sect1><para>
1206 "Online ads are placed by algorithms that broker between a diverse ecosystem "
1207 "of self-serve ad platforms that anyone can buy an ad through, so the Nazi ad "
1208 "that slips onto your favorite online publication isn’t seen as their moral "
1209 "failing but rather as a failure in some distant, upstream ad supplier. When "
1210 "a publication gets a complaint about an offensive ad that’s appearing in one "
1211 "of its units, it can take some steps to block that ad, but the Nazi might "
1212 "buy a slightly different ad from a different broker serving the same unit. "
1213 "And in any event, internet users increasingly understand that when they see "
1214 "an ad, it’s likely that the advertiser did not choose that publication and "
1215 "that the publication has no idea who its advertisers are."
1218 #. type: Content of: <book><chapter><sect1><para>
1220 "These layers of indirection between advertisers and publishers serve as "
1221 "moral buffers: Today’s moral consensus is largely that publishers shouldn’t "
1222 "be held responsible for the ads that appear on their pages because they’re "
1223 "not actively choosing to put those ads there. Because of this, Nazis are "
1224 "able to overcome significant barriers to organizing their movement."
1227 #. type: Content of: <book><chapter><sect1><para>
1229 "Data has a complex relationship with domination. Being able to spy on your "
1230 "customers can alert you to their preferences for your rivals and allow you "
1231 "to head off your rivals at the pass."
1234 #. type: Content of: <book><chapter><sect1><para>
1236 "More importantly, if you can dominate the information space while also "
1237 "gathering data, then you make other deceptive tactics stronger because it’s "
1238 "harder to break out of the web of deceit you’re spinning. Domination — that "
1239 "is, ultimately becoming a monopoly — and not the data itself is the "
1240 "supercharger that makes every tactic worth pursuing because monopolistic "
1241 "domination deprives your target of an escape route."
1244 #. type: Content of: <book><chapter><sect1><para>
1246 "If you’re a Nazi who wants to ensure that your prospects primarily see "
1247 "deceptive, confirming information when they search for more, you can improve "
1248 "your odds by seeding the search terms they use through your initial "
1249 "communications. You don’t need to own the top 10 results for <quote>voter "
1250 "suppression</quote> if you can convince your marks to confine their search "
1251 "terms to <quote>voter fraud,</quote> which throws up a very different set of "
1255 #. type: Content of: <book><chapter><sect1><para>
1257 "Surveillance capitalists are like stage mentalists who claim that their "
1258 "extraordinary insights into human behavior let them guess the word that you "
1259 "wrote down and folded up in your pocket but who really use shills, hidden "
1260 "cameras, sleight of hand, and brute-force memorization to amaze you."
1263 #. type: Content of: <book><chapter><sect1><para>
1265 "Or perhaps they’re more like pick-up artists, the misogynistic cult that "
1266 "promises to help awkward men have sex with women by teaching them "
1267 "<quote>neurolinguistic programming</quote> phrases, body language "
1268 "techniques, and psychological manipulation tactics like <quote>negging</"
1269 "quote> — offering unsolicited negative feedback to women to lower their self-"
1270 "esteem and prick their interest."
1273 #. type: Content of: <book><chapter><sect1><para>
1275 "Some pick-up artists eventually manage to convince women to go home with "
1276 "them, but it’s not because these men have figured out how to bypass women’s "
1277 "critical faculties. Rather, pick-up artists’ <quote>success</quote> stories "
1278 "are a mix of women who were incapable of giving consent, women who were "
1279 "coerced, women who were intoxicated, self-destructive women, and a few women "
1280 "who were sober and in command of their faculties but who didn’t realize "
1281 "straightaway that they were with terrible men but rectified the error as "
1282 "soon as they could."
1285 #. type: Content of: <book><chapter><sect1><para>
1287 "Pick-up artists <emphasis>believe</emphasis> they have figured out a secret "
1288 "back door that bypasses women’s critical faculties, but they haven’t. Many "
1289 "of the tactics they deploy, like negging, became the butt of jokes (just "
1290 "like people joke about bad ad targeting), and there’s a good chance that "
1291 "anyone they try these tactics on will immediately recognize them and dismiss "
1292 "the men who use them as irredeemable losers."
1295 #. type: Content of: <book><chapter><sect1><para>
1297 "Pick-up artists are proof that people can believe they have developed a "
1298 "system of mind control <emphasis>even when it doesn’t work</emphasis>. Pick-"
1299 "up artists simply exploit the fact that one-in-a-million chances can come "
1300 "through for you if you make a million attempts, and then they assume that "
1301 "the other 999,999 times, they simply performed the technique incorrectly and "
1302 "commit themselves to doing better next time. There’s only one group of "
1303 "people who find pick-up artist lore reliably convincing: other would-be pick-"
1304 "up artists whose anxiety and insecurity make them vulnerable to scammers and "
1305 "delusional men who convince them that if they pay for tutelage and follow "
1306 "instructions, then they will someday succeed. Pick-up artists assume they "
1307 "fail to entice women because they are bad at being pick-up artists, not "
1308 "because pick-up artistry is bullshit. Pick-up artists are bad at selling "
1309 "themselves to women, but they’re much better at selling themselves to men "
1310 "who pay to learn the secrets of pick-up artistry."
1313 #. type: Content of: <book><chapter><sect1><para>
1315 "Department store pioneer John Wanamaker is said to have lamented, "
1316 "<quote>Half the money I spend on advertising is wasted; the trouble is I "
1317 "don’t know which half.</quote> The fact that Wanamaker thought that only "
1318 "half of his advertising spending was wasted is a tribute to the "
1319 "persuasiveness of advertising executives, who are <emphasis>much</emphasis> "
1320 "better at convincing potential clients to buy their services than they are "
1321 "at convincing the general public to buy their clients’ wares."
1324 #. type: Content of: <book><chapter><sect1><title>
1325 msgid "What is Facebook?"
1326 msgstr "Hva er Facebook?"
1328 #. type: Content of: <book><chapter><sect1><para>
1330 "Facebook is heralded as the origin of all of our modern plagues, and it’s "
1331 "not hard to see why. Some tech companies want to lock their users in but "
1332 "make their money by monopolizing access to the market for apps for their "
1333 "devices and gouging them on prices rather than by spying on them (like "
1334 "Apple). Some companies don’t care about locking in users because they’ve "
1335 "figured out how to spy on them no matter where they are and what they’re "
1336 "doing and can turn that surveillance into money (Google). Facebook alone "
1337 "among the Western tech giants has built a business based on locking in its "
1338 "users <emphasis>and</emphasis> spying on them all the time."
1341 #. type: Content of: <book><chapter><sect1><para>
1343 "Facebook’s surveillance regime is really without parallel in the Western "
1344 "world. Though Facebook tries to prevent itself from being visible on the "
1345 "public web, hiding most of what goes on there from people unless they’re "
1346 "logged into Facebook, the company has nevertheless booby-trapped the entire "
1347 "web with surveillance tools in the form of Facebook <quote>Like</quote> "
1348 "buttons that web publishers include on their sites to boost their Facebook "
1349 "profiles. Facebook also makes various libraries and other useful code "
1350 "snippets available to web publishers that act as surveillance tendrils on "
1351 "the sites where they’re used, funneling information about visitors to the "
1352 "site — newspapers, dating sites, message boards — to Facebook."
1355 #. type: Content of: <book><chapter><sect1><blockquote><para>
1357 "Big Tech is able to practice surveillance not just because it is tech but "
1358 "because it is <emphasis>big</emphasis>."
1361 #. type: Content of: <book><chapter><sect1><para>
1363 "Facebook offers similar tools to app developers, so the apps — games, fart "
1364 "machines, business review services, apps for keeping abreast of your kid’s "
1365 "schooling — you use will send information about your activities to Facebook "
1366 "even if you don’t have a Facebook account and even if you don’t download or "
1367 "use Facebook apps. On top of all that, Facebook buys data from third-party "
1368 "brokers on shopping habits, physical location, use of <quote>loyalty</quote> "
1369 "programs, financial transactions, etc., and cross-references that with the "
1370 "dossiers it develops on activity on Facebook and with apps and the public "
1374 #. type: Content of: <book><chapter><sect1><para>
1376 "Though it’s easy to integrate the web with Facebook — linking to news "
1377 "stories and such — Facebook products are generally not available to be "
1378 "integrated back into the web itself. You can embed a tweet in a Facebook "
1379 "post, but if you embed a Facebook post in a tweet, you just get a link back "
1380 "to Facebook and must log in before you can see it. Facebook has used extreme "
1381 "technological and legal countermeasures to prevent rivals from allowing "
1382 "their users to embed Facebook snippets in competing services or to create "
1383 "alternative interfaces to Facebook that merge your Facebook inbox with those "
1384 "of other services that you use."
1387 #. type: Content of: <book><chapter><sect1><para>
1389 "And Facebook is incredibly popular, with 2.3 billion claimed users (though "
1390 "many believe this figure to be inflated). Facebook has been used to organize "
1391 "genocidal pogroms, racist riots, anti-vaccination movements, flat Earth "
1392 "cults, and the political lives of some of the world’s ugliest, most brutal "
1393 "autocrats. There are some really alarming things going on in the world, and "
1394 "Facebook is implicated in many of them, so it’s easy to conclude that these "
1395 "bad things are the result of Facebook’s mind-control system, which it rents "
1396 "out to anyone with a few bucks to spend."
1399 #. type: Content of: <book><chapter><sect1><para>
1401 "To understand what role Facebook plays in the formulation and mobilization "
1402 "of antisocial movements, we need to understand the dual nature of Facebook."
1405 #. type: Content of: <book><chapter><sect1><para>
1407 "Because it has a lot of users and a lot of data about those users, Facebook "
1408 "is a very efficient tool for locating people with hard-to-find traits, the "
1409 "kinds of traits that are widely diffused in the population such that "
1410 "advertisers have historically struggled to find a cost-effective way to "
1411 "reach them. Think back to refrigerators: Most of us only replace our major "
1412 "appliances a few times in our entire lives. If you’re a refrigerator "
1413 "manufacturer or retailer, you have these brief windows in the life of a "
1414 "consumer during which they are pondering a purchase, and you have to somehow "
1415 "reach them. Anyone who’s ever registered a title change after buying a house "
1416 "can attest that appliance manufacturers are incredibly desperate to reach "
1417 "anyone who has even the slenderest chance of being in the market for a new "
1421 #. type: Content of: <book><chapter><sect1><para>
1423 "Facebook makes finding people shopping for refrigerators a <emphasis>lot</"
1424 "emphasis> easier. It can target ads to people who’ve registered a new home "
1425 "purchase, to people who’ve searched for refrigerator buying advice, to "
1426 "people who have complained about their fridge dying, or any combination "
1427 "thereof. It can even target people who’ve recently bought <emphasis>other</"
1428 "emphasis> kitchen appliances on the theory that someone who’s just replaced "
1429 "their stove and dishwasher might be in a fridge-buying kind of mood. The "
1430 "vast majority of people who are reached by these ads will not be in the "
1431 "market for a new fridge, but — crucially — the percentage of people who "
1432 "<emphasis>are</emphasis> looking for fridges that these ads reach is "
1433 "<emphasis>much</emphasis> larger than it is than for any group that might be "
1434 "subjected to traditional, offline targeted refrigerator marketing."
1437 #. type: Content of: <book><chapter><sect1><para>
1439 "Facebook also makes it a lot easier to find people who have the same rare "
1440 "disease as you, which might have been impossible in earlier eras — the "
1441 "closest fellow sufferer might otherwise be hundreds of miles away. It makes "
1442 "it easier to find people who went to the same high school as you even though "
1443 "decades have passed and your former classmates have all been scattered to "
1444 "the four corners of the Earth."
1447 #. type: Content of: <book><chapter><sect1><para>
1449 "Facebook also makes it much easier to find people who hold the same rare "
1450 "political beliefs as you. If you’ve always harbored a secret affinity for "
1451 "socialism but never dared utter this aloud lest you be demonized by your "
1452 "neighbors, Facebook can help you discover other people who feel the same way "
1453 "(and it might just demonstrate to you that your affinity is more widespread "
1454 "than you ever suspected). It can make it easier to find people who share "
1455 "your sexual identity. And again, it can help you to understand that what "
1456 "you thought was a shameful secret that affected only you was really a widely "
1457 "shared trait, giving you both comfort and the courage to come out to the "
1458 "people in your life."
1461 #. type: Content of: <book><chapter><sect1><para>
1463 "All of this presents a dilemma for Facebook: Targeting makes the company’s "
1464 "ads more effective than traditional ads, but it also lets advertisers see "
1465 "just how effective their ads are. While advertisers are pleased to learn "
1466 "that Facebook ads are more effective than ads on systems with less "
1467 "sophisticated targeting, advertisers can also see that in nearly every case, "
1468 "the people who see their ads ignore them. Or, at best, the ads work on a "
1469 "subconscious level, creating nebulous unmeasurables like <quote>brand "
1470 "recognition.</quote> This means that the price per ad is very low in nearly "
1474 #. type: Content of: <book><chapter><sect1><para>
1476 "To make things worse, many Facebook groups spark precious little discussion. "
1477 "Your little-league soccer team, the people with the same rare disease as "
1478 "you, and the people you share a political affinity with may exchange the odd "
1479 "flurry of messages at critical junctures, but on a daily basis, there’s not "
1480 "much to say to your old high school chums or other hockey-card collectors."
1483 #. type: Content of: <book><chapter><sect1><para>
1485 "With nothing but <quote>organic</quote> discussion, Facebook would not "
1486 "generate enough traffic to sell enough ads to make the money it needs to "
1487 "continually expand by buying up its competitors while returning handsome "
1488 "sums to its investors."
1491 #. type: Content of: <book><chapter><sect1><para>
1493 "So Facebook has to gin up traffic by sidetracking its own forums: Every time "
1494 "Facebook’s algorithm injects controversial materials — inflammatory "
1495 "political articles, conspiracy theories, outrage stories — into a group, it "
1496 "can hijack that group’s nominal purpose with its desultory discussions and "
1497 "supercharge those discussions by turning them into bitter, unproductive "
1498 "arguments that drag on and on. Facebook is optimized for engagement, not "
1499 "happiness, and it turns out that automated systems are pretty good at "
1500 "figuring out things that people will get angry about."
1503 #. type: Content of: <book><chapter><sect1><para>
1505 "Facebook <emphasis>can</emphasis> modify our behavior but only in a couple "
1506 "of trivial ways. First, it can lock in all your friends and family members "
1507 "so that you check and check and check with Facebook to find out what they "
1508 "are up to; and second, it can make you angry and anxious. It can force you "
1509 "to choose between being interrupted constantly by updates — a process that "
1510 "breaks your concentration and makes it hard to be introspective — and "
1511 "staying in touch with your friends. This is a very limited form of mind "
1512 "control, and it can only really make us miserable, angry, and anxious."
1515 #. type: Content of: <book><chapter><sect1><para>
1517 "This is why Facebook’s targeting systems — both the ones it shows to "
1518 "advertisers and the ones that let users find people who share their "
1519 "interests — are so next-gen and smooth and easy to use as well as why its "
1520 "message boards have a toolset that seems like it hasn’t changed since the "
1521 "mid-2000s. If Facebook delivered an equally flexible, sophisticated message-"
1522 "reading system to its users, those users could defend themselves against "
1523 "being nonconsensually eyeball-fucked with Donald Trump headlines."
1526 #. type: Content of: <book><chapter><sect1><para>
1528 "The more time you spend on Facebook, the more ads it gets to show you. The "
1529 "solution to Facebook’s ads only working one in a thousand times is for the "
1530 "company to try to increase how much time you spend on Facebook by a factor "
1531 "of a thousand. Rather than thinking of Facebook as a company that has "
1532 "figured out how to show you exactly the right ad in exactly the right way to "
1533 "get you to do what its advertisers want, think of it as a company that has "
1534 "figured out how to make you slog through an endless torrent of arguments "
1535 "even though they make you miserable, spending so much time on the site that "
1536 "it eventually shows you at least one ad that you respond to."
1539 #. type: Content of: <book><chapter><sect1><title>
1540 msgid "Monopoly and the right to the future tense"
1543 #. type: Content of: <book><chapter><sect1><para>
1545 "Zuboff and her cohort are particularly alarmed at the extent to which "
1546 "surveillance allows corporations to influence our decisions, taking away "
1547 "something she poetically calls <quote>the right to the future tense</quote> "
1548 "— that is, the right to decide for yourself what you will do in the future."
1551 #. type: Content of: <book><chapter><sect1><para>
1553 "It’s true that advertising can tip the scales one way or another: When "
1554 "you’re thinking of buying a fridge, a timely fridge ad might end the search "
1555 "on the spot. But Zuboff puts enormous and undue weight on the persuasive "
1556 "power of surveillance-based influence techniques. Most of these don’t work "
1557 "very well, and the ones that do won’t work for very long. The makers of "
1558 "these influence tools are confident they will someday refine them into "
1559 "systems of total control, but they are hardly unbiased observers, and the "
1560 "risks from their dreams coming true are very speculative."
1563 #. type: Content of: <book><chapter><sect1><para>
1565 "By contrast, Zuboff is rather sanguine about 40 years of lax antitrust "
1566 "practice that has allowed a handful of companies to dominate the internet, "
1567 "ushering in an information age with, <ulink url=\"https://twitter.com/"
1568 "tveastman/status/1069674780826071040\">as one person on Twitter noted</"
1569 "ulink>, five giant websites each filled with screenshots of the other four."
1572 #. type: Content of: <book><chapter><sect1><para>
1574 "However, if we are to be alarmed that we might lose the right to choose for "
1575 "ourselves what our future will hold, then monopoly’s nonspeculative, "
1576 "concrete, here-and-now harms should be front and center in our debate over "
1580 #. type: Content of: <book><chapter><sect1><para>
1582 "Start with <quote>digital rights management.</quote> In 1998, Bill Clinton "
1583 "signed the Digital Millennium Copyright Act (DMCA) into law. It’s a complex "
1584 "piece of legislation with many controversial clauses but none more so than "
1585 "Section 1201, the <quote>anti-circumvention</quote> rule."
1588 #. type: Content of: <book><chapter><sect1><para>
1590 "This is a blanket ban on tampering with systems that restrict access to "
1591 "copyrighted works. The ban is so thoroughgoing that it prohibits removing a "
1592 "copyright lock even when no copyright infringement takes place. This is by "
1593 "design: The activities that the DMCA’s Section 1201 sets out to ban are not "
1594 "copyright infringements; rather, they are legal activities that frustrate "
1595 "manufacturers’ commercial plans."
1598 #. type: Content of: <book><chapter><sect1><para>
1600 "For example, Section 1201’s first major application was on DVD players as a "
1601 "means of enforcing the region coding built into those devices. DVD-CCA, the "
1602 "body that standardized DVDs and DVD players, divided the world into six "
1603 "regions and specified that DVD players must check each disc to determine "
1604 "which regions it was authorized to be played in. DVD players would have "
1605 "their own corresponding region (a DVD player bought in the U.S. would be "
1606 "region 1 while one bought in India would be region 5). If the player and the "
1607 "disc’s region matched, the player would play the disc; otherwise, it would "
1611 #. type: Content of: <book><chapter><sect1><para>
1613 "However, watching a lawfully produced disc in a country other than the one "
1614 "where you purchased it is not copyright infringement — it’s the opposite. "
1615 "Copyright law imposes this duty on customers for a movie: You must go into a "
1616 "store, find a licensed disc, and pay the asking price. Do that — and "
1617 "<emphasis>nothing else</emphasis> — and you and copyright are square with "
1621 #. type: Content of: <book><chapter><sect1><para>
1623 "The fact that a movie studio wants to charge Indians less than Americans or "
1624 "release in Australia later than it releases in the U.K. has no bearing on "
1625 "copyright law. Once you lawfully acquire a DVD, it is no copyright "
1626 "infringement to watch it no matter where you happen to be."
1629 #. type: Content of: <book><chapter><sect1><para>
1631 "So DVD and DVD player manufacturers would not be able to use accusations of "
1632 "abetting copyright infringement to punish manufacturers who made "
1633 "noncompliant players that would play discs from any region or repair shops "
1634 "that modified players to let you watch out-of-region discs or software "
1635 "programmers who created programs to let you do this."
1638 #. type: Content of: <book><chapter><sect1><para>
1640 "That’s where Section 1201 of the DMCA comes in: By banning tampering with an "
1641 "<quote>access control,</quote> the rule gave manufacturers and rights "
1642 "holders standing to sue competitors who released superior products with "
1643 "lawful features that the market demanded (in this case, region-free players)."
1646 #. type: Content of: <book><chapter><sect1><para>
1648 "This is an odious scam against consumers, but as time went by, Section 1201 "
1649 "grew to encompass a rapidly expanding constellation of devices and services "
1650 "as canny manufacturers have realized certain things:"
1653 #. type: Content of: <book><chapter><sect1><itemizedlist><listitem><para>
1655 "Any device with software in it contains a <quote>copyrighted work</quote> — "
1656 "i.e., the software."
1659 #. type: Content of: <book><chapter><sect1><itemizedlist><listitem><para>
1661 "A device can be designed so that reconfiguring the software requires "
1662 "bypassing an <quote>access control for copyrighted works,</quote> which is a "
1663 "potential felony under Section 1201."
1666 #. type: Content of: <book><chapter><sect1><itemizedlist><listitem><para>
1668 "Thus, companies can control their customers’ behavior after they take home "
1669 "their purchases by designing products so that all unpermitted uses require "
1670 "modifications that fall afoul of Section 1201."
1673 #. type: Content of: <book><chapter><sect1><para>
1675 "Section 1201 then becomes a means for manufacturers of all descriptions to "
1676 "force their customers to arrange their affairs to benefit the manufacturers’ "
1677 "shareholders instead of themselves."
1680 #. type: Content of: <book><chapter><sect1><para>
1682 "This manifests in many ways: from a new generation of inkjet printers that "
1683 "use countermeasures to prevent third-party ink that cannot be bypassed "
1684 "without legal risks to similar systems in tractors that prevent third-party "
1685 "technicians from swapping in the manufacturer’s own parts that are not "
1686 "recognized by the tractor’s control system until it is supplied with a "
1687 "manufacturer’s unlock code."
1690 #. type: Content of: <book><chapter><sect1><para>
1692 "Closer to home, Apple’s iPhones use these measures to prevent both third-"
1693 "party service and third-party software installation. This allows Apple to "
1694 "decide when an iPhone is beyond repair and must be shredded and landfilled "
1695 "as opposed to the iPhone’s purchaser. (Apple is notorious for its "
1696 "environmentally catastrophic policy of destroying old electronics rather "
1697 "than permitting them to be cannibalized for parts.) This is a very useful "
1698 "power to wield, especially in light of CEO Tim Cook’s January 2019 warning "
1699 "to investors that the company’s profits are endangered by customers choosing "
1700 "to hold onto their phones for longer rather than replacing them."
1703 #. type: Content of: <book><chapter><sect1><para>
1705 "Apple’s use of copyright locks also allows it to establish a monopoly over "
1706 "how its customers acquire software for their mobile devices. The App Store’s "
1707 "commercial terms guarantee Apple a share of all revenues generated by the "
1708 "apps sold there, meaning that Apple gets paid when you buy an app from its "
1709 "store and then continues to get paid every time you buy something using that "
1710 "app. This comes out of the bottom line of software developers, who must "
1711 "either charge more or accept lower profits for their products."
1714 #. type: Content of: <book><chapter><sect1><para>
1716 "Crucially, Apple’s use of copyright locks gives it the power to make "
1717 "editorial decisions about which apps you may and may not install on your own "
1718 "device. Apple has used this power to <ulink url=\"https://www.telegraph.co."
1719 "uk/technology/apple/5982243/Apple-bans-dictionary-from-App-Store-over-swear-"
1720 "words.html\">reject dictionaries</ulink> for containing obscene words; to "
1721 "<ulink url=\"https://www.vice.com/en_us/article/538kan/apple-just-banned-the-"
1722 "app-that-tracks-us-drone-strikes-again\">limit political speech</ulink>, "
1723 "especially from apps that make sensitive political commentary such as an app "
1724 "that notifies you every time a U.S. drone kills someone somewhere in the "
1725 "world; and to <ulink url=\"https://www.eurogamer.net/articles/2016-05-19-"
1726 "palestinian-indie-game-must-not-be-called-a-game-apple-says\">object to a "
1727 "game</ulink> that commented on the Israel-Palestine conflict."
1730 #. type: Content of: <book><chapter><sect1><para>
1732 "Apple often justifies monopoly power over software installation in the name "
1733 "of security, arguing that its vetting of apps for its store means that it "
1734 "can guard its users against apps that contain surveillance code. But this "
1735 "cuts both ways. In China, the government <ulink url=\"https://www.ft.com/"
1736 "content/ad42e536-cf36-11e7-b781-794ce08b24dc\">ordered Apple to prohibit the "
1737 "sale of privacy tools</ulink> like VPNs with the exception of VPNs that had "
1738 "deliberately introduced flaws designed to let the Chinese state eavesdrop on "
1739 "users. Because Apple uses technological countermeasures — with legal "
1740 "backstops — to block customers from installing unauthorized apps, Chinese "
1741 "iPhone owners cannot readily (or legally) acquire VPNs that would protect "
1742 "them from Chinese state snooping."
1745 #. type: Content of: <book><chapter><sect1><para>
1747 "Zuboff calls surveillance capitalism a <quote>rogue capitalism.</quote> "
1748 "Theoreticians of capitalism claim that its virtue is that it <ulink url="
1749 "\"https://en.wikipedia.org/wiki/Price_signal\">aggregates information in the "
1750 "form of consumers’ decisions</ulink>, producing efficient markets. "
1751 "Surveillance capitalism’s supposed power to rob its victims of their free "
1752 "will through computationally supercharged influence campaigns means that our "
1753 "markets no longer aggregate customers’ decisions because we customers no "
1754 "longer decide — we are given orders by surveillance capitalism’s mind-"
1758 #. type: Content of: <book><chapter><sect1><para>
1760 "If our concern is that markets cease to function when consumers can no "
1761 "longer make choices, then copyright locks should concern us at "
1762 "<emphasis>least</emphasis> as much as influence campaigns. An influence "
1763 "campaign might nudge you to buy a certain brand of phone; but the copyright "
1764 "locks on that phone absolutely determine where you get it serviced, which "
1765 "apps can run on it, and when you have to throw it away rather than fixing it."
1768 #. type: Content of: <book><chapter><sect1><title>
1769 msgid "Search order and the right to the future tense"
1772 #. type: Content of: <book><chapter><sect1><para>
1774 "Markets are posed as a kind of magic: By discovering otherwise hidden "
1775 "information conveyed by the free choices of consumers, those consumers’ "
1776 "local knowledge is integrated into a self-correcting system that makes "
1777 "efficient allocations—more efficient than any computer could calculate. But "
1778 "monopolies are incompatible with that notion. When you only have one app "
1779 "store, the owner of the store — not the consumer — decides on the range of "
1780 "choices. As Boss Tweed once said, <quote>I don’t care who does the electing, "
1781 "so long as I get to do the nominating.</quote> A monopolized market is an "
1782 "election whose candidates are chosen by the monopolist."
1785 #. type: Content of: <book><chapter><sect1><para>
1787 "This ballot rigging is made more pernicious by the existence of monopolies "
1788 "over search order. Google’s search market share is about 90%. When Google’s "
1789 "ranking algorithm puts a result for a popular search term in its top 10, "
1790 "that helps determine the behavior of millions of people. If Google’s answer "
1791 "to <quote>Are vaccines dangerous?</quote> is a page that rebuts anti-vax "
1792 "conspiracy theories, then a sizable portion of the public will learn that "
1793 "vaccines are safe. If, on the other hand, Google sends those people to a "
1794 "site affirming the anti-vax conspiracies, a sizable portion of those "
1795 "millions will come away convinced that vaccines are dangerous."
1798 #. type: Content of: <book><chapter><sect1><para>
1800 "Google’s algorithm is often tricked into serving disinformation as a "
1801 "prominent search result. But in these cases, Google isn’t persuading people "
1802 "to change their minds; it’s just presenting something untrue as fact when "
1803 "the user has no cause to doubt it."
1806 #. type: Content of: <book><chapter><sect1><para>
1808 "This is true whether the search is for <quote>Are vaccines dangerous?</"
1809 "quote> or <quote>best restaurants near me.</quote> Most users will never "
1810 "look past the first page of search results, and when the overwhelming "
1811 "majority of people all use the same search engine, the ranking algorithm "
1812 "deployed by that search engine will determine myriad outcomes (whether to "
1813 "adopt a child, whether to have cancer surgery, where to eat dinner, where to "
1814 "move, where to apply for a job) to a degree that vastly outstrips any "
1815 "behavioral outcomes dictated by algorithmic persuasion techniques."
1818 #. type: Content of: <book><chapter><sect1><para>
1820 "Many of the questions we ask search engines have no empirically correct "
1821 "answers: <quote>Where should I eat dinner?</quote> is not an objective "
1822 "question. Even questions that do have correct answers (<quote>Are vaccines "
1823 "dangerous?</quote>) don’t have one empirically superior source for that "
1824 "answer. Many pages affirm the safety of vaccines, so which one goes first? "
1825 "Under conditions of competition, consumers can choose from many search "
1826 "engines and stick with the one whose algorithmic judgment suits them best, "
1827 "but under conditions of monopoly, we all get our answers from the same place."
1830 #. type: Content of: <book><chapter><sect1><para>
1832 "Google’s search dominance isn’t a matter of pure merit: The company has "
1833 "leveraged many tactics that would have been prohibited under classical, pre-"
1834 "Ronald-Reagan antitrust enforcement standards to attain its dominance. After "
1835 "all, this is a company that has developed two major products: a really good "
1836 "search engine and a pretty good Hotmail clone. Every other major success "
1837 "it’s had — Android, YouTube, Google Maps, etc. — has come through an "
1838 "acquisition of a nascent competitor. Many of the company’s key divisions, "
1839 "such as the advertising technology of DoubleClick, violate the historical "
1840 "antitrust principle of structural separation, which forbade firms from "
1841 "owning subsidiaries that competed with their customers. Railroads, for "
1842 "example, were barred from owning freight companies that competed with the "
1843 "shippers whose freight they carried."
1846 #. type: Content of: <book><chapter><sect1><para>
1848 "If we’re worried about giant companies subverting markets by stripping "
1849 "consumers of their ability to make free choices, then vigorous antitrust "
1850 "enforcement seems like an excellent remedy. If we’d denied Google the right "
1851 "to effect its many mergers, we would also have probably denied it its total "
1852 "search dominance. Without that dominance, the pet theories, biases, errors "
1853 "(and good judgment, too) of Google search engineers and product managers "
1854 "would not have such an outsized effect on consumer choice."
1857 #. type: Content of: <book><chapter><sect1><para>
1859 "This goes for many other companies. Amazon, a classic surveillance "
1860 "capitalist, is obviously the dominant tool for searching Amazon — though "
1861 "many people find their way to Amazon through Google searches and Facebook "
1862 "posts — and obviously, Amazon controls Amazon search. That means that "
1863 "Amazon’s own self-serving editorial choices—like promoting its own house "
1864 "brands over rival goods from its sellers as well as its own pet theories, "
1865 "biases, and errors— determine much of what we buy on Amazon. And since "
1866 "Amazon is the dominant e-commerce retailer outside of China and since it "
1867 "attained that dominance by buying up both large rivals and nascent "
1868 "competitors in defiance of historical antitrust rules, we can blame the "
1869 "monopoly for stripping consumers of their right to the future tense and the "
1870 "ability to shape markets by making informed choices."
1873 #. type: Content of: <book><chapter><sect1><para>
1875 "Not every monopolist is a surveillance capitalist, but that doesn’t mean "
1876 "they’re not able to shape consumer choices in wide-ranging ways. Zuboff "
1877 "lauds Apple for its App Store and iTunes Store, insisting that adding price "
1878 "tags to the features on its platforms has been the secret to resisting "
1879 "surveillance and thus creating markets. But Apple is the only retailer "
1880 "allowed to sell on its platforms, and it’s the second-largest mobile device "
1881 "vendor in the world. The independent software vendors that sell through "
1882 "Apple’s marketplace accuse the company of the same surveillance sins as "
1883 "Amazon and other big retailers: spying on its customers to find lucrative "
1884 "new products to launch, effectively using independent software vendors as "
1885 "free-market researchers, then forcing them out of any markets they discover."
1888 #. type: Content of: <book><chapter><sect1><para>
1890 "Because of its use of copyright locks, Apple’s mobile customers are not "
1891 "legally allowed to switch to a rival retailer for its apps if they want to "
1892 "do so on an iPhone. Apple, obviously, is the only entity that gets to decide "
1893 "how it ranks the results of search queries in its stores. These decisions "
1894 "ensure that some apps are often installed (because they appear on page one) "
1895 "and others are never installed (because they appear on page one million). "
1896 "Apple’s search-ranking design decisions have a vastly more significant "
1897 "effect on consumer behaviors than influence campaigns delivered by "
1898 "surveillance capitalism’s ad-serving bots."
1901 #. type: Content of: <book><chapter><sect1><title>
1902 msgid "Monopolists can afford sleeping pills for watchdogs"
1903 msgstr "Monopolister har råd til sovepiller for vakthundene"
1905 #. type: Content of: <book><chapter><sect1><para>
1907 "Only the most extreme market ideologues think that markets can self-regulate "
1908 "without state oversight. Markets need watchdogs — regulators, lawmakers, and "
1909 "other elements of democratic control — to keep them honest. When these "
1910 "watchdogs sleep on the job, then markets cease to aggregate consumer choices "
1911 "because those choices are constrained by illegitimate and deceptive "
1912 "activities that companies are able to get away with because no one is "
1913 "holding them to account."
1916 #. type: Content of: <book><chapter><sect1><para>
1918 "But this kind of regulatory capture doesn’t come cheap. In competitive "
1919 "sectors, where rivals are constantly eroding one another’s margins, "
1920 "individual firms lack the surplus capital to effectively lobby for laws and "
1921 "regulations that serve their ends."
1924 #. type: Content of: <book><chapter><sect1><para>
1926 "Many of the harms of surveillance capitalism are the result of weak or "
1927 "nonexistent regulation. Those regulatory vacuums spring from the power of "
1928 "monopolists to resist stronger regulation and to tailor what regulation "
1929 "exists to permit their existing businesses."
1932 #. type: Content of: <book><chapter><sect1><para>
1934 "Here’s an example: When firms over-collect and over-retain our data, they "
1935 "are at increased risk of suffering a breach — you can’t leak data you never "
1936 "collected, and once you delete all copies of that data, you can no longer "
1937 "leak it. For more than a decade, we’ve lived through an endless parade of "
1938 "ever-worsening data breaches, each one uniquely horrible in the scale of "
1939 "data breached and the sensitivity of that data."
1942 #. type: Content of: <book><chapter><sect1><para>
1944 "But still, firms continue to over-collect and over-retain our data for three "
1948 #. type: Content of: <book><chapter><sect1><para>
1950 "<emphasis role=\"strong\">1. They are locked in the aforementioned limbic "
1951 "arms race with our capacity to shore up our attentional defense systems to "
1952 "resist their new persuasion techniques.</emphasis> They’re also locked in an "
1953 "arms race with their competitors to find new ways to target people for sales "
1954 "pitches. As soon as they discover a soft spot in our attentional defenses (a "
1955 "counterintuitive, unobvious way to target potential refrigerator buyers), "
1956 "the public begins to wise up to the tactic, and their competitors leap on "
1957 "it, hastening the day in which all potential refrigerator buyers have been "
1958 "inured to the pitch."
1961 #. type: Content of: <book><chapter><sect1><para>
1963 "<emphasis role=\"strong\">2. They believe the surveillance capitalism story."
1964 "</emphasis> Data is cheap to aggregate and store, and both proponents and "
1965 "opponents of surveillance capitalism have assured managers and product "
1966 "designers that if you collect enough data, you will be able to perform "
1967 "sorcerous acts of mind control, thus supercharging your sales. Even if you "
1968 "never figure out how to profit from the data, someone else will eventually "
1969 "offer to buy it from you to give it a try. This is the hallmark of all "
1970 "economic bubbles: acquiring an asset on the assumption that someone else "
1971 "will buy it from you for more than you paid for it, often to sell to someone "
1972 "else at an even greater price."
1975 #. type: Content of: <book><chapter><sect1><para>
1977 "<emphasis role=\"strong\">3. The penalties for leaking data are negligible.</"
1978 "emphasis> Most countries limit these penalties to actual damages, meaning "
1979 "that consumers who’ve had their data breached have to show actual monetary "
1980 "harms to get a reward. In 2014, Home Depot disclosed that it had lost credit-"
1981 "card data for 53 million of its customers, but it settled the matter by "
1982 "paying those customers about $0.34 each — and a third of that $0.34 wasn’t "
1983 "even paid in cash. It took the form of a credit to procure a largely "
1984 "ineffectual credit-monitoring service."
1987 #. type: Content of: <book><chapter><sect1><para>
1989 "But the harms from breaches are much more extensive than these actual-"
1990 "damages rules capture. Identity thieves and fraudsters are wily and "
1991 "endlessly inventive. All the vast breaches of our century are being "
1992 "continuously recombined, the data sets merged and mined for new ways to "
1993 "victimize the people whose data was present in them. Any reasonable, "
1994 "evidence-based theory of deterrence and compensation for breaches would not "
1995 "confine damages to actual damages but rather would allow users to claim "
1996 "these future harms."
1999 #. type: Content of: <book><chapter><sect1><para>
2001 "However, even the most ambitious privacy rules, such as the EU General Data "
2002 "Protection Regulation, fall far short of capturing the negative "
2003 "externalities of the platforms’ negligent over-collection and over-"
2004 "retention, and what penalties they do provide are not aggressively pursued "
2008 #. type: Content of: <book><chapter><sect1><para>
2010 "This tolerance of — or indifference to — data over-collection and over-"
2011 "retention can be ascribed in part to the sheer lobbying muscle of the "
2012 "platforms. They are so profitable that they can handily afford to divert "
2013 "gigantic sums to fight any real change — that is, change that would force "
2014 "them to internalize the costs of their surveillance activities."
2017 #. type: Content of: <book><chapter><sect1><para>
2019 "And then there’s state surveillance, which the surveillance capitalism story "
2020 "dismisses as a relic of another era when the big worry was being jailed for "
2021 "your dissident speech, not having your free will stripped away with machine "
2025 #. type: Content of: <book><chapter><sect1><para>
2027 "But state surveillance and private surveillance are intimately related. As "
2028 "we saw when Apple was conscripted by the Chinese government as a vital "
2029 "collaborator in state surveillance, the only really affordable and tractable "
2030 "way to conduct mass surveillance on the scale practiced by modern states — "
2031 "both <quote>free</quote> and autocratic states — is to suborn commercial "
2035 #. type: Content of: <book><chapter><sect1><para>
2037 "Whether it’s Google being used as a location tracking tool by local law "
2038 "enforcement across the U.S. or the use of social media tracking by the "
2039 "Department of Homeland Security to build dossiers on participants in "
2040 "protests against Immigration and Customs Enforcement’s family separation "
2041 "practices, any hard limits on surveillance capitalism would hamstring the "
2042 "state’s own surveillance capability. Without Palantir, Amazon, Google, and "
2043 "other major tech contractors, U.S. cops would not be able to spy on Black "
2044 "people, ICE would not be able to manage the caging of children at the U.S. "
2045 "border, and state welfare systems would not be able to purge their rolls by "
2046 "dressing up cruelty as empiricism and claiming that poor and vulnerable "
2047 "people are ineligible for assistance. At least some of the states’ "
2048 "unwillingness to take meaningful action to curb surveillance should be "
2049 "attributed to this symbiotic relationship. There is no mass state "
2050 "surveillance without mass commercial surveillance."
2053 #. type: Content of: <book><chapter><sect1><para>
2055 "Monopolism is key to the project of mass state surveillance. It’s true that "
2056 "smaller tech firms are apt to be less well-defended than Big Tech, whose "
2057 "security experts are drawn from the tops of their field and who are given "
2058 "enormous resources to secure and monitor their systems against intruders. "
2059 "But smaller firms also have less to protect: fewer users whose data is more "
2060 "fragmented across more systems and have to be suborned one at a time by "
2064 #. type: Content of: <book><chapter><sect1><para>
2066 "A concentrated tech sector that works with authorities is a much more "
2067 "powerful ally in the project of mass state surveillance than a fragmented "
2068 "one composed of smaller actors. The U.S. tech sector is small enough that "
2069 "all of its top executives fit around a single boardroom table in Trump Tower "
2070 "in 2017, shortly after Trump’s inauguration. Most of its biggest players bid "
2071 "to win JEDI, the Pentagon’s $10 billion Joint Enterprise Defense "
2072 "Infrastructure cloud contract. Like other highly concentrated industries, "
2073 "Big Tech rotates its key employees in and out of government service, sending "
2074 "them to serve in the Department of Defense and the White House, then hiring "
2075 "ex-Pentagon and ex-DOD top staffers and officers to work in their own "
2076 "government relations departments."
2079 #. type: Content of: <book><chapter><sect1><para>
2081 "They can even make a good case for doing this: After all, when there are "
2082 "only four or five big companies in an industry, everyone qualified to "
2083 "regulate those companies has served as an executive in at least a couple of "
2084 "them — because, likewise, when there are only five companies in an industry, "
2085 "everyone qualified for a senior role at any of them is by definition working "
2086 "at one of the other ones."
2089 #. type: Content of: <book><chapter><sect1><blockquote><para>
2091 "While surveillance doesn’t cause monopolies, monopolies certainly abet "
2095 #. type: Content of: <book><chapter><sect1><para>
2097 "Industries that are competitive are fragmented — composed of companies that "
2098 "are at each other’s throats all the time and eroding one another’s margins "
2099 "in bids to steal their best customers. This leaves them with much more "
2100 "limited capital to use to lobby for favorable rules and a much harder job of "
2101 "getting everyone to agree to pool their resources to benefit the industry as "
2105 #. type: Content of: <book><chapter><sect1><para>
2107 "Surveillance combined with machine learning is supposed to be an existential "
2108 "crisis, a species-defining moment at which our free will is just a few more "
2109 "advances in the field from being stripped away. I am skeptical of this "
2110 "claim, but I <emphasis>do</emphasis> think that tech poses an existential "
2111 "threat to our society and possibly our species."
2114 #. type: Content of: <book><chapter><sect1><para>
2115 msgid "But that threat grows out of monopoly."
2118 #. type: Content of: <book><chapter><sect1><para>
2120 "One of the consequences of tech’s regulatory capture is that it can shift "
2121 "liability for poor security decisions onto its customers and the wider "
2122 "society. It is absolutely normal in tech for companies to obfuscate the "
2123 "workings of their products, to make them deliberately hard to understand, "
2124 "and to threaten security researchers who seek to independently audit those "
2128 #. type: Content of: <book><chapter><sect1><para>
2130 "IT is the only field in which this is practiced: No one builds a bridge or a "
2131 "hospital and keeps the composition of the steel or the equations used to "
2132 "calculate load stresses a secret. It is a frankly bizarre practice that "
2133 "leads, time and again, to grotesque security defects on farcical scales, "
2134 "with whole classes of devices being revealed as vulnerable long after they "
2135 "are deployed in the field and put into sensitive places."
2138 #. type: Content of: <book><chapter><sect1><para>
2140 "The monopoly power that keeps any meaningful consequences for breaches at "
2141 "bay means that tech companies continue to build terrible products that are "
2142 "insecure by design and that end up integrated into our lives, in possession "
2143 "of our data, and connected to our physical world. For years, Boeing has "
2144 "struggled with the aftermath of a series of bad technology decisions that "
2145 "made its 737 fleet a global pariah, a rare instance in which bad tech "
2146 "decisions have been seriously punished in the market."
2149 #. type: Content of: <book><chapter><sect1><para>
2151 "These bad security decisions are compounded yet again by the use of "
2152 "copyright locks to enforce business-model decisions against consumers. "
2153 "Recall that these locks have become the go-to means for shaping consumer "
2154 "behavior, making it technically impossible to use third-party ink, insulin, "
2155 "apps, or service depots in connection with your lawfully acquired property."
2158 #. type: Content of: <book><chapter><sect1><para>
2160 "Recall also that these copyright locks are backstopped by legislation (such "
2161 "as Section 1201 of the DMCA or Article 6 of the 2001 EU Copyright Directive) "
2162 "that ban tampering with (<quote>circumventing</quote>) them, and these "
2163 "statutes have been used to threaten security researchers who make "
2164 "disclosures about vulnerabilities without permission from manufacturers."
2167 #. type: Content of: <book><chapter><sect1><para>
2169 "This amounts to a manufacturer’s veto over safety warnings and criticism. "
2170 "While this is far from the legislative intent of the DMCA and its sister "
2171 "statutes around the world, Congress has not intervened to clarify the "
2172 "statute nor will it because to do so would run counter to the interests of "
2173 "powerful, large firms whose lobbying muscle is unstoppable."
2176 #. type: Content of: <book><chapter><sect1><para>
2178 "Copyright locks are a double whammy: They create bad security decisions that "
2179 "can’t be freely investigated or discussed. If markets are supposed to be "
2180 "machines for aggregating information (and if surveillance capitalism’s "
2181 "notional mind-control rays are what make it a <quote>rogue capitalism</"
2182 "quote> because it denies consumers the power to make decisions), then a "
2183 "program of legally enforced ignorance of the risks of products makes "
2184 "monopolism even more of a <quote>rogue capitalism</quote> than surveillance "
2185 "capitalism’s influence campaigns."
2188 #. type: Content of: <book><chapter><sect1><para>
2190 "And unlike mind-control rays, enforced silence over security is an "
2191 "immediate, documented problem, and it <emphasis>does</emphasis> constitute "
2192 "an existential threat to our civilization and possibly our species. The "
2193 "proliferation of insecure devices — especially devices that spy on us and "
2194 "especially when those devices also can manipulate the physical world by, "
2195 "say, steering your car or flipping a breaker at a power station — is a kind "
2196 "of technology debt."
2199 #. type: Content of: <book><chapter><sect1><para>
2201 "In software design, <quote>technology debt</quote> refers to old, baked-in "
2202 "decisions that turn out to be bad ones in hindsight. Perhaps a long-ago "
2203 "developer decided to incorporate a networking protocol made by a vendor that "
2204 "has since stopped supporting it. But everything in the product still relies "
2205 "on that superannuated protocol, and so, with each revision, the product team "
2206 "has to work around this obsolete core, adding compatibility layers, "
2207 "surrounding it with security checks that try to shore up its defenses, and "
2208 "so on. These Band-Aid measures compound the debt because every subsequent "
2209 "revision has to make allowances for <emphasis>them</emphasis>, too, like "
2210 "interest mounting on a predatory subprime loan. And like a subprime loan, "
2211 "the interest mounts faster than you can hope to pay it off: The product team "
2212 "has to put so much energy into maintaining this complex, brittle system that "
2213 "they don’t have any time left over to refactor the product from the ground "
2214 "up and <quote>pay off the debt</quote> once and for all."
2217 #. type: Content of: <book><chapter><sect1><para>
2219 "Typically, technology debt results in a technological bankruptcy: The "
2220 "product gets so brittle and unsustainable that it fails catastrophically. "
2221 "Think of the antiquated COBOL-based banking and accounting systems that fell "
2222 "over at the start of the pandemic emergency when confronted with surges of "
2223 "unemployment claims. Sometimes that ends the product; sometimes it takes "
2224 "the company down with it. Being caught in the default of a technology debt "
2225 "is scary and traumatic, just like losing your house due to bankruptcy is "
2226 "scary and traumatic."
2229 #. type: Content of: <book><chapter><sect1><para>
2231 "But the technology debt created by copyright locks isn’t individual debt; "
2232 "it’s systemic. Everyone in the world is exposed to this over-leverage, as "
2233 "was the case with the 2008 financial crisis. When that debt comes due — when "
2234 "we face a cascade of security breaches that threaten global shipping and "
2235 "logistics, the food supply, pharmaceutical production pipelines, emergency "
2236 "communications, and other critical systems that are accumulating technology "
2237 "debt in part due to the presence of deliberately insecure and deliberately "
2238 "unauditable copyright locks — it will indeed pose an existential risk."
2241 #. type: Content of: <book><chapter><sect1><title>
2242 msgid "Privacy and monopoly"
2245 #. type: Content of: <book><chapter><sect1><para>
2247 "Many tech companies are gripped by an orthodoxy that holds that if they just "
2248 "gather enough data on enough of our activities, everything else is possible "
2249 "— the mind control and endless profits. This is an unfalsifiable hypothesis: "
2250 "If data gives a tech company even a tiny improvement in behavior prediction "
2251 "and modification, the company declares that it has taken the first step "
2252 "toward global domination with no end in sight. If a company <emphasis>fails</"
2253 "emphasis> to attain any improvements from gathering and analyzing data, it "
2254 "declares success to be just around the corner, attainable once more data is "
2258 #. type: Content of: <book><chapter><sect1><para>
2260 "Surveillance tech is far from the first industry to embrace a nonsensical, "
2261 "self-serving belief that harms the rest of the world, and it is not the "
2262 "first industry to profit handsomely from such a delusion. Long before hedge-"
2263 "fund managers were claiming (falsely) that they could beat the S&P 500, "
2264 "there were plenty of other <quote>respectable</quote> industries that have "
2265 "been revealed as quacks in hindsight. From the makers of radium "
2266 "suppositories (a real thing!) to the cruel sociopaths who claimed they "
2267 "could <quote>cure</quote> gay people, history is littered with the formerly "
2268 "respectable titans of discredited industries."
2271 #. type: Content of: <book><chapter><sect1><para>
2273 "This is not to say that there’s nothing wrong with Big Tech and its "
2274 "ideological addiction to data. While surveillance’s benefits are mostly "
2275 "overstated, its harms are, if anything, <emphasis>understated</emphasis>."
2278 #. type: Content of: <book><chapter><sect1><para>
2280 "There’s real irony here. The belief in surveillance capitalism as a "
2281 "<quote>rogue capitalism</quote> is driven by the belief that markets "
2282 "wouldn’t tolerate firms that are gripped by false beliefs. An oil company "
2283 "that has false beliefs about where the oil is will eventually go broke "
2284 "digging dry wells after all."
2287 #. type: Content of: <book><chapter><sect1><para>
2289 "But monopolists get to do terrible things for a long time before they pay "
2290 "the price. Think of how concentration in the finance sector allowed the "
2291 "subprime crisis to fester as bond-rating agencies, regulators, investors, "
2292 "and critics all fell under the sway of a false belief that complex "
2293 "mathematics could construct <quote>fully hedged</quote> debt instruments "
2294 "that could not possibly default. A small bank that engaged in this kind of "
2295 "malfeasance would simply go broke rather than outrunning the inevitable "
2296 "crisis, perhaps growing so big that it averted it altogether. But large "
2297 "banks were able to continue to attract investors, and when they finally "
2298 "<emphasis>did</emphasis> come a-cropper, the world’s governments bailed them "
2299 "out. The worst offenders of the subprime crisis are bigger than they were in "
2300 "2008, bringing home more profits and paying their execs even larger sums."
2303 #. type: Content of: <book><chapter><sect1><para>
2305 "Big Tech is able to practice surveillance not just because it is tech but "
2306 "because it is <emphasis>big</emphasis>. The reason every web publisher "
2307 "embeds a Facebook <quote>Like</quote> button is that Facebook dominates the "
2308 "internet’s social media referrals — and every one of those <quote>Like</"
2309 "quote> buttons spies on everyone who lands on a page that contains them (see "
2310 "also: Google Analytics embeds, Twitter buttons, etc.)."
2313 #. type: Content of: <book><chapter><sect1><para>
2315 "The reason the world’s governments have been slow to create meaningful "
2316 "penalties for privacy breaches is that Big Tech’s concentration produces "
2317 "huge profits that can be used to lobby against those penalties — and Big "
2318 "Tech’s concentration means that the companies involved are able to arrive at "
2319 "a unified negotiating position that supercharges the lobbying."
2322 #. type: Content of: <book><chapter><sect1><para>
2324 "The reason that the smartest engineers in the world want to work for Big "
2325 "Tech is that Big Tech commands the lion’s share of tech industry jobs."
2328 #. type: Content of: <book><chapter><sect1><para>
2330 "The reason people who are aghast at Facebook’s and Google’s and Amazon’s "
2331 "data-handling practices continue to use these services is that all their "
2332 "friends are on Facebook; Google dominates search; and Amazon has put all the "
2333 "local merchants out of business."
2336 #. type: Content of: <book><chapter><sect1><para>
2338 "Competitive markets would weaken the companies’ lobbying muscle by reducing "
2339 "their profits and pitting them against each other in regulatory forums. It "
2340 "would give customers other places to go to get their online services. It "
2341 "would make the companies small enough to regulate and pave the way to "
2342 "meaningful penalties for breaches. It would let engineers with ideas that "
2343 "challenged the surveillance orthodoxy raise capital to compete with the "
2344 "incumbents. It would give web publishers multiple ways to reach audiences "
2345 "and make the case against Facebook and Google and Twitter embeds."
2348 #. type: Content of: <book><chapter><sect1><para>
2350 "In other words, while surveillance doesn’t cause monopolies, monopolies "
2351 "certainly abet surveillance."
2354 #. type: Content of: <book><chapter><sect1><title>
2355 msgid "Ronald Reagan, pioneer of tech monopolism"
2358 #. type: Content of: <book><chapter><sect1><para>
2360 "Technology exceptionalism is a sin, whether it’s practiced by technology’s "
2361 "blind proponents or by its critics. Both of these camps are prone to "
2362 "explaining away monopolistic concentration by citing some special "
2363 "characteristic of the tech industry, like network effects or first-mover "
2364 "advantage. The only real difference between these two groups is that the "
2365 "tech apologists say monopoly is inevitable so we should just let tech get "
2366 "away with its abuses while competition regulators in the U.S. and the EU say "
2367 "monopoly is inevitable so we should punish tech for its abuses but not try "
2368 "to break up the monopolies."
2371 #. type: Content of: <book><chapter><sect1><para>
2373 "To understand how tech became so monopolistic, it’s useful to look at the "
2374 "dawn of the consumer tech industry: 1979, the year the Apple II Plus "
2375 "launched and became the first successful home computer. That also happens to "
2376 "be the year that Ronald Reagan hit the campaign trail for the 1980 "
2377 "presidential race — a race he won, leading to a radical shift in the way "
2378 "that antitrust concerns are handled in America. Reagan’s cohort of "
2379 "politicians — including Margaret Thatcher in the U.K., Brian Mulroney in "
2380 "Canada, Helmut Kohl in Germany, and Augusto Pinochet in Chile — went on to "
2381 "enact similar reforms that eventually spread around the world."
2384 #. type: Content of: <book><chapter><sect1><para>
2386 "Antitrust’s story began nearly a century before all that with laws like the "
2387 "Sherman Act, which took aim at monopolists on the grounds that monopolies "
2388 "were bad in and of themselves — squeezing out competitors, creating "
2389 "<quote>diseconomies of scale</quote> (when a company is so big that its "
2390 "constituent parts go awry and it is seemingly helpless to address the "
2391 "problems), and capturing their regulators to such a degree that they can get "
2392 "away with a host of evils."
2395 #. type: Content of: <book><chapter><sect1><para>
2397 "Then came a fabulist named Robert Bork, a former solicitor general who "
2398 "Reagan appointed to the powerful U.S. Court of Appeals for the D.C. Circuit "
2399 "and who had created an alternate legislative history of the Sherman Act and "
2400 "its successors out of whole cloth. Bork insisted that these statutes were "
2401 "never targeted at monopolies (despite a wealth of evidence to the contrary, "
2402 "including the transcribed speeches of the acts’ authors) but, rather, that "
2403 "they were intended to prevent <quote>consumer harm</quote> — in the form of "
2407 #. type: Content of: <book><chapter><sect1><para>
2409 "Bork was a crank, but he was a crank with a theory that rich people really "
2410 "liked. Monopolies are a great way to make rich people richer by allowing "
2411 "them to receive <quote>monopoly rents</quote> (that is, bigger profits) and "
2412 "capture regulators, leading to a weaker, more favorable regulatory "
2413 "environment with fewer protections for customers, suppliers, the "
2414 "environment, and workers."
2417 #. type: Content of: <book><chapter><sect1><para>
2419 "Bork’s theories were especially palatable to the same power brokers who "
2420 "backed Reagan, and Reagan’s Department of Justice and other agencies began "
2421 "to incorporate Bork’s antitrust doctrine into their enforcement decisions "
2422 "(Reagan even put Bork up for a Supreme Court seat, but Bork flunked the "
2423 "Senate confirmation hearing so badly that, 40 years later, D.C. insiders use "
2424 "the term <quote>borked</quote> to refer to any catastrophically bad "
2425 "political performance)."
2428 #. type: Content of: <book><chapter><sect1><para>
2430 "Little by little, Bork’s theories entered the mainstream, and their backers "
2431 "began to infiltrate the legal education field, even putting on junkets where "
2432 "members of the judiciary were treated to lavish meals, fun outdoor "
2433 "activities, and seminars where they were indoctrinated into the consumer "
2434 "harm theory of antitrust. The more Bork’s theories took hold, the more money "
2435 "the monopolists were making — and the more surplus capital they had at their "
2436 "disposal to lobby for even more Borkian antitrust influence campaigns."
2439 #. type: Content of: <book><chapter><sect1><para>
2441 "The history of Bork’s antitrust theories is a really good example of the "
2442 "kind of covertly engineered shifts in public opinion that Zuboff warns us "
2443 "against, where fringe ideas become mainstream orthodoxy. But Bork didn’t "
2444 "change the world overnight. He played a very long game, for over a "
2445 "generation, and he had a tailwind because the same forces that backed "
2446 "oligarchic antitrust theories also backed many other oligarchic shifts in "
2447 "public opinion. For example, the idea that taxation is theft, that wealth is "
2448 "a sign of virtue, and so on — all of these theories meshed to form a "
2449 "coherent ideology that elevated inequality to a virtue."
2452 #. type: Content of: <book><chapter><sect1><para>
2454 "Today, many fear that machine learning allows surveillance capitalism to "
2455 "sell <quote>Bork-as-a-Service,</quote> at internet speeds, so that you can "
2456 "contract a machine-learning company to engineer <emphasis>rapid</emphasis> "
2457 "shifts in public sentiment without needing the capital to sustain a "
2458 "multipronged, multigenerational project working at the local, state, "
2459 "national, and global levels in business, law, and philosophy. I do not "
2460 "believe that such a project is plausible, though I agree that this is "
2461 "basically what the platforms claim to be selling. They’re just lying about "
2462 "it. Big Tech lies all the time, <emphasis>including</emphasis> in their "
2466 #. type: Content of: <book><chapter><sect1><para>
2468 "The idea that tech forms <quote>natural monopolies</quote> (monopolies that "
2469 "are the inevitable result of the realities of an industry, such as the "
2470 "monopolies that accrue the first company to run long-haul phone lines or "
2471 "rail lines) is belied by tech’s own history: In the absence of anti-"
2472 "competitive tactics, Google was able to unseat AltaVista and Yahoo; Facebook "
2473 "was able to head off Myspace. There are some advantages to gathering "
2474 "mountains of data, but those mountains of data also have disadvantages: "
2475 "liability (from leaking), diminishing returns (from old data), and "
2476 "institutional inertia (big companies, like science, progress one funeral at "
2480 #. type: Content of: <book><chapter><sect1><para>
2482 "Indeed, the birth of the web saw a mass-extinction event for the existing "
2483 "giant, wildly profitable proprietary technologies that had capital, network "
2484 "effects, and walls and moats surrounding their businesses. The web showed "
2485 "that when a new industry is built around a protocol, rather than a product, "
2486 "the combined might of everyone who uses the protocol to reach their "
2487 "customers or users or communities outweighs even the most massive products. "
2488 "CompuServe, AOL, MSN, and a host of other proprietary walled gardens learned "
2489 "this lesson the hard way: Each believed it could stay separate from the web, "
2490 "offering <quote>curation</quote> and a guarantee of consistency and quality "
2491 "instead of the chaos of an open system. Each was wrong and ended up being "
2492 "absorbed into the public web."
2495 #. type: Content of: <book><chapter><sect1><para>
2497 "Yes, tech is heavily monopolized and is now closely associated with industry "
2498 "concentration, but this has more to do with a matter of timing than its "
2499 "intrinsically monopolistic tendencies. Tech was born at the moment that "
2500 "antitrust enforcement was being dismantled, and tech fell into exactly the "
2501 "same pathologies that antitrust was supposed to guard against. To a first "
2502 "approximation, it is reasonable to assume that tech’s monopolies are the "
2503 "result of a lack of anti-monopoly action and not the much-touted unique "
2504 "characteristics of tech, such as network effects, first-mover advantage, and "
2508 #. type: Content of: <book><chapter><sect1><para>
2510 "In support of this thesis, I offer the concentration that every "
2511 "<emphasis>other</emphasis> industry has undergone over the same period. From "
2512 "professional wrestling to consumer packaged goods to commercial property "
2513 "leasing to banking to sea freight to oil to record labels to newspaper "
2514 "ownership to theme parks, <emphasis>every</emphasis> industry has undergone "
2515 "a massive shift toward concentration. There’s no obvious network effects or "
2516 "first-mover advantage at play in these industries. However, in every case, "
2517 "these industries attained their concentrated status through tactics that "
2518 "were prohibited before Bork’s triumph: merging with major competitors, "
2519 "buying out innovative new market entrants, horizontal and vertical "
2520 "integration, and a suite of anti-competitive tactics that were once illegal "
2521 "but are not any longer."
2524 #. type: Content of: <book><chapter><sect1><para>
2526 "Again: When you change the laws intended to prevent monopolies and then "
2527 "monopolies form in exactly the way the law was supposed to prevent, it is "
2528 "reasonable to suppose that these facts are related. Tech’s concentration "
2529 "can be readily explained without recourse to radical theories of network "
2530 "effects — but only if you’re willing to indict unregulated markets as "
2531 "tending toward monopoly. Just as a lifelong smoker can give you a hundred "
2532 "reasons why their smoking didn’t cause their cancer (<quote>It was the "
2533 "environmental toxins</quote>), true believers in unregulated markets have a "
2534 "whole suite of unconvincing explanations for monopoly in tech that leave "
2535 "capitalism intact."
2538 #. type: Content of: <book><chapter><sect1><title>
2539 msgid "Steering with the windshield wipers"
2542 #. type: Content of: <book><chapter><sect1><para>
2544 "It’s been 40 years since Bork’s project to rehabilitate monopolies achieved "
2545 "liftoff, and that is a generation and a half, which is plenty of time to "
2546 "take a common idea and make it seem outlandish and vice versa. Before the "
2547 "1940s, affluent Americans dressed their baby boys in pink while baby girls "
2548 "wore blue (a <quote>delicate and dainty</quote> color). While gendered "
2549 "colors are obviously totally arbitrary, many still greet this news with "
2550 "amazement and find it hard to imagine a time when pink connoted masculinity."
2553 #. type: Content of: <book><chapter><sect1><para>
2555 "After 40 years of studiously ignoring antitrust analysis and enforcement, "
2556 "it’s not surprising that we’ve all but forgotten that antitrust exists, that "
2557 "in living memory, growth through mergers and acquisitions were largely "
2558 "prohibited under law, that market-cornering strategies like vertical "
2559 "integration could land a company in court."
2562 #. type: Content of: <book><chapter><sect1><para>
2564 "Antitrust is a market society’s steering wheel, the control of first resort "
2565 "to keep would-be masters of the universe in their lanes. But Bork and his "
2566 "cohort ripped out our steering wheel 40 years ago. The car is still "
2567 "barreling along, and so we’re yanking as hard as we can on all the "
2568 "<emphasis>other</emphasis> controls in the car as well as desperately "
2569 "flapping the doors and rolling the windows up and down in the hopes that one "
2570 "of these other controls can be repurposed to let us choose where we’re "
2571 "heading before we careen off a cliff."
2574 #. type: Content of: <book><chapter><sect1><para>
2576 "It’s like a 1960s science-fiction plot come to life: People stuck in a "
2577 "<quote>generation ship,</quote> plying its way across the stars, a ship once "
2578 "piloted by their ancestors; and now, after a great cataclysm, the ship’s "
2579 "crew have forgotten that they’re in a ship at all and no longer remember "
2580 "where the control room is. Adrift, the ship is racing toward its extinction, "
2581 "and unless we can seize the controls and execute emergency course "
2582 "correction, we’re all headed for a fiery death in the heart of a sun."
2585 #. type: Content of: <book><chapter><sect1><title>
2586 msgid "Surveillance still matters"
2589 #. type: Content of: <book><chapter><sect1><para>
2591 "None of this is to minimize the problems with surveillance. Surveillance "
2592 "matters, and Big Tech’s use of surveillance <emphasis>is</emphasis> an "
2593 "existential risk to our species, but that’s not because surveillance and "
2594 "machine learning rob us of our free will."
2597 #. type: Content of: <book><chapter><sect1><para>
2599 "Surveillance has become <emphasis>much</emphasis> more efficient thanks to "
2600 "Big Tech. In 1989, the Stasi — the East German secret police — had the whole "
2601 "country under surveillance, a massive undertaking that recruited one out of "
2602 "every 60 people to serve as an informant or intelligence operative."
2605 #. type: Content of: <book><chapter><sect1><para>
2607 "Today, we know that the NSA is spying on a significant fraction of the "
2608 "entire world’s population, and its ratio of surveillance operatives to the "
2609 "surveilled is more like 1:10,000 (that’s probably on the low side since it "
2610 "assumes that every American with top-secret clearance is working for the NSA "
2611 "on this project — we don’t know how many of those cleared people are "
2612 "involved in NSA spying, but it’s definitely not all of them)."
2615 #. type: Content of: <book><chapter><sect1><para>
2617 "How did the ratio of surveillable citizens expand from 1:60 to 1:10,000 in "
2618 "less than 30 years? It’s thanks to Big Tech. Our devices and services gather "
2619 "most of the data that the NSA mines for its surveillance project. We pay for "
2620 "these devices and the services they connect to, and then we painstakingly "
2621 "perform the data-entry tasks associated with logging facts about our lives, "
2622 "opinions, and preferences. This mass surveillance project has been largely "
2623 "useless for fighting terrorism: The NSA can <ulink url=\"https://www."
2624 "washingtonpost.com/world/national-security/nsa-cites-case-as-success-of-"
2625 "phone-data-collection-program/2013/08/08/fc915e5a-feda-11e2-96a8-"
2626 "d3b921c0924a_story.html\">only point to a single minor success story</ulink> "
2627 "in which it used its data collection program to foil an attempt by a U.S. "
2628 "resident to wire a few thousand dollars to an overseas terror group. It’s "
2629 "ineffective for much the same reason that commercial surveillance projects "
2630 "are largely ineffective at targeting advertising: The people who want to "
2631 "commit acts of terror, like people who want to buy a refrigerator, are "
2632 "extremely rare. If you’re trying to detect a phenomenon whose base rate is "
2633 "one in a million with an instrument whose accuracy is only 99%, then every "
2634 "true positive will come at the cost of 9,999 false positives."
2637 #. type: Content of: <book><chapter><sect1><para>
2639 "Let me explain that again: If one in a million people is a terrorist, then "
2640 "there will only be about one terrorist in a random sample of one million "
2641 "people. If your test for detecting terrorists is 99% accurate, it will "
2642 "identify 10,000 terrorists in your million-person sample (1% of one million "
2643 "is 10,000). For every true positive, you’ll get 9,999 false positives."
2646 #. type: Content of: <book><chapter><sect1><para>
2648 "In reality, the accuracy of algorithmic terrorism detection falls far short "
2649 "of the 99% mark, as does refrigerator ad targeting. The difference is that "
2650 "being falsely accused of wanting to buy a fridge is a minor nuisance while "
2651 "being falsely accused of planning a terror attack can destroy your life and "
2652 "the lives of everyone you love."
2655 #. type: Content of: <book><chapter><sect1><para>
2657 "Mass state surveillance is only feasible because of surveillance capitalism "
2658 "and its extremely low-yield ad-targeting systems, which require a constant "
2659 "feed of personal data to remain barely viable. Surveillance capitalism’s "
2660 "primary failure mode is mistargeted ads while mass state surveillance’s "
2661 "primary failure mode is grotesque human rights abuses, tending toward "
2665 #. type: Content of: <book><chapter><sect1><para>
2667 "State surveillance is no mere parasite on Big Tech, sucking up its data and "
2668 "giving nothing in return. In truth, the two are symbiotes: Big Tech sucks up "
2669 "our data for spy agencies, and spy agencies ensure that governments don’t "
2670 "limit Big Tech’s activities so severely that it would no longer serve the "
2671 "spy agencies’ needs. There is no firm distinction between state surveillance "
2672 "and surveillance capitalism; they are dependent on one another."
2675 #. type: Content of: <book><chapter><sect1><para>
2677 "To see this at work today, look no further than Amazon’s home surveillance "
2678 "device, the Ring doorbell, and its associated app, Neighbors. Ring — a "
2679 "product that Amazon acquired and did not develop in house — makes a camera-"
2680 "enabled doorbell that streams footage from your front door to your mobile "
2681 "device. The Neighbors app allows you to form a neighborhood-wide "
2682 "surveillance grid with your fellow Ring owners through which you can share "
2683 "clips of <quote>suspicious characters.</quote> If you’re thinking that this "
2684 "sounds like a recipe for letting curtain-twitching racists supercharge their "
2685 "suspicions of people with brown skin who walk down their blocks, <ulink url="
2686 "\"https://www.eff.org/deeplinks/2020/07/amazons-ring-enables-over-policing-"
2687 "efforts-some-americas-deadliest-law-enforcement\">you’re right</ulink>. Ring "
2688 "has become a <emphasis>de facto,</emphasis> off-the-books arm of the police "
2689 "without any of the pesky oversight or rules."
2692 #. type: Content of: <book><chapter><sect1><para>
2694 "In mid-2019, a series of public records requests revealed that Amazon had "
2695 "struck confidential deals with more than 400 local law enforcement agencies "
2696 "through which the agencies would promote Ring and Neighbors and in exchange "
2697 "get access to footage from Ring cameras. In theory, cops would need to "
2698 "request this footage through Amazon (and internal documents reveal that "
2699 "Amazon devotes substantial resources to coaching cops on how to spin a "
2700 "convincing story when doing so), but in practice, when a Ring customer turns "
2701 "down a police request, Amazon only requires the agency to formally request "
2702 "the footage from the company, which it will then produce."
2705 #. type: Content of: <book><chapter><sect1><para>
2707 "Ring and law enforcement have found many ways to intertwine their "
2708 "activities. Ring strikes secret deals to acquire real-time access to 911 "
2709 "dispatch and then streams alarming crime reports to Neighbors users, which "
2710 "serve as convincers for anyone who’s contemplating a surveillance doorbell "
2711 "but isn’t sure whether their neighborhood is dangerous enough to warrant it."
2714 #. type: Content of: <book><chapter><sect1><para>
2716 "The more the cops buzz-market the surveillance capitalist Ring, the more "
2717 "surveillance capability the state gets. Cops who rely on private entities "
2718 "for law-enforcement roles then brief against any controls on the deployment "
2719 "of that technology while the companies return the favor by lobbying against "
2720 "rules requiring public oversight of police surveillance technology. The more "
2721 "the cops rely on Ring and Neighbors, the harder it will be to pass laws to "
2722 "curb them. The fewer laws there are against them, the more the cops will "
2726 #. type: Content of: <book><chapter><sect1><title>
2727 msgid "Dignity and sanctuary"
2730 #. type: Content of: <book><chapter><sect1><para>
2732 "But even if we could exercise democratic control over our states and force "
2733 "them to stop raiding surveillance capitalism’s reservoirs of behavioral "
2734 "data, surveillance capitalism would still harm us."
2737 #. type: Content of: <book><chapter><sect1><para>
2739 "This is an area where Zuboff shines. Her chapter on <quote>sanctuary</quote> "
2740 "— the feeling of being unobserved — is a beautiful hymn to introspection, "
2741 "calmness, mindfulness, and tranquility."
2744 #. type: Content of: <book><chapter><sect1><para>
2746 "When you are watched, something changes. Anyone who has ever raised a child "
2747 "knows this. You might look up from your book (or more realistically, from "
2748 "your phone) and catch your child in a moment of profound realization and "
2749 "growth, a moment where they are learning something that is right at the edge "
2750 "of their abilities, requiring their entire ferocious concentration. For a "
2751 "moment, you’re transfixed, watching that rare and beautiful moment of focus "
2752 "playing out before your eyes, and then your child looks up and sees you "
2753 "seeing them, and the moment collapses. To grow, you need to be and expose "
2754 "your authentic self, and in that moment, you are vulnerable like a hermit "
2755 "crab scuttling from one shell to the next. The tender, unprotected tissues "
2756 "you expose in that moment are too delicate to reveal in the presence of "
2757 "another, even someone you trust as implicitly as a child trusts their parent."
2760 #. type: Content of: <book><chapter><sect1><para>
2762 "In the digital age, our authentic selves are inextricably tied to our "
2763 "digital lives. Your search history is a running ledger of the questions "
2764 "you’ve pondered. Your location history is a record of the places you’ve "
2765 "sought out and the experiences you’ve had there. Your social graph reveals "
2766 "the different facets of your identity, the people you’ve connected with."
2769 #. type: Content of: <book><chapter><sect1><para>
2771 "To be observed in these activities is to lose the sanctuary of your "
2775 #. type: Content of: <book><chapter><sect1><para>
2777 "There’s another way in which surveillance capitalism robs us of our capacity "
2778 "to be our authentic selves: by making us anxious. Surveillance capitalism "
2779 "isn’t really a mind-control ray, but you don’t need a mind-control ray to "
2780 "make someone anxious. After all, another word for anxiety is agitation, and "
2781 "to make someone experience agitation, you need merely to agitate them. To "
2782 "poke them and prod them and beep at them and buzz at them and bombard them "
2783 "on an intermittent schedule that is just random enough that our limbic "
2784 "systems never quite become inured to it."
2787 #. type: Content of: <book><chapter><sect1><para>
2789 "Our devices and services are <quote>general purpose</quote> in that they can "
2790 "connect anything or anyone to anything or anyone else and that they can run "
2791 "any program that can be written. This means that the distraction rectangles "
2792 "in our pockets hold our most precious moments with our most beloved people "
2793 "and their most urgent or time-sensitive communications (from <quote>running "
2794 "late can you get the kid?</quote> to <quote>doctor gave me bad news and I "
2795 "need to talk to you RIGHT NOW</quote>) as well as ads for refrigerators and "
2796 "recruiting messages from Nazis."
2799 #. type: Content of: <book><chapter><sect1><para>
2801 "All day and all night, our pockets buzz, shattering our concentration and "
2802 "tearing apart the fragile webs of connection we spin as we think through "
2803 "difficult ideas. If you locked someone in a cell and agitated them like "
2804 "this, we’d call it <quote>sleep deprivation torture,</quote> and it would be "
2805 "<ulink url=\"https://www.youtube.com/watch?v=1SKpRbvnx6g\">a war crime under "
2806 "the Geneva Conventions</ulink>."
2809 #. type: Content of: <book><chapter><sect1><title>
2810 msgid "Afflicting the afflicted"
2813 #. type: Content of: <book><chapter><sect1><para>
2815 "The effects of surveillance on our ability to be our authentic selves are "
2816 "not equal for all people. Some of us are lucky enough to live in a time and "
2817 "place in which all the most important facts of our lives are widely and "
2818 "roundly socially acceptable and can be publicly displayed without the risk "
2819 "of social consequence."
2822 #. type: Content of: <book><chapter><sect1><para>
2824 "But for many of us, this is not true. Recall that in living memory, many of "
2825 "the ways of being that we think of as socially acceptable today were once "
2826 "cause for dire social sanction or even imprisonment. If you are 65 years "
2827 "old, you have lived through a time in which people living in <quote>free "
2828 "societies</quote> could be imprisoned or sanctioned for engaging in "
2829 "homosexual activity, for falling in love with a person whose skin was a "
2830 "different color than their own, or for smoking weed."
2833 #. type: Content of: <book><chapter><sect1><para>
2835 "Today, these activities aren’t just decriminalized in much of the world, "
2836 "they’re considered normal, and the fallen prohibitions are viewed as "
2837 "shameful, regrettable relics of the past."
2840 #. type: Content of: <book><chapter><sect1><para>
2842 "How did we get from prohibition to normalization? Through private, personal "
2843 "activity: People who were secretly gay or secret pot-smokers or who secretly "
2844 "loved someone with a different skin color were vulnerable to retaliation if "
2845 "they made their true selves known and were limited in how much they could "
2846 "advocate for their own right to exist in the world and be true to "
2847 "themselves. But because there was a private sphere, these people could form "
2848 "alliances with their friends and loved ones who did not share their "
2849 "disfavored traits by having private conversations in which they came out, "
2850 "disclosing their true selves to the people around them and bringing them to "
2851 "their cause one conversation at a time."
2854 #. type: Content of: <book><chapter><sect1><para>
2856 "The right to choose the time and manner of these conversations was key to "
2857 "their success. It’s one thing to come out to your dad while you’re on a "
2858 "fishing trip away from the world and another thing entirely to blurt it out "
2859 "over the Christmas dinner table while your racist Facebook uncle is there to "
2863 #. type: Content of: <book><chapter><sect1><para>
2865 "Without a private sphere, there’s a chance that none of these changes would "
2866 "have come to pass and that the people who benefited from these changes would "
2867 "have either faced social sanction for coming out to a hostile world or would "
2868 "have never been able to reveal their true selves to the people they love."
2871 #. type: Content of: <book><chapter><sect1><para>
2873 "The corollary is that, unless you think that our society has attained social "
2874 "perfection — that your grandchildren in 50 years will ask you to tell them "
2875 "the story of how, in 2020, every injustice had been righted and no further "
2876 "change had to be made — then you should expect that right now, at this "
2877 "minute, there are people you love, whose happiness is key to your own, who "
2878 "have a secret in their hearts that stops them from ever being their "
2879 "authentic selves with you. These people are sorrowing and will go to their "
2880 "graves with that secret sorrow in their hearts, and the source of that "
2881 "sorrow will be the falsity of their relationship to you."
2884 #. type: Content of: <book><chapter><sect1><para>
2885 msgid "A private realm is necessary for human progress."
2888 #. type: Content of: <book><chapter><sect1><title>
2889 msgid "Any data you collect and retain will eventually leak"
2890 msgstr "Alle data du samler og tar vare på vil til slutt lekke"
2892 #. type: Content of: <book><chapter><sect1><para>
2894 "The lack of a private life can rob vulnerable people of the chance to be "
2895 "their authentic selves and constrain our actions by depriving us of "
2896 "sanctuary, but there is another risk that is borne by everyone, not just "
2897 "people with a secret: crime."
2900 #. type: Content of: <book><chapter><sect1><para>
2902 "Personally identifying information is of very limited use for the purpose of "
2903 "controlling peoples’ minds, but identity theft — really a catchall term for "
2904 "a whole constellation of terrible criminal activities that can destroy your "
2905 "finances, compromise your personal integrity, ruin your reputation, or even "
2906 "expose you to physical danger — thrives on it."
2909 #. type: Content of: <book><chapter><sect1><para>
2911 "Attackers are not limited to using data from one breached source, either. "
2912 "Multiple services have suffered breaches that exposed names, addresses, "
2913 "phone numbers, passwords, sexual tastes, school grades, work performance, "
2914 "brushes with the criminal justice system, family details, genetic "
2915 "information, fingerprints and other biometrics, reading habits, search "
2916 "histories, literary tastes, pseudonymous identities, and other sensitive "
2917 "information. Attackers can merge data from these different breaches to build "
2918 "up extremely detailed dossiers on random subjects and then use different "
2919 "parts of the data for different criminal purposes."
2922 #. type: Content of: <book><chapter><sect1><para>
2924 "For example, attackers can use leaked username and password combinations to "
2925 "hijack whole fleets of commercial vehicles that <ulink url=\"https://www."
2926 "vice.com/en_us/article/zmpx4x/hacker-monitor-cars-kill-engine-gps-tracking-"
2927 "apps\">have been fitted with anti-theft GPS trackers and immobilizers</"
2928 "ulink> or to hijack baby monitors in order to <ulink url=\"https://www."
2929 "washingtonpost.com/technology/2019/04/23/how-nest-designed-keep-intruders-"
2930 "out-peoples-homes-effectively-allowed-hackers-get/?"
2931 "utm_term=.15220e98c550\">terrorize toddlers with the audio tracks from "
2932 "pornography</ulink>. Attackers use leaked data to trick phone companies into "
2933 "giving them your phone number, then they intercept SMS-based two-factor "
2934 "authentication codes in order to take over your email, bank account, and/or "
2935 "cryptocurrency wallets."
2938 #. type: Content of: <book><chapter><sect1><para>
2940 "Attackers are endlessly inventive in the pursuit of creative ways to "
2941 "weaponize leaked data. One common use of leaked data is to penetrate "
2942 "companies in order to access <emphasis>more</emphasis> data."
2945 #. type: Content of: <book><chapter><sect1><para>
2947 "Like spies, online fraudsters are totally dependent on companies over-"
2948 "collecting and over-retaining our data. Spy agencies sometimes pay companies "
2949 "for access to their data or intimidate them into giving it up, but sometimes "
2950 "they work just like criminals do — by <ulink url=\"https://www.bbc.com/news/"
2951 "world-us-canada-24751821\">sneaking data out of companies’ databases</ulink>."
2954 #. type: Content of: <book><chapter><sect1><para>
2956 "The over-collection of data has a host of terrible social consequences, from "
2957 "the erosion of our authentic selves to the undermining of social progress, "
2958 "from state surveillance to an epidemic of online crime. Commercial "
2959 "surveillance is also a boon to people running influence campaigns, but "
2960 "that’s the least of our troubles."
2963 #. type: Content of: <book><chapter><sect1><title>
2964 msgid "Critical tech exceptionalism is still tech exceptionalism"
2967 #. type: Content of: <book><chapter><sect1><para>
2969 "Big Tech has long practiced technology exceptionalism: the idea that it "
2970 "should not be subject to the mundane laws and norms of <quote>meatspace.</"
2971 "quote> Mottoes like Facebook’s <quote>move fast and break things</quote> "
2972 "attracted justifiable scorn of the companies’ self-serving rhetoric."
2975 #. type: Content of: <book><chapter><sect1><para>
2977 "Tech exceptionalism got us all into a lot of trouble, so it’s ironic and "
2978 "distressing to see Big Tech’s critics committing the same sin."
2981 #. type: Content of: <book><chapter><sect1><para>
2983 "Big Tech is not a <quote>rogue capitalism</quote> that cannot be cured "
2984 "through the traditional anti-monopoly remedies of trustbusting (forcing "
2985 "companies to divest of competitors they have acquired) and bans on mergers "
2986 "to monopoly and other anti-competitive tactics. Big Tech does not have the "
2987 "power to use machine learning to influence our behavior so thoroughly that "
2988 "markets lose the ability to punish bad actors and reward superior "
2989 "competitors. Big Tech has no rule-writing mind-control ray that necessitates "
2990 "ditching our old toolbox."
2993 #. type: Content of: <book><chapter><sect1><para>
2995 "The thing is, people have been claiming to have perfected mind-control rays "
2996 "for centuries, and every time, it turned out to be a con — though sometimes "
2997 "the con artists were also conning themselves."
3000 #. type: Content of: <book><chapter><sect1><para>
3002 "For generations, the advertising industry has been steadily improving its "
3003 "ability to sell advertising services to businesses while only making "
3004 "marginal gains in selling those businesses’ products to prospective "
3005 "customers. John Wanamaker’s lament that <quote>50% of my advertising budget "
3006 "is wasted, I just don’t know which 50%</quote> is a testament to the triumph "
3007 "of <emphasis>ad executives</emphasis>, who successfully convinced Wanamaker "
3008 "that only half of the money he spent went to waste."
3011 #. type: Content of: <book><chapter><sect1><para>
3013 "The tech industry has made enormous improvements in the science of "
3014 "convincing businesses that they’re good at advertising while their actual "
3015 "improvements to advertising — as opposed to targeting — have been pretty ho-"
3016 "hum. The vogue for machine learning — and the mystical invocation of "
3017 "<quote>artificial intelligence</quote> as a synonym for straightforward "
3018 "statistical inference techniques — has greatly boosted the efficacy of Big "
3019 "Tech’s sales pitch as marketers have exploited potential customers’ lack of "
3020 "technical sophistication to get away with breathtaking acts of overpromising "
3021 "and underdelivering."
3024 #. type: Content of: <book><chapter><sect1><para>
3026 "It’s tempting to think that if businesses are willing to pour billions into "
3027 "a venture that the venture must be a good one. Yet there are plenty of times "
3028 "when this rule of thumb has led us astray. For example, it’s virtually "
3029 "unheard of for managed investment funds to outperform simple index funds, "
3030 "and investors who put their money into the hands of expert money managers "
3031 "overwhelmingly fare worse than those who entrust their savings to index "
3032 "funds. But managed funds still account for the majority of the money "
3033 "invested in the markets, and they are patronized by some of the richest, "
3034 "most sophisticated investors in the world. Their vote of confidence in an "
3035 "underperforming sector is a parable about the role of luck in wealth "
3036 "accumulation, not a sign that managed funds are a good buy."
3039 #. type: Content of: <book><chapter><sect1><para>
3041 "The claims of Big Tech’s mind-control system are full of tells that the "
3042 "enterprise is a con. For example, <ulink url=\"https://www.frontiersin.org/"
3043 "articles/10.3389/fpsyg.2020.01415/full\">the reliance on the <quote>Big "
3044 "Five</quote> personality traits</ulink> as a primary means of influencing "
3045 "people even though the <quote>Big Five</quote> theory is unsupported by any "
3046 "large-scale, peer-reviewed studies and is <ulink url=\"https://www.wired.com/"
3047 "story/the-noisy-fallacies-of-psychographic-targeting/\">mostly the realm of "
3048 "marketing hucksters and pop psych</ulink>."
3051 #. type: Content of: <book><chapter><sect1><para>
3053 "Big Tech’s promotional materials also claim that their algorithms can "
3054 "accurately perform <quote>sentiment analysis</quote> or detect peoples’ "
3055 "moods based on their <quote>microexpressions,</quote> but <ulink url="
3056 "\"https://www.npr.org/2018/09/12/647040758/advertising-on-facebook-is-it-"
3057 "worth-it\">these are marketing claims, not scientific ones</ulink>. These "
3058 "methods are largely untested by independent scientific experts, and where "
3059 "they have been tested, they’ve been found sorely wanting. Microexpressions "
3060 "are particularly suspect as the companies that specialize in training people "
3061 "to detect them <ulink url=\"https://theintercept.com/2017/02/08/tsas-own-"
3062 "files-show-doubtful-science-behind-its-behavior-screening-program/\">have "
3063 "been shown</ulink> to underperform relative to random chance."
3066 #. type: Content of: <book><chapter><sect1><para>
3068 "Big Tech has been so good at marketing its own supposed superpowers that "
3069 "it’s easy to believe that they can market everything else with similar "
3070 "acumen, but it’s a mistake to believe the hype. Any statement a company "
3071 "makes about the quality of its products is clearly not impartial. The fact "
3072 "that we distrust all the things that Big Tech says about its data handling, "
3073 "compliance with privacy laws, etc., is only reasonable — but why on Earth "
3074 "would we treat Big Tech’s marketing literature as the gospel truth? Big Tech "
3075 "lies about just about <emphasis>everything</emphasis>, including how well "
3076 "its machine-learning fueled persuasion systems work."
3079 #. type: Content of: <book><chapter><sect1><para>
3081 "That skepticism should infuse all of our evaluations of Big Tech and its "
3082 "supposed abilities, including our perusal of its patents. Zuboff vests these "
3083 "patents with enormous significance, pointing out that Google claimed "
3084 "extensive new persuasion capabilities in <ulink url=\"https://patents.google."
3085 "com/patent/US20050131762A1/en\">its patent filings</ulink>. These claims are "
3086 "doubly suspect: first, because they are so self-serving, and second, because "
3087 "the patent itself is so notoriously an invitation to exaggeration."
3090 #. type: Content of: <book><chapter><sect1><para>
3092 "Patent applications take the form of a series of claims and range from broad "
3093 "to narrow. A typical patent starts out by claiming that its authors have "
3094 "invented a method or system for doing every conceivable thing that anyone "
3095 "might do, ever, with any tool or device. Then it narrows that claim in "
3096 "successive stages until we get to the actual <quote>invention</quote> that "
3097 "is the true subject of the patent. The hope is that the patent examiner — "
3098 "who is almost certainly overworked and underinformed — will miss the fact "
3099 "that some or all of these claims are ridiculous, or at least suspect, and "
3100 "grant the patent’s broader claims. Patents for unpatentable things are still "
3101 "incredibly useful because they can be wielded against competitors who might "
3102 "license that patent or steer clear of its claims rather than endure the "
3103 "lengthy, expensive process of contesting it."
3106 #. type: Content of: <book><chapter><sect1><para>
3108 "What’s more, software patents are routinely granted even though the filer "
3109 "doesn’t have any evidence that they can do the thing claimed by the patent. "
3110 "That is, you can patent an <quote>invention</quote> that you haven’t "
3111 "actually made and that you don’t know how to make."
3114 #. type: Content of: <book><chapter><sect1><para>
3116 "With these considerations in hand, it becomes obvious that the fact that a "
3117 "Big Tech company has patented what it <emphasis>says</emphasis> is an "
3118 "effective mind-control ray is largely irrelevant to whether Big Tech can in "
3119 "fact control our minds."
3122 #. type: Content of: <book><chapter><sect1><para>
3124 "Big Tech collects our data for many reasons, including the diminishing "
3125 "returns on existing stores of data. But many tech companies also collect "
3126 "data out of a mistaken tech exceptionalist belief in the network effects of "
3127 "data. Network effects occur when each new user in a system increases its "
3128 "value. The classic example is fax machines: A single fax machine is of no "
3129 "use, two fax machines are of limited use, but every new fax machine that’s "
3130 "put to use after the first doubles the number of possible fax-to-fax links."
3133 #. type: Content of: <book><chapter><sect1><para>
3135 "Data mined for predictive systems doesn’t necessarily produce these "
3136 "dividends. Think of Netflix: The predictive value of the data mined from a "
3137 "million English-speaking Netflix viewers is hardly improved by the addition "
3138 "of one more user’s viewing data. Most of the data Netflix acquires after "
3139 "that first minimum viable sample duplicates existing data and produces only "
3140 "minimal gains. Meanwhile, retraining models with new data gets progressively "
3141 "more expensive as the number of data points increases, and manual tasks like "
3142 "labeling and validating data do not get cheaper at scale."
3145 #. type: Content of: <book><chapter><sect1><para>
3147 "Businesses pursue fads to the detriment of their profits all the time, "
3148 "especially when the businesses and their investors are not motivated by the "
3149 "prospect of becoming profitable but rather by the prospect of being acquired "
3150 "by a Big Tech giant or by having an IPO. For these firms, ticking faddish "
3151 "boxes like <quote>collects as much data as possible</quote> might realize a "
3152 "bigger return on investment than <quote>collects a business-appropriate "
3153 "quantity of data.</quote>"
3156 #. type: Content of: <book><chapter><sect1><para>
3158 "This is another harm of tech exceptionalism: The belief that more data "
3159 "always produces more profits in the form of more insights that can be "
3160 "translated into better mind-control rays drives firms to over-collect and "
3161 "over-retain data beyond all rationality. And since the firms are behaving "
3162 "irrationally, a good number of them will go out of business and become ghost "
3163 "ships whose cargo holds are stuffed full of data that can harm people in "
3164 "myriad ways — but which no one is responsible for antey longer. Even if the "
3165 "companies don’t go under, the data they collect is maintained behind the "
3166 "minimum viable security — just enough security to keep the company viable "
3167 "while it waits to get bought out by a tech giant, an amount calculated to "
3168 "spend not one penny more than is necessary on protecting data."
3171 #. type: Content of: <book><chapter><sect1><title>
3173 "How monopolies, not mind control, drive surveillance capitalism: The "
3177 #. type: Content of: <book><chapter><sect1><para>
3179 "For the first decade of its existence, Facebook competed with the social "
3180 "media giants of the day (Myspace, Orkut, etc.) by presenting itself as the "
3181 "pro-privacy alternative. Indeed, Facebook justified its walled garden — "
3182 "which let users bring in data from the web but blocked web services like "
3183 "Google Search from indexing and caching Facebook pages — as a pro-privacy "
3184 "measure that protected users from the surveillance-happy winners of the "
3185 "social media wars like Myspace."
3188 #. type: Content of: <book><chapter><sect1><para>
3190 "Despite frequent promises that it would never collect or analyze its users’ "
3191 "data, Facebook periodically created initiatives that did just that, like the "
3192 "creepy, ham-fisted Beacon tool, which spied on you as you moved around the "
3193 "web and then added your online activities to your public timeline, allowing "
3194 "your friends to monitor your browsing habits. Beacon sparked a user revolt. "
3195 "Every time, Facebook backed off from its surveillance initiative, but not "
3196 "all the way; inevitably, the new Facebook would be more surveilling than the "
3197 "old Facebook, though not quite as surveilling as the intermediate Facebook "
3198 "following the launch of the new product or service."
3201 #. type: Content of: <book><chapter><sect1><para>
3203 "The pace at which Facebook ramped up its surveillance efforts seems to have "
3204 "been set by Facebook’s competitive landscape. The more competitors Facebook "
3205 "had, the better it behaved. Every time a major competitor foundered, "
3206 "Facebook’s behavior <ulink url=\"https://papers.ssrn.com/sol3/papers.cfm?"
3207 "abstract_id=3247362\">got markedly worse</ulink>."
3210 #. type: Content of: <book><chapter><sect1><para>
3212 "All the while, Facebook was prodigiously acquiring companies, including a "
3213 "company called Onavo. Nominally, Onavo made a battery-monitoring mobile app. "
3214 "But the permissions that Onavo required were so expansive that the app was "
3215 "able to gather fine-grained telemetry on everything users did with their "
3216 "phones, including which apps they used and how they were using them."
3219 #. type: Content of: <book><chapter><sect1><para>
3221 "Through Onavo, Facebook discovered that it was losing market share to "
3222 "Snapchat, an app that — like Facebook a decade before — billed itself as the "
3223 "pro-privacy alternative to the status quo. Through Onavo, Facebook was able "
3224 "to mine data from the devices of Snapchat users, including both current and "
3225 "former Snapchat users. This spurred Facebook to acquire Instagram — some "
3226 "features of which competed with Snapchat — and then allowed Facebook to fine-"
3227 "tune Instagram’s features and sales pitch to erode Snapchat’s gains and "
3228 "ensure that Facebook would not have to face the kinds of competitive "
3229 "pressures it had earlier inflicted on Myspace and Orkut."
3232 #. type: Content of: <book><chapter><sect1><para>
3234 "The story of how Facebook crushed Snapchat reveals the relationship between "
3235 "monopoly and surveillance capitalism. Facebook combined surveillance with "
3236 "lax antitrust enforcement to spot the competitive threat of Snapchat on its "
3237 "horizon and then take decisive action against it. Facebook’s surveillance "
3238 "capitalism let it avert competitive pressure with anti-competitive tactics. "
3239 "Facebook users still want privacy — Facebook hasn’t used surveillance to "
3240 "brainwash them out of it — but they can’t get it because Facebook’s "
3241 "surveillance lets it destroy any hope of a rival service emerging that "
3242 "competes on privacy features."
3245 #. type: Content of: <book><chapter><sect1><title>
3246 msgid "A monopoly over your friends"
3247 msgstr "Et monopol over vennene dine"
3249 #. type: Content of: <book><chapter><sect1><para>
3251 "A decentralization movement has tried to erode the dominance of Facebook and "
3252 "other Big Tech companies by fielding <quote>indieweb</quote> alternatives — "
3253 "Mastodon as a Twitter alternative, Diaspora as a Facebook alternative, etc. "
3254 "— but these efforts have failed to attain any kind of liftoff."
3257 #. type: Content of: <book><chapter><sect1><para>
3259 "Fundamentally, each of these services is hamstrung by the same problem: "
3260 "Every potential user for a Facebook or Twitter alternative has to convince "
3261 "all their friends to follow them to a decentralized web alternative in order "
3262 "to continue to realize the benefit of social media. For many of us, the only "
3263 "reason to have a Facebook account is that our friends have Facebook "
3264 "accounts, and the reason they have Facebook accounts is that <emphasis>we</"
3265 "emphasis> have Facebook accounts."
3268 #. type: Content of: <book><chapter><sect1><para>
3270 "All of this has conspired to make Facebook — and other dominant platforms — "
3271 "into <quote>kill zones</quote> that investors will not fund new entrants for."
3274 #. type: Content of: <book><chapter><sect1><para>
3276 "And yet, all of today’s tech giants came into existence despite the "
3277 "entrenched advantage of the companies that came before them. To understand "
3278 "how that happened, you have to understand both interoperability and "
3279 "adversarial interoperability."
3282 #. type: Content of: <book><chapter><sect1><blockquote><para>
3283 msgid "The hard problem of our species is coordination."
3286 #. type: Content of: <book><chapter><sect1><para>
3288 "<quote>Interoperability</quote> is the ability of two technologies to work "
3289 "with one another: Anyone can make an LP that will play on any record player, "
3290 "anyone can make a filter you can install in your stove’s extractor fan, "
3291 "anyone can make gasoline for your car, anyone can make a USB phone charger "
3292 "that fits in your car’s cigarette lighter receptacle, anyone can make a "
3293 "light bulb that works in your light socket, anyone can make bread that will "
3294 "toast in your toaster."
3297 #. type: Content of: <book><chapter><sect1><para>
3299 "Interoperability is often a source of innovation and consumer benefit: Apple "
3300 "made the first commercially successful PC, but millions of independent "
3301 "software vendors made interoperable programs that ran on the Apple II Plus. "
3302 "The simple analog antenna inputs on the back of TVs first allowed cable "
3303 "operators to connect directly to TVs, then they allowed game console "
3304 "companies and then personal computer companies to use standard televisions "
3305 "as displays. Standard RJ-11 telephone jacks allowed for the production of "
3306 "phones from a variety of vendors in a variety of forms, from the free "
3307 "football-shaped phone that came with a <emphasis>Sports Illustrated</"
3308 "emphasis> subscription to business phones with speakers, hold functions, and "
3309 "so on and then answering machines and finally modems, paving the way for the "
3310 "internet revolution."
3313 #. type: Content of: <book><chapter><sect1><para>
3315 "<quote>Interoperability</quote> is often used interchangeably with "
3316 "<quote>standardization,</quote> which is the process when manufacturers and "
3317 "other stakeholders hammer out a set of agreed-upon rules for implementing a "
3318 "technology, such as the electrical plug on your wall, the CAN bus used by "
3319 "your car’s computer systems, or the HTML instructions that your browser "
3323 #. type: Content of: <book><chapter><sect1><para>
3325 "But interoperability doesn’t require standardization — indeed, "
3326 "standardization often proceeds from the chaos of ad hoc interoperability "
3327 "measures. The inventor of the cigarette-lighter USB charger didn’t need to "
3328 "get permission from car manufacturers or even the manufacturers of the "
3329 "dashboard lighter subcomponent. The automakers didn’t take any "
3330 "countermeasures to prevent the use of these aftermarket accessories by their "
3331 "customers, but they also didn’t do anything to make life easier for the "
3332 "chargers’ manufacturers. This is a kind of <quote>neutral interoperability.</"
3336 #. type: Content of: <book><chapter><sect1><para>
3338 "Beyond neutral interoperability, there is <quote>adversarial "
3339 "interoperability.</quote> That’s when a manufacturer makes a product that "
3340 "interoperates with another manufacturer’s product <emphasis>despite the "
3341 "second manufacturer’s objections</emphasis> and <emphasis>even if that means "
3342 "bypassing a security system designed to prevent interoperability</emphasis>."
3345 #. type: Content of: <book><chapter><sect1><para>
3347 "Probably the most familiar form of adversarial interoperability is third-"
3348 "party printer ink. Printer manufacturers claim that they sell printers below "
3349 "cost and that the only way they can recoup the losses they incur is by "
3350 "charging high markups on ink. To prevent the owners of printers from buying "
3351 "ink elsewhere, the printer companies deploy a suite of anti-customer "
3352 "security systems that detect and reject both refilled and third-party "
3356 #. type: Content of: <book><chapter><sect1><para>
3358 "Owners of printers take the position that HP and Epson and Brother are not "
3359 "charities and that customers for their wares have no obligation to help them "
3360 "survive, and so if the companies choose to sell their products at a loss, "
3361 "that’s their foolish choice and their consequences to live with. Likewise, "
3362 "competitors who make ink or refill kits observe that they don’t owe printer "
3363 "companies anything, and their erosion of printer companies’ margins are the "
3364 "printer companies’ problems, not their competitors’. After all, the printer "
3365 "companies shed no tears when they drive a refiller out of business, so why "
3366 "should the refillers concern themselves with the economic fortunes of the "
3367 "printer companies?"
3370 #. type: Content of: <book><chapter><sect1><para>
3372 "Adversarial interoperability has played an outsized role in the history of "
3373 "the tech industry: from the founding of the <quote>alt.*</quote> Usenet "
3374 "hierarchy (which was started against the wishes of Usenet’s maintainers and "
3375 "which grew to be bigger than all of Usenet combined) to the browser wars "
3376 "(when Netscape and Microsoft devoted massive engineering efforts to making "
3377 "their browsers incompatible with the other’s special commands and "
3378 "peccadilloes) to Facebook (whose success was built in part by helping its "
3379 "new users stay in touch with friends they’d left behind on Myspace because "
3380 "Facebook supplied them with a tool that scraped waiting messages from "
3381 "Myspace and imported them into Facebook, effectively creating an Facebook-"
3382 "based Myspace reader)."
3385 #. type: Content of: <book><chapter><sect1><para>
3387 "Today, incumbency is seen as an unassailable advantage. Facebook is where "
3388 "all of your friends are, so no one can start a Facebook competitor. But "
3389 "adversarial compatibility reverses the competitive advantage: If you were "
3390 "allowed to compete with Facebook by providing a tool that imported all your "
3391 "users’ waiting Facebook messages into an environment that competed on lines "
3392 "that Facebook couldn’t cross, like eliminating surveillance and ads, then "
3393 "Facebook would be at a huge disadvantage. It would have assembled all "
3394 "possible ex-Facebook users into a single, easy-to-find service; it would "
3395 "have educated them on how a Facebook-like service worked and what its "
3396 "potential benefits were; and it would have provided an easy means for "
3397 "disgruntled Facebook users to tell their friends where they might expect "
3401 #. type: Content of: <book><chapter><sect1><para>
3403 "Adversarial interoperability was once the norm and a key contributor to the "
3404 "dynamic, vibrant tech scene, but now it is stuck behind a thicket of laws "
3405 "and regulations that add legal risks to the tried-and-true tactics of "
3406 "adversarial interoperability. New rules and new interpretations of existing "
3407 "rules mean that a would-be adversarial interoperator needs to steer clear of "
3408 "claims under copyright, terms of service, trade secrecy, tortious "
3409 "interference, and patent."
3412 #. type: Content of: <book><chapter><sect1><para>
3414 "In the absence of a competitive market, lawmakers have resorted to assigning "
3415 "expensive, state-like duties to Big Tech firms, such as automatically "
3416 "filtering user contributions for copyright infringement or terrorist and "
3417 "extremist content or detecting and preventing harassment in real time or "
3418 "controlling access to sexual material."
3421 #. type: Content of: <book><chapter><sect1><para>
3423 "These measures put a floor under how small we can make Big Tech because only "
3424 "the very largest companies can afford the humans and automated filters "
3425 "needed to perform these duties."
3428 #. type: Content of: <book><chapter><sect1><para>
3430 "But that’s not the only way in which making platforms responsible for "
3431 "policing their users undermines competition. A platform that is expected to "
3432 "police its users’ conduct must prevent many vital adversarial "
3433 "interoperability techniques lest these subvert its policing measures. For "
3434 "example, if someone using a Twitter replacement like Mastodon is able to "
3435 "push messages into Twitter and read messages out of Twitter, they could "
3436 "avoid being caught by automated systems that detect and prevent harassment "
3437 "(such as systems that use the timing of messages or IP-based rules to make "
3438 "guesses about whether someone is a harasser)."
3441 #. type: Content of: <book><chapter><sect1><para>
3443 "To the extent that we are willing to let Big Tech police itself — rather "
3444 "than making Big Tech small enough that users can leave bad platforms for "
3445 "better ones and small enough that a regulation that simply puts a platform "
3446 "out of business will not destroy billions of users’ access to their "
3447 "communities and data — we build the case that Big Tech should be able to "
3448 "block its competitors and make it easier for Big Tech to demand legal "
3449 "enforcement tools to ban and punish attempts at adversarial interoperability."
3452 #. type: Content of: <book><chapter><sect1><para>
3454 "Ultimately, we can try to fix Big Tech by making it responsible for bad acts "
3455 "by its users, or we can try to fix the internet by cutting Big Tech down to "
3456 "size. But we can’t do both. To replace today’s giant products with "
3457 "pluralistic protocols, we need to clear the legal thicket that prevents "
3458 "adversarial interoperability so that tomorrow’s nimble, personal, small-"
3459 "scale products can federate themselves with giants like Facebook, allowing "
3460 "the users who’ve left to continue to communicate with users who haven’t left "
3461 "yet, reaching tendrils over Facebook’s garden wall that Facebook’s trapped "
3462 "users can use to scale the walls and escape to the global, open web."
3465 #. type: Content of: <book><chapter><sect1><title>
3466 msgid "Fake news is an epistemological crisis"
3469 #. type: Content of: <book><chapter><sect1><para>
3471 "Tech is not the only industry that has undergone massive concentration since "
3472 "the Reagan era. Virtually every major industry — from oil to newspapers to "
3473 "meatpacking to sea freight to eyewear to online pornography — has become a "
3474 "clubby oligarchy that just a few players dominate."
3477 #. type: Content of: <book><chapter><sect1><para>
3479 "At the same time, every industry has become something of a tech industry as "
3480 "general-purpose computers and general-purpose networks and the promise of "
3481 "efficiencies through data-driven analysis infuse every device, process, and "
3485 #. type: Content of: <book><chapter><sect1><para>
3487 "This phenomenon of industrial concentration is part of a wider story about "
3488 "wealth concentration overall as a smaller and smaller number of people own "
3489 "more and more of our world. This concentration of both wealth and industries "
3490 "means that our political outcomes are increasingly beholden to the parochial "
3491 "interests of the people and companies with all the money."
3494 #. type: Content of: <book><chapter><sect1><para>
3496 "That means that whenever a regulator asks a question with an obvious, "
3497 "empirical answer (<quote>Are humans causing climate change?</quote> or "
3498 "<quote>Should we let companies conduct commercial mass surveillance?</quote> "
3499 "or <quote>Does society benefit from allowing network neutrality violations?</"
3500 "quote>), the answer that comes out is only correct if that correctness meets "
3501 "with the approval of rich people and the industries that made them so "
3505 #. type: Content of: <book><chapter><sect1><para>
3507 "Rich people have always played an outsized role in politics and more so "
3508 "since the Supreme Court’s <emphasis>Citizens United</emphasis> decision "
3509 "eliminated key controls over political spending. Widening inequality and "
3510 "wealth concentration means that the very richest people are now a lot richer "
3511 "and can afford to spend a lot more money on political projects than ever "
3512 "before. Think of the Koch brothers or George Soros or Bill Gates."
3515 #. type: Content of: <book><chapter><sect1><para>
3517 "But the policy distortions of rich individuals pale in comparison to the "
3518 "policy distortions that concentrated industries are capable of. The "
3519 "companies in highly concentrated industries are much more profitable than "
3520 "companies in competitive industries — no competition means not having to "
3521 "reduce prices or improve quality to win customers — leaving them with bigger "
3522 "capital surpluses to spend on lobbying."
3525 #. type: Content of: <book><chapter><sect1><para>
3527 "Concentrated industries also find it easier to collaborate on policy "
3528 "objectives than competitive ones. When all the top execs from your industry "
3529 "can fit around a single boardroom table, they often do. And <emphasis>when</"
3530 "emphasis> they do, they can forge a consensus position on regulation."
3533 #. type: Content of: <book><chapter><sect1><para>
3535 "Rising through the ranks in a concentrated industry generally means working "
3536 "at two or three of the big companies. When there are only relatively few "
3537 "companies in a given industry, each company has a more ossified executive "
3538 "rank, leaving ambitious execs with fewer paths to higher positions unless "
3539 "they are recruited to a rival. This means that the top execs in concentrated "
3540 "industries are likely to have been colleagues at some point and socialize in "
3541 "the same circles — connected through social ties or, say, serving as "
3542 "trustees for each others’ estates. These tight social bonds foster a "
3543 "collegial, rather than competitive, attitude."
3546 #. type: Content of: <book><chapter><sect1><para>
3548 "Highly concentrated industries also present a regulatory conundrum. When an "
3549 "industry is dominated by just four or five companies, the only people who "
3550 "are likely to truly understand the industry’s practices are its veteran "
3551 "executives. This means that top regulators are often former execs of the "
3552 "companies they are supposed to be regulating. These turns in government are "
3553 "often tacitly understood to be leaves of absence from industry, with former "
3554 "employers welcoming their erstwhile watchdogs back into their executive "
3555 "ranks once their terms have expired."
3558 #. type: Content of: <book><chapter><sect1><para>
3560 "All this is to say that the tight social bonds, small number of firms, and "
3561 "regulatory capture of concentrated industries give the companies that "
3562 "comprise them the power to dictate many, if not all, of the regulations that "
3566 #. type: Content of: <book><chapter><sect1><para>
3568 "This is increasingly obvious. Whether it’s payday lenders <ulink url="
3569 "\"https://www.washingtonpost.com/business/2019/02/25/how-payday-lending-"
3570 "industry-insider-tilted-academic-research-its-favor/\">winning the right to "
3571 "practice predatory lending</ulink> or Apple <ulink url=\"https://www.vice."
3572 "com/en_us/article/mgxayp/source-apple-will-fight-right-to-repair-legislation"
3573 "\">winning the right to decide who can fix your phone</ulink> or Google and "
3574 "Facebook winning the right to breach your private data without suffering "
3575 "meaningful consequences or victories for pipeline companies or impunity for "
3576 "opioid manufacturers or massive tax subsidies for incredibly profitable "
3577 "dominant businesses, it’s increasingly apparent that many of our official, "
3578 "evidence-based truth-seeking processes are, in fact, auctions for sale to "
3579 "the highest bidder."
3582 #. type: Content of: <book><chapter><sect1><para>
3584 "It’s really impossible to overstate what a terrifying prospect this is. We "
3585 "live in an incredibly high-tech society, and none of us could acquire the "
3586 "expertise to evaluate every technological proposition that stands between us "
3587 "and our untimely, horrible deaths. You might devote your life to acquiring "
3588 "the media literacy to distinguish good scientific journals from corrupt pay-"
3589 "for-play lookalikes and the statistical literacy to evaluate the quality of "
3590 "the analysis in the journals as well as the microbiology and epidemiology "
3591 "knowledge to determine whether you can trust claims about the safety of "
3592 "vaccines — but that would still leave you unqualified to judge whether the "
3593 "wiring in your home will give you a lethal shock <emphasis>and</emphasis> "
3594 "whether your car’s brakes’ software will cause them to fail unpredictably "
3595 "<emphasis>and</emphasis> whether the hygiene standards at your butcher are "
3596 "sufficient to keep you from dying after you finish your dinner."
3599 #. type: Content of: <book><chapter><sect1><para>
3601 "In a world as complex as this one, we have to defer to authorities, and we "
3602 "keep them honest by making those authorities accountable to us and binding "
3603 "them with rules to prevent conflicts of interest. We can’t possibly acquire "
3604 "the expertise to adjudicate conflicting claims about the best way to make "
3605 "the world safe and prosperous, but we <emphasis>can</emphasis> determine "
3606 "whether the adjudication process itself is trustworthy."
3609 #. type: Content of: <book><chapter><sect1><para>
3610 msgid "Right now, it’s obviously not."
3613 #. type: Content of: <book><chapter><sect1><para>
3615 "The past 40 years of rising inequality and industry concentration, together "
3616 "with increasingly weak accountability and transparency for expert agencies, "
3617 "has created an increasingly urgent sense of impending doom, the sense that "
3618 "there are vast conspiracies afoot that operate with tacit official approval "
3619 "despite the likelihood they are working to better themselves by ruining the "
3623 #. type: Content of: <book><chapter><sect1><para>
3625 "For example, it’s been decades since Exxon’s own scientists concluded that "
3626 "its products would render the Earth uninhabitable by humans. And yet those "
3627 "decades were lost to us, in large part because Exxon lobbied governments and "
3628 "sowed doubt about the dangers of its products and did so with the "
3629 "cooperation of many public officials. When the survival of you and everyone "
3630 "you love is threatened by conspiracies, it’s not unreasonable to start "
3631 "questioning the things you think you know in an attempt to determine whether "
3632 "they, too, are the outcome of another conspiracy."
3635 #. type: Content of: <book><chapter><sect1><para>
3637 "The collapse of the credibility of our systems for divining and upholding "
3638 "truths has left us in a state of epistemological chaos. Once, most of us "
3639 "might have assumed that the system was working and that our regulations "
3640 "reflected our best understanding of the empirical truths of the world as "
3641 "they were best understood — now we have to find our own experts to help us "
3642 "sort the true from the false."
3645 #. type: Content of: <book><chapter><sect1><para>
3647 "If you’re like me, you probably believe that vaccines are safe, but you "
3648 "(like me) probably also can’t explain the microbiology or statistics. Few of "
3649 "us have the math skills to review the literature on vaccine safety and "
3650 "describe why their statistical reasoning is sound. Likewise, few of us can "
3651 "review the stats in the (now discredited) literature on opioid safety and "
3652 "explain how those stats were manipulated. Both vaccines and opioids were "
3653 "embraced by medical authorities, after all, and one is safe while the other "
3654 "could ruin your life. You’re left with a kind of inchoate constellation of "
3655 "rules of thumb about which experts you trust to fact-check controversial "
3656 "claims and then to explain how all those respectable doctors with their peer-"
3657 "reviewed research on opioid safety <emphasis>were</emphasis> an aberration "
3658 "and then how you know that the doctors writing about vaccine safety are "
3659 "<emphasis>not</emphasis> an aberration."
3662 #. type: Content of: <book><chapter><sect1><para>
3664 "I’m 100% certain that vaccinating is safe and effective, but I’m also at "
3665 "something of a loss to explain exactly, <emphasis>precisely,</emphasis> why "
3666 "I believe this, given all the corruption I know about and the many times the "
3667 "stamp of certainty has turned out to be a parochial lie told to further "
3668 "enrich the super rich."
3671 #. type: Content of: <book><chapter><sect1><para>
3673 "Fake news — conspiracy theories, racist ideologies, scientific denialism — "
3674 "has always been with us. What’s changed today is not the mix of ideas in the "
3675 "public discourse but the popularity of the worst ideas in that mix. "
3676 "Conspiracy and denial have skyrocketed in lockstep with the growth of Big "
3677 "Inequality, which has also tracked the rise of Big Tech and Big Pharma and "
3678 "Big Wrestling and Big Car and Big Movie Theater and Big Everything Else."
3681 #. type: Content of: <book><chapter><sect1><para>
3683 "No one can say for certain why this has happened, but the two dominant camps "
3684 "are idealism (the belief that the people who argue for these conspiracies "
3685 "have gotten better at explaining them, maybe with the help of machine-"
3686 "learning tools) or materialism (the ideas have become more attractive "
3687 "because of material conditions in the world)."
3690 #. type: Content of: <book><chapter><sect1><para>
3692 "I’m a materialist. I’ve been exposed to the arguments of conspiracy "
3693 "theorists all my life, and I have not experienced any qualitative leap in "
3694 "the quality of those arguments."
3697 #. type: Content of: <book><chapter><sect1><para>
3699 "The major difference is in the world, not the arguments. In a time where "
3700 "actual conspiracies are commonplace, conspiracy theories acquire a ring of "
3704 #. type: Content of: <book><chapter><sect1><para>
3706 "We have always had disagreements about what’s true, but today, we have a "
3707 "disagreement over how we know whether something is true. This is an "
3708 "epistemological crisis, not a crisis over belief. It’s a crisis over the "
3709 "credibility of our truth-seeking exercises, from scientific journals (in an "
3710 "era where the biggest journal publishers have been caught producing pay-to-"
3711 "play journals for junk science) to regulations (in an era where regulators "
3712 "are routinely cycling in and out of business) to education (in an era where "
3713 "universities are dependent on corporate donations to keep their lights on)."
3716 #. type: Content of: <book><chapter><sect1><para>
3718 "Targeting — surveillance capitalism — makes it easier to find people who are "
3719 "undergoing this epistemological crisis, but it doesn’t create the crisis. "
3720 "For that, you need to look to corruption."
3723 #. type: Content of: <book><chapter><sect1><para>
3725 "And, conveniently enough, it’s corruption that allows surveillance "
3726 "capitalism to grow by dismantling monopoly protections, by permitting "
3727 "reckless collection and retention of personal data, by allowing ads to be "
3728 "targeted in secret, and by foreclosing on the possibility of going somewhere "
3729 "else where you might continue to enjoy your friends without subjecting "
3730 "yourself to commercial surveillance."
3733 #. type: Content of: <book><chapter><sect1><title>
3734 msgid "Tech is different"
3737 #. type: Content of: <book><chapter><sect1><para>
3739 "I reject both iterations of technological exceptionalism. I reject the idea "
3740 "that tech is uniquely terrible and led by people who are greedier or worse "
3741 "than the leaders of other industries, and I reject the idea that tech is so "
3742 "good — or so intrinsically prone to concentration — that it can’t be blamed "
3743 "for its present-day monopolistic status."
3746 #. type: Content of: <book><chapter><sect1><para>
3748 "I think tech is just another industry, albeit one that grew up in the "
3749 "absence of real monopoly constraints. It may have been first, but it isn’t "
3750 "the worst nor will it be the last."
3753 #. type: Content of: <book><chapter><sect1><para>
3755 "But there’s one way in which I <emphasis>am</emphasis> a tech "
3756 "exceptionalist. I believe that online tools are the key to overcoming "
3757 "problems that are much more urgent than tech monopolization: climate change, "
3758 "inequality, misogyny, and discrimination on the basis of race, gender "
3759 "identity, and other factors. The internet is how we will recruit people to "
3760 "fight those fights, and how we will coordinate their labor. Tech is not a "
3761 "substitute for democratic accountability, the rule of law, fairness, or "
3762 "stability — but it’s a means to achieve these things."
3765 #. type: Content of: <book><chapter><sect1><para>
3767 "The hard problem of our species is coordination. Everything from climate "
3768 "change to social change to running a business to making a family work can be "
3769 "viewed as a collective action problem."
3772 #. type: Content of: <book><chapter><sect1><para>
3774 "The internet makes it easier than at any time before to find people who want "
3775 "to work on a project with you — hence the success of free and open-source "
3776 "software, crowdfunding, and racist terror groups — and easier than ever to "
3777 "coordinate the work you do."
3780 #. type: Content of: <book><chapter><sect1><para>
3782 "The internet and the computers we connect to it also possess an exceptional "
3783 "quality: general-purposeness. The internet is designed to allow any two "
3784 "parties to communicate any data, using any protocol, without permission from "
3785 "anyone else. The only production design we have for computers is the general-"
3786 "purpose, <quote>Turing complete</quote> computer that can run every program "
3787 "we can express in symbolic logic."
3790 #. type: Content of: <book><chapter><sect1><para>
3792 "This means that every time someone with a special communications need "
3793 "invests in infrastructure and techniques to make the internet faster, "
3794 "cheaper, and more robust, this benefit redounds to everyone else who is "
3795 "using the internet to communicate. And this also means that every time "
3796 "someone with a special computing need invests to make computers faster, "
3797 "cheaper, and more robust, every other computing application is a potential "
3798 "beneficiary of this work."
3801 #. type: Content of: <book><chapter><sect1><para>
3803 "For these reasons, every type of communication is gradually absorbed into "
3804 "the internet, and every type of device — from airplanes to pacemakers — "
3805 "eventually becomes a computer in a fancy case."
3808 #. type: Content of: <book><chapter><sect1><para>
3810 "While these considerations don’t preclude regulating networks and computers, "
3811 "they do call for gravitas and caution when doing so because changes to "
3812 "regulatory frameworks could ripple out to have unintended consequences in "
3813 "many, many other domains."
3816 #. type: Content of: <book><chapter><sect1><para>
3818 "The upshot of this is that our best hope of solving the big coordination "
3819 "problems — climate change, inequality, etc. — is with free, fair, and open "
3820 "tech. Our best hope of keeping tech free, fair, and open is to exercise "
3821 "caution in how we regulate tech and to attend closely to the ways in which "
3822 "interventions to solve one problem might create problems in other domains."
3825 #. type: Content of: <book><chapter><sect1><title>
3826 msgid "Ownership of facts"
3827 msgstr "Eierskap til fakta"
3829 #. type: Content of: <book><chapter><sect1><para>
3831 "Big Tech has a funny relationship with information. When you’re generating "
3832 "information — anything from the location data streaming off your mobile "
3833 "device to the private messages you send to friends on a social network — it "
3834 "claims the rights to make unlimited use of that data."
3837 #. type: Content of: <book><chapter><sect1><para>
3839 "But when you have the audacity to turn the tables — to use a tool that "
3840 "blocks ads or slurps your waiting updates out of a social network and puts "
3841 "them in another app that lets you set your own priorities and suggestions or "
3842 "crawls their system to allow you to start a rival business — they claim that "
3843 "you’re stealing from them."
3846 #. type: Content of: <book><chapter><sect1><para>
3848 "The thing is, information is a very bad fit for any kind of private property "
3849 "regime. Property rights are useful for establishing markets that can lead to "
3850 "the effective development of fallow assets. These markets depend on clear "
3851 "titles to ensure that the things being bought and sold in them can, in fact, "
3852 "be bought and sold."
3855 #. type: Content of: <book><chapter><sect1><para>
3857 "Information rarely has such a clear title. Take phone numbers: There’s "
3858 "clearly something going wrong when Facebook slurps up millions of users’ "
3859 "address books and uses the phone numbers it finds in them to plot out social "
3860 "graphs and fill in missing information about other users."
3863 #. type: Content of: <book><chapter><sect1><para>
3865 "But the phone numbers Facebook nonconsensually acquires in this transaction "
3866 "are not the <quote>property</quote> of the users they’re taken from nor do "
3867 "they belong to the people whose phones ring when you dial those numbers. The "
3868 "numbers are mere integers, 10 digits in the U.S. and Canada, and they "
3869 "appear in millions of places, including somewhere deep in pi as well as "
3870 "numerous other contexts. Giving people ownership titles to integers is an "
3871 "obviously terrible idea."
3874 #. type: Content of: <book><chapter><sect1><para>
3876 "Likewise for the facts that Facebook and other commercial surveillance "
3877 "operators acquire about us, like that we are the children of our parents or "
3878 "the parents to our children or that we had a conversation with someone else "
3879 "or went to a public place. These data points can’t be property in the sense "
3880 "that your house or your shirt is your property because the title to them is "
3881 "intrinsically muddy: Does your mom own the fact that she is your mother? Do "
3882 "you? Do both of you? What about your dad — does he own this fact too, or "
3883 "does he have to license the fact from you (or your mom or both of you) in "
3884 "order to use this fact? What about the hundreds or thousands of other people "
3885 "who know these facts?"
3888 #. type: Content of: <book><chapter><sect1><para>
3890 "If you go to a Black Lives Matter demonstration, do the other demonstrators "
3891 "need your permission to post their photos from the event? The online fights "
3892 "over <ulink url=\"https://www.wired.com/story/how-to-take-photos-at-protests/"
3893 "\">when and how to post photos from demonstrations</ulink> reveal a nuanced, "
3894 "complex issue that cannot be easily hand-waved away by giving one party a "
3895 "property right that everyone else in the mix has to respect."
3898 #. type: Content of: <book><chapter><sect1><para>
3900 "The fact that information isn’t a good fit with property and markets doesn’t "
3901 "mean that it’s not valuable. Babies aren’t property, but they’re inarguably "
3902 "valuable. In fact, we have a whole set of rules just for babies as well as a "
3903 "subset of those rules that apply to humans more generally. Someone who "
3904 "argues that babies won’t be truly valuable until they can be bought and sold "
3905 "like loaves of bread would be instantly and rightfully condemned as a "
3909 #. type: Content of: <book><chapter><sect1><para>
3911 "It’s tempting to reach for the property hammer when Big Tech treats your "
3912 "information like a nail — not least because Big Tech are such prolific "
3913 "abusers of property hammers when it comes to <emphasis>their</emphasis> "
3914 "information. But this is a mistake. If we allow markets to dictate the use "
3915 "of our information, then we’ll find that we’re sellers in a buyers’ market "
3916 "where the Big Tech monopolies set a price for our data that is so low as to "
3917 "be insignificant or, more likely, set at a nonnegotiable price of zero in a "
3918 "click-through agreement that you don’t have the opportunity to modify."
3921 #. type: Content of: <book><chapter><sect1><para>
3923 "Meanwhile, establishing property rights over information will create "
3924 "insurmountable barriers to independent data processing. Imagine that we "
3925 "require a license to be negotiated when a translated document is compared "
3926 "with its original, something Google has done and continues to do billions of "
3927 "times to train its automated language translation tools. Google can afford "
3928 "this, but independent third parties cannot. Google can staff a clearances "
3929 "department to negotiate one-time payments to the likes of the EU (one of the "
3930 "major repositories of translated documents) while independent watchdogs "
3931 "wanting to verify that the translations are well-prepared, or to root out "
3932 "bias in translations, will find themselves needing a staffed-up legal "
3933 "department and millions for licenses before they can even get started."
3936 #. type: Content of: <book><chapter><sect1><para>
3938 "The same goes for things like search indexes of the web or photos of "
3939 "peoples’ houses, which have become contentious thanks to Google’s Street "
3940 "View project. Whatever problems may exist with Google’s photographing of "
3941 "street scenes, resolving them by letting people decide who can take pictures "
3942 "of the facades of their homes from a public street will surely create even "
3943 "worse ones. Think of how street photography is important for newsgathering — "
3944 "including informal newsgathering, like photographing abuses of authority — "
3945 "and how being able to document housing and street life are important for "
3946 "contesting eminent domain, advocating for social aid, reporting planning and "
3947 "zoning violations, documenting discriminatory and unequal living conditions, "
3951 #. type: Content of: <book><chapter><sect1><para>
3953 "The ownership of facts is antithetical to many kinds of human progress. It’s "
3954 "hard to imagine a rule that limits Big Tech’s exploitation of our collective "
3955 "labors without inadvertently banning people from gathering data on online "
3956 "harassment or compiling indexes of changes in language or simply "
3957 "investigating how the platforms are shaping our discourse — all of which "
3958 "require scraping data that other people have created and subjecting it to "
3959 "scrutiny and analysis."
3962 #. type: Content of: <book><chapter><sect1><title>
3963 msgid "Persuasion works… slowly"
3964 msgstr "Overtalelse virker… sakte"
3966 #. type: Content of: <book><chapter><sect1><para>
3968 "The platforms may oversell their ability to persuade people, but obviously, "
3969 "persuasion works sometimes. Whether it’s the private realm that LGBTQ people "
3970 "used to recruit allies and normalize sexual diversity or the decadeslong "
3971 "project to convince people that markets are the only efficient way to solve "
3972 "complicated resource allocation problems, it’s clear that our societal "
3973 "attitudes <emphasis>can</emphasis> change."
3976 #. type: Content of: <book><chapter><sect1><para>
3978 "The project of shifting societal attitudes is a game of inches and years. "
3979 "For centuries, svengalis have purported to be able to accelerate this "
3980 "process, but even the most brutal forms of propaganda have struggled to make "
3981 "permanent changes. Joseph Goebbels was able to subject Germans to daily, "
3982 "mandatory, hourslong radio broadcasts, to round up and torture and murder "
3983 "dissidents, and to seize full control over their children’s education while "
3984 "banning any literature, broadcasts, or films that did not comport with his "
3988 #. type: Content of: <book><chapter><sect1><para>
3990 "Yet, after 12 years of terror, once the war ended, Nazi ideology was largely "
3991 "discredited in both East and West Germany, and a program of national truth "
3992 "and reconciliation was put in its place. Racism and authoritarianism were "
3993 "never fully abolished in Germany, but neither were the majority of Germans "
3994 "irrevocably convinced of Nazism — and the rise of racist authoritarianism in "
3995 "Germany today tells us that the liberal attitudes that replaced Nazism were "
3996 "no more permanent than Nazism itself."
3999 #. type: Content of: <book><chapter><sect1><para>
4001 "Racism and authoritarianism have also always been with us. Anyone who’s "
4002 "reviewed the kind of messages and arguments that racists put forward today "
4003 "would be hard-pressed to say that they have gotten better at presenting "
4004 "their ideas. The same pseudoscience, appeals to fear, and circular logic "
4005 "that racists presented in the 1980s, when the cause of white supremacy was "
4006 "on the wane, are to be found in the communications of leading white "
4007 "nationalists today."
4010 #. type: Content of: <book><chapter><sect1><para>
4012 "If racists haven’t gotten more convincing in the past decade, then how is it "
4013 "that more people were convinced to be openly racist at that time? I believe "
4014 "that the answer lies in the material world, not the world of ideas. The "
4015 "ideas haven’t gotten more convincing, but people have become more afraid. "
4016 "Afraid that the state can’t be trusted to act as an honest broker in life-or-"
4017 "death decisions, from those regarding the management of the economy to the "
4018 "regulation of painkillers to the rules for handling private information. "
4019 "Afraid that the world has become a game of musical chairs in which the "
4020 "chairs are being taken away at a never-before-seen rate. Afraid that justice "
4021 "for others will come at their expense. Monopolism isn’t the cause of these "
4022 "fears, but the inequality and material desperation and policy malpractice "
4023 "that monopolism contributes to is a significant contributor to these "
4024 "conditions. Inequality creates the conditions for both conspiracies and "
4025 "violent racist ideologies, and then surveillance capitalism lets "
4026 "opportunists target the fearful and the conspiracy-minded."
4029 #. type: Content of: <book><chapter><sect1><title>
4030 msgid "Paying won’t help"
4031 msgstr "Det hjelper ikke å betale"
4033 #. type: Content of: <book><chapter><sect1><para>
4035 "As the old saw goes, <quote>If you’re not paying for the product, you’re the "
4039 #. type: Content of: <book><chapter><sect1><para>
4041 "It’s a commonplace belief today that the advent of free, ad-supported media "
4042 "was the original sin of surveillance capitalism. The reasoning is that the "
4043 "companies that charged for access couldn’t <quote>compete with free</quote> "
4044 "and so they were driven out of business. Their ad-supported competitors, "
4045 "meanwhile, declared open season on their users’ data in a bid to improve "
4046 "their ad targeting and make more money and then resorted to the most "
4047 "sensationalist tactics to generate clicks on those ads. If only we’d pay for "
4048 "media again, we’d have a better, more responsible, more sober discourse that "
4049 "would be better for democracy."
4052 #. type: Content of: <book><chapter><sect1><para>
4054 "But the degradation of news products long precedes the advent of ad-"
4055 "supported online news. Long before newspapers were online, lax antitrust "
4056 "enforcement had opened the door for unprecedented waves of consolidation and "
4057 "roll-ups in newsrooms. Rival newspapers were merged, reporters and ad sales "
4058 "staff were laid off, physical plants were sold and leased back, leaving the "
4059 "companies loaded up with debt through leveraged buyouts and subsequent "
4060 "profit-taking by the new owners. In other words, it wasn’t merely shifts in "
4061 "the classified advertising market, which was long held to be the primary "
4062 "driver in the decline of the traditional newsroom, that made news companies "
4063 "unable to adapt to the internet — it was monopolism."
4066 #. type: Content of: <book><chapter><sect1><para>
4068 "Then, as news companies <emphasis>did</emphasis> come online, the ad "
4069 "revenues they commanded dropped even as the number of internet users (and "
4070 "thus potential online readers) increased. That shift was a function of "
4071 "consolidation in the ad sales market, with Google and Facebook emerging as "
4072 "duopolists who made more money every year from advertising while paying less "
4073 "and less of it to the publishers whose work the ads appeared alongside. "
4074 "Monopolism created a buyer’s market for ad inventory with Facebook and "
4075 "Google acting as gatekeepers."
4078 #. type: Content of: <book><chapter><sect1><para>
4080 "Paid services continue to exist alongside free ones, and often it is these "
4081 "paid services — anxious to prevent people from bypassing their paywalls or "
4082 "sharing paid media with freeloaders — that exert the most control over their "
4083 "customers. Apple’s iTunes and App Stores are paid services, but to maximize "
4084 "their profitability, Apple has to lock its platforms so that third parties "
4085 "can’t make compatible software without permission. These locks allow the "
4086 "company to exercise both editorial control (enabling it to exclude <ulink "
4087 "url=\"https://ncac.org/news/blog/does-apples-strict-app-store-content-policy-"
4088 "limit-freedom-of-expression\">controversial political material</ulink>) and "
4089 "technological control, including control over who can repair the devices it "
4090 "makes. If we’re worried that ad-supported products deprive people of their "
4091 "right to self-determination by using persuasion techniques to nudge their "
4092 "purchase decisions a few degrees in one direction or the other, then the "
4093 "near-total control a single company holds over the decision of who gets to "
4094 "sell you software, parts, and service for your iPhone should have us very "
4098 #. type: Content of: <book><chapter><sect1><para>
4100 "We shouldn’t just be concerned about payment and control: The idea that "
4101 "paying will improve discourse is also dangerously wrong. The poor success "
4102 "rate of targeted advertising means that the platforms have to incentivize "
4103 "you to <quote>engage</quote> with posts at extremely high levels to generate "
4104 "enough pageviews to safeguard their profits. As discussed earlier, to "
4105 "increase engagement, platforms like Facebook use machine learning to guess "
4106 "which messages will be most inflammatory and make a point of shoving those "
4107 "into your eyeballs at every turn so that you will hate-click and argue with "
4111 #. type: Content of: <book><chapter><sect1><para>
4113 "Perhaps paying would fix this, the reasoning goes. If platforms could be "
4114 "economically viable even if you stopped clicking on them once your "
4115 "intellectual and social curiosity had been slaked, then they would have no "
4116 "reason to algorithmically enrage you to get more clicks out of you, right?"
4119 #. type: Content of: <book><chapter><sect1><para>
4121 "There may be something to that argument, but it still ignores the wider "
4122 "economic and political context of the platforms and the world that allowed "
4123 "them to grow so dominant."
4126 #. type: Content of: <book><chapter><sect1><para>
4128 "Platforms are world-spanning and all-encompassing because they are "
4129 "monopolies, and they are monopolies because we have gutted our most "
4130 "important and reliable anti-monopoly rules. Antitrust was neutered as a key "
4131 "part of the project to make the wealthy wealthier, and that project has "
4132 "worked. The vast majority of people on Earth have a negative net worth, and "
4133 "even the dwindling middle class is in a precarious state, undersaved for "
4134 "retirement, underinsured for medical disasters, and undersecured against "
4135 "climate and technology shocks."
4138 #. type: Content of: <book><chapter><sect1><para>
4140 "In this wildly unequal world, paying doesn’t improve the discourse; it "
4141 "simply prices discourse out of the range of the majority of people. Paying "
4142 "for the product is dandy, if you can afford it."
4145 #. type: Content of: <book><chapter><sect1><para>
4147 "If you think today’s filter bubbles are a problem for our discourse, imagine "
4148 "what they’d be like if rich people inhabited free-flowing Athenian "
4149 "marketplaces of ideas where you have to pay for admission while everyone "
4150 "else lives in online spaces that are subsidized by wealthy benefactors who "
4151 "relish the chance to establish conversational spaces where the <quote>house "
4152 "rules</quote> forbid questioning the status quo. That is, imagine if the "
4153 "rich seceded from Facebook, and then, instead of running ads that made money "
4154 "for shareholders, Facebook became a billionaire’s vanity project that also "
4155 "happened to ensure that nobody talked about whether it was fair that only "
4156 "billionaires could afford to hang out in the rarified corners of the "
4160 #. type: Content of: <book><chapter><sect1><para>
4162 "Behind the idea of paying for access is a belief that free markets will "
4163 "address Big Tech’s dysfunction. After all, to the extent that people have a "
4164 "view of surveillance at all, it is generally an unfavorable one, and the "
4165 "longer and more thoroughly one is surveilled, the less one tends to like it. "
4166 "Same goes for lock-in: If HP’s ink or Apple’s App Store were really "
4167 "obviously fantastic, they wouldn’t need technical measures to prevent users "
4168 "from choosing a rival’s product. The only reason these technical "
4169 "countermeasures exist is that the companies don’t believe their customers "
4170 "would <emphasis>voluntarily</emphasis> submit to their terms, and they want "
4171 "to deprive them of the choice to take their business elsewhere."
4174 #. type: Content of: <book><chapter><sect1><para>
4176 "Advocates for markets laud their ability to aggregate the diffused knowledge "
4177 "of buyers and sellers across a whole society through demand signals, price "
4178 "signals, and so on. The argument for surveillance capitalism being a "
4179 "<quote>rogue capitalism</quote> is that machine-learning-driven persuasion "
4180 "techniques distort decision-making by consumers, leading to incorrect "
4181 "signals — consumers don’t buy what they prefer, they buy what they’re "
4182 "tricked into preferring. It follows that the monopolistic practices of lock-"
4183 "in, which do far more to constrain consumers’ free choices, are even more of "
4184 "a <quote>rogue capitalism.</quote>"
4187 #. type: Content of: <book><chapter><sect1><para>
4189 "The profitability of any business is constrained by the possibility that its "
4190 "customers will take their business elsewhere. Both surveillance and lock-in "
4191 "are anti-features that no customer wants. But monopolies can capture their "
4192 "regulators, crush their competitors, insert themselves into their customers’ "
4193 "lives, and corral people into <quote>choosing</quote> their services "
4194 "regardless of whether they want them — it’s fine to be terrible when there "
4195 "is no alternative."
4198 #. type: Content of: <book><chapter><sect1><para>
4200 "Ultimately, surveillance and lock-in are both simply business strategies "
4201 "that monopolists can choose. Surveillance companies like Google are "
4202 "perfectly capable of deploying lock-in technologies — just look at the "
4203 "onerous Android licensing terms that require device-makers to bundle in "
4204 "Google’s suite of applications. And lock-in companies like Apple are "
4205 "perfectly capable of subjecting their users to surveillance if it means "
4206 "keeping the Chinese government happy and preserving ongoing access to "
4207 "Chinese markets. Monopolies may be made up of good, ethical people, but as "
4208 "institutions, they are not your friend — they will do whatever they can get "
4209 "away with to maximize their profits, and the more monopolistic they are, the "
4210 "more they <emphasis>can</emphasis> get away with."
4213 #. type: Content of: <book><chapter><sect1><title>
4214 msgid "An <quote>ecology</quote> moment for trustbusting"
4217 #. type: Content of: <book><chapter><sect1><para>
4219 "If we’re going to break Big Tech’s death grip on our digital lives, we’re "
4220 "going to have to fight monopolies. That may sound pretty mundane and old-"
4221 "fashioned, something out of the New Deal era, while ending the use of "
4222 "automated behavioral modification feels like the plotline of a really cool "
4226 #. type: Content of: <book><chapter><sect1><para>
4228 "Meanwhile, breaking up monopolies is something we seem to have forgotten how "
4229 "to do. There is a bipartisan, trans-Atlantic consensus that breaking up "
4230 "companies is a fool’s errand at best — liable to mire your federal "
4231 "prosecutors in decades of litigation — and counterproductive at worst, "
4232 "eroding the <quote>consumer benefits</quote> of large companies with massive "
4233 "efficiencies of scale."
4236 #. type: Content of: <book><chapter><sect1><para>
4238 "But trustbusters once strode the nation, brandishing law books, terrorizing "
4239 "robber barons, and shattering the illusion of monopolies’ all-powerful grip "
4240 "on our society. The trustbusting era could not begin until we found the "
4241 "political will — until the people convinced politicians they’d have their "
4242 "backs when they went up against the richest, most powerful men in the world."
4245 #. type: Content of: <book><chapter><sect1><para>
4246 msgid "Could we find that political will again?"
4249 #. type: Content of: <book><chapter><sect1><para>
4251 "Copyright scholar James Boyle has described how the term <quote>ecology</"
4252 "quote> marked a turning point in environmental activism. Prior to the "
4253 "adoption of this term, people who wanted to preserve whale populations "
4254 "didn’t necessarily see themselves as fighting the same battle as people who "
4255 "wanted to protect the ozone layer or fight freshwater pollution or beat back "
4256 "smog or acid rain."
4259 #. type: Content of: <book><chapter><sect1><para>
4261 "But the term <quote>ecology</quote> welded these disparate causes together "
4262 "into a single movement, and the members of this movement found solidarity "
4263 "with one another. The people who cared about smog signed petitions "
4264 "circulated by the people who wanted to end whaling, and the anti-whalers "
4265 "marched alongside the people demanding action on acid rain. This uniting "
4266 "behind a common cause completely changed the dynamics of environmentalism, "
4267 "setting the stage for today’s climate activism and the sense that preserving "
4268 "the habitability of the planet Earth is a shared duty among all people."
4271 #. type: Content of: <book><chapter><sect1><para>
4273 "I believe we are on the verge of a new <quote>ecology</quote> moment "
4274 "dedicated to combating monopolies. After all, tech isn’t the only "
4275 "concentrated industry nor is it even the <emphasis>most</emphasis> "
4276 "concentrated of industries."
4279 #. type: Content of: <book><chapter><sect1><para>
4281 "You can find partisans for trustbusting in every sector of the economy. "
4282 "Everywhere you look, you can find people who’ve been wronged by monopolists "
4283 "who’ve trashed their finances, their health, their privacy, their "
4284 "educations, and the lives of people they love. Those people have the same "
4285 "cause as the people who want to break up Big Tech and the same enemies. When "
4286 "most of the world’s wealth is in the hands of a very few, it follows that "
4287 "nearly every large company will have overlapping shareholders."
4290 #. type: Content of: <book><chapter><sect1><para>
4292 "That’s the good news: With a little bit of work and a little bit of "
4293 "coalition building, we have more than enough political will to break up Big "
4294 "Tech and every other concentrated industry besides. First we take Facebook, "
4295 "then we take AT&T/WarnerMedia."
4298 #. type: Content of: <book><chapter><sect1><para>
4300 "But here’s the bad news: Much of what we’re doing to tame Big Tech "
4301 "<emphasis>instead</emphasis> of breaking up the big companies also "
4302 "forecloses on the possibility of breaking them up later."
4305 #. type: Content of: <book><chapter><sect1><para>
4307 "Big Tech’s concentration currently means that their inaction on harassment, "
4308 "for example, leaves users with an impossible choice: absent themselves from "
4309 "public discourse by, say, quitting Twitter or endure vile, constant abuse. "
4310 "Big Tech’s over-collection and over-retention of data results in horrific "
4311 "identity theft. And their inaction on extremist recruitment means that white "
4312 "supremacists who livestream their shooting rampages can reach an audience of "
4313 "billions. The combination of tech concentration and media concentration "
4314 "means that artists’ incomes are falling even as the revenue generated by "
4315 "their creations are increasing."
4318 #. type: Content of: <book><chapter><sect1><para>
4320 "Yet governments confronting all of these problems all inevitably converge on "
4321 "the same solution: deputize the Big Tech giants to police their users and "
4322 "render them liable for their users’ bad actions. The drive to force Big Tech "
4323 "to use automated filters to block everything from copyright infringement to "
4324 "sex-trafficking to violent extremism means that tech companies will have to "
4325 "allocate hundreds of millions to run these compliance systems."
4328 #. type: Content of: <book><chapter><sect1><para>
4330 "These rules — the EU’s new Directive on Copyright, Australia’s new terror "
4331 "regulation, America’s FOSTA/SESTA sex-trafficking law and more — are not "
4332 "just death warrants for small, upstart competitors that might challenge Big "
4333 "Tech’s dominance but who lack the deep pockets of established incumbents to "
4334 "pay for all these automated systems. Worse still, these rules put a floor "
4335 "under how small we can hope to make Big Tech."
4338 #. type: Content of: <book><chapter><sect1><para>
4340 "That’s because any move to break up Big Tech and cut it down to size will "
4341 "have to cope with the hard limit of not making these companies so small that "
4342 "they can no longer afford to perform these duties — and it’s "
4343 "<emphasis>expensive</emphasis> to invest in those automated filters and "
4344 "outsource content moderation. It’s already going to be hard to unwind these "
4345 "deeply concentrated, chimeric behemoths that have been welded together in "
4346 "the pursuit of monopoly profits. Doing so while simultaneously finding some "
4347 "way to fill the regulatory void that will be left behind if these self-"
4348 "policing rulers were forced to suddenly abdicate will be much, much harder."
4351 #. type: Content of: <book><chapter><sect1><para>
4353 "Allowing the platforms to grow to their present size has given them a "
4354 "dominance that is nearly insurmountable — deputizing them with public duties "
4355 "to redress the pathologies created by their size makes it virtually "
4356 "impossible to reduce that size. Lather, rinse, repeat: If the platforms "
4357 "don’t get smaller, they will get larger, and as they get larger, they will "
4358 "create more problems, which will give rise to more public duties for the "
4359 "companies, which will make them bigger still."
4362 #. type: Content of: <book><chapter><sect1><para>
4364 "We can work to fix the internet by breaking up Big Tech and depriving them "
4365 "of monopoly profits, or we can work to fix Big Tech by making them spend "
4366 "their monopoly profits on governance. But we can’t do both. We have to "
4367 "choose between a vibrant, open internet or a dominated, monopolized internet "
4368 "commanded by Big Tech giants that we struggle with constantly to get them to "
4369 "behave themselves."
4372 #. type: Content of: <book><chapter><sect1><title>
4373 msgid "Make Big Tech small again"
4376 #. type: Content of: <book><chapter><sect1><para>
4378 "Trustbusting is hard. Breaking big companies into smaller ones is expensive "
4379 "and time-consuming. So time-consuming that by the time you’re done, the "
4380 "world has often moved on and rendered years of litigation irrelevant. From "
4381 "1969 to 1982, the U.S. government pursued an antitrust case against IBM over "
4382 "its dominance of mainframe computing — but the case collapsed in 1982 "
4383 "because mainframes were being speedily replaced by PCs."
4386 #. type: Content of: <book><chapter><sect1><blockquote><para>
4388 "A future U.S. president could simply direct their attorney general to "
4389 "enforce the law as it was written."
4392 #. type: Content of: <book><chapter><sect1><para>
4394 "It’s far easier to prevent concentration than to fix it, and reinstating the "
4395 "traditional contours of U.S. antitrust enforcement will, at the very least, "
4396 "prevent further concentration. That means bans on mergers between large "
4397 "companies, on big companies acquiring nascent competitors, and on platform "
4398 "companies competing directly with the companies that rely on the platforms."
4401 #. type: Content of: <book><chapter><sect1><para>
4403 "These powers are all in the plain language of U.S. antitrust laws, so in "
4404 "theory, a future U.S. president could simply direct their attorney general "
4405 "to enforce the law as it was written. But after decades of judicial "
4406 "<quote>education</quote> in the benefits of monopolies, after multiple "
4407 "administrations that have packed the federal courts with lifetime-appointed "
4408 "monopoly cheerleaders, it’s not clear that mere administrative action would "
4412 #. type: Content of: <book><chapter><sect1><para>
4414 "If the courts frustrate the Justice Department and the president, the next "
4415 "stop would be Congress, which could eliminate any doubt about how antitrust "
4416 "law should be enforced in the U.S. by passing new laws that boil down to "
4417 "saying, <quote>Knock it off. We all know what the Sherman Act says. Robert "
4418 "Bork was a deranged fantasist. For avoidance of doubt, <emphasis>fuck that "
4419 "guy</emphasis>.</quote> In other words, the problem with monopolies is "
4420 "<emphasis>monopolism</emphasis> — the concentration of power into too few "
4421 "hands, which erodes our right to self-determination. If there is a monopoly, "
4422 "the law wants it gone, period. Sure, get rid of monopolies that create "
4423 "<quote>consumer harm</quote> in the form of higher prices, but also, "
4424 "<emphasis>get rid of other monopolies, too.</emphasis>"
4427 #. type: Content of: <book><chapter><sect1><para>
4429 "But this only prevents things from getting worse. To help them get better, "
4430 "we will have to build coalitions with other activists in the anti-monopoly "
4431 "ecology movement — a pluralism movement or a self-determination movement — "
4432 "and target existing monopolies in every industry for breakup and structural "
4433 "separation rules that prevent, for example, the giant eyewear monopolist "
4434 "Luxottica from dominating both the sale and the manufacture of spectacles."
4437 #. type: Content of: <book><chapter><sect1><para>
4439 "In an important sense, it doesn’t matter which industry the breakups begin "
4440 "in. Once they start, shareholders in <emphasis>every</emphasis> industry "
4441 "will start to eye their investments in monopolists skeptically. As "
4442 "trustbusters ride into town and start making lives miserable for "
4443 "monopolists, the debate around every corporate boardroom’s table will shift. "
4444 "People within corporations who’ve always felt uneasy about monopolism will "
4445 "gain a powerful new argument to fend off their evil rivals in the corporate "
4446 "hierarchy: <quote>If we do it my way, we make less money; if we do it your "
4447 "way, a judge will fine us billions and expose us to ridicule and public "
4448 "disapprobation. So even though I get that it would be really cool to do that "
4449 "merger, lock out that competitor, or buy that little company and kill it "
4450 "before it can threaten it, we really shouldn’t — not if we don’t want to get "
4451 "tied to the DOJ’s bumper and get dragged up and down Trustbuster Road for "
4452 "the next 10 years.</quote>"
4455 #. type: Content of: <book><chapter><sect1><title>
4459 #. type: Content of: <book><chapter><sect1><para>
4461 "Fixing Big Tech will require a lot of iteration. As cyber lawyer Lawrence "
4462 "Lessig wrote in his 1999 book, <emphasis>Code and Other Laws of Cyberspace</"
4463 "emphasis>, our lives are regulated by four forces: law (what’s legal), code "
4464 "(what’s technologically possible), norms (what’s socially acceptable), and "
4465 "markets (what’s profitable)."
4468 #. type: Content of: <book><chapter><sect1><para>
4470 "If you could wave a wand and get Congress to pass a law that re-fanged the "
4471 "Sherman Act tomorrow, you could use the impending breakups to convince "
4472 "venture capitalists to fund competitors to Facebook, Google, Twitter, and "
4473 "Apple that would be waiting in the wings after they were cut down to size."
4476 #. type: Content of: <book><chapter><sect1><para>
4478 "But getting Congress to act will require a massive normative shift, a mass "
4479 "movement of people who care about monopolies — and pulling them apart."
4482 #. type: Content of: <book><chapter><sect1><para>
4484 "Getting people to care about monopolies will take technological "
4485 "interventions that help them to see what a world free from Big Tech might "
4486 "look like. Imagine if someone could make a beloved (but unauthorized) third-"
4487 "party Facebook or Twitter client that dampens the anxiety-producing "
4488 "algorithmic drumbeat and still lets you talk to your friends without being "
4489 "spied upon — something that made social media more sociable and less toxic. "
4490 "Now imagine that it gets shut down in a brutal legal battle. It’s always "
4491 "easier to convince people that something must be done to save a thing they "
4492 "love than it is to excite them about something that doesn’t even exist yet."
4495 #. type: Content of: <book><chapter><sect1><para>
4497 "Neither tech nor law nor code nor markets are sufficient to reform Big Tech. "
4498 "But a profitable competitor to Big Tech could bankroll a legislative push; "
4499 "legal reform can embolden a toolsmith to make a better tool; the tool can "
4500 "create customers for a potential business who value the benefits of the "
4501 "internet but want them delivered without Big Tech; and that business can get "
4502 "funded and divert some of its profits to legal reform. 20 GOTO 10 (or "
4503 "lather, rinse, repeat). Do it again, but this time, get farther! After all, "
4504 "this time you’re starting with weaker Big Tech adversaries, a constituency "
4505 "that understands things can be better, Big Tech rivals who’ll help ensure "
4506 "their own future by bankrolling reform, and code that other programmers can "
4507 "build on to weaken Big Tech even further."
4510 #. type: Content of: <book><chapter><sect1><para>
4512 "The surveillance capitalism hypothesis — that Big Tech’s products really "
4513 "work as well as they say they do and that’s why everything is so screwed up "
4514 "— is way too easy on surveillance and even easier on capitalism. Companies "
4515 "spy because they believe their own BS, and companies spy because governments "
4516 "let them, and companies spy because any advantage from spying is so short-"
4517 "lived and minor that they have to do more and more of it just to stay in "
4521 #. type: Content of: <book><chapter><sect1><para>
4523 "As to why things are so screwed up? Capitalism. Specifically, the monopolism "
4524 "that creates inequality and the inequality that creates monopolism. It’s a "
4525 "form of capitalism that rewards sociopaths who destroy the real economy to "
4526 "inflate the bottom line, and they get away with it for the same reason "
4527 "companies get away with spying: because our governments are in thrall to "
4528 "both the ideology that says monopolies are actually just fine and in thrall "
4529 "to the ideology that says that in a monopolistic world, you’d better not "
4530 "piss off the monopolists."
4533 #. type: Content of: <book><chapter><sect1><para>
4535 "Surveillance doesn’t make capitalism rogue. Capitalism’s unchecked rule "
4536 "begets surveillance. Surveillance isn’t bad because it lets people "
4537 "manipulate us. It’s bad because it crushes our ability to be our authentic "
4538 "selves — and because it lets the rich and powerful figure out who might be "
4539 "thinking of building guillotines and what dirt they can use to discredit "
4540 "those embryonic guillotine-builders before they can even get to the "
4544 #. type: Content of: <book><chapter><sect1><title>
4545 msgid "Up and through"
4548 #. type: Content of: <book><chapter><sect1><para>
4550 "With all the problems of Big Tech, it’s tempting to imagine solving the "
4551 "problem by returning to a world without tech at all. Resist that temptation."
4553 "Men alle problemene med Stortek, så er det fristende å forestille seg å løse "
4554 "problemet ved å gå tilbake til en verden helt uten teknologi. Stå imot den "
4557 #. type: Content of: <book><chapter><sect1><para>
4559 "The only way out of our Big Tech problem is up and through. If our future is "
4560 "not reliant upon high tech, it will be because civilization has fallen. Big "
4561 "Tech wired together a planetary, species-wide nervous system that, with the "
4562 "proper reforms and course corrections, is capable of seeing us through the "
4563 "existential challenge of our species and planet. Now it’s up to us to seize "
4564 "the means of computation, putting that electronic nervous system under "
4565 "democratic, accountable control."
4568 #. type: Content of: <book><chapter><sect1><para>
4570 "I am, secretly, despite what I have said earlier, a tech exceptionalist. Not "
4571 "in the sense of thinking that tech should be given a free pass to monopolize "
4572 "because it has <quote>economies of scale</quote> or some other nebulous "
4573 "feature. I’m a tech exceptionalist because I believe that getting tech right "
4574 "matters and that getting it wrong will be an unmitigated catastrophe — and "
4575 "doing it right can give us the power to work together to save our "
4576 "civilization, our species, and our planet."