frank-pasquale · 2015

The Black Box Society: The Secret Algorithms That Control Money and Information

date
2015
venue
Harvard University Press
type
book
archive
snapshot

caught 15 June 2026 — mid-summer. vetted 15 June 2026 — mid-summer.

Frank Pasquale was a law professor specialising in the regulation of information, finance, and technology platforms; around the time of this book he moved to the University of Maryland's Carey School of Law, and he later joined Brooklyn Law School. He is one of the central scholars of algorithmic accountability, and The Black Box Society is the work that carried the phrase into legal and public-policy discussion of automated decision-making.

The book was published in 2015 by Harvard University Press, an academic publisher whose editing and review aim at a scholarly-trade standard rather than at the blind peer review of a science journal. Its argument is explicitly normative. Pasquale surveys three domains — reputation (the scoring of individuals), search (the ordering of information), and finance (the algorithms of Wall Street) — and argues that their combination of automated decision and corporate secrecy has produced power that escapes scrutiny. He proposes transparency obligations and a right to inspect as remedies, writing as an advocate for regulation rather than a neutral surveyor.

The piece sits as a secondary, synthesising work with a reform agenda, drawing on legal cases, journalism, and finance to make its case. It revives the cybernetic black-box of Ashby — inputs and outputs visible, the conversion between them hidden — but shifts the emphasis from the epistemic puzzle to the politics of secrecy, who is kept from seeing and who benefits. Its concrete legal cousin is Wachter, Mittelstadt and Russell's work on what a usable right to explanation under European data-protection law could contain. Where the machine-learning sources ask whether a model can be understood, Pasquale asks who is permitted to understand it.

Pasquale's stake is professional and ideological, and openly so. The book is an argument for a policy position — mandated transparency, constraints on algorithmic secrecy — that aligns with the scholarly programme he is identified with, and its persuasive aim is part of its design. There is no commercial interest in the claim; the work is academic and normative, and it presents itself as advocacy rather than as a disinterested report.

the concepts this source discusses
Algorithmic opacityAlgorithmic opacity Black-box methodBlack-box method

discusses 2 conceptsopen the full territory →

excerpts

The term 'black box' is a useful metaphor for doing so, given its own dual meaning. It can refer to a recording device, like the data-monitoring systems in planes, trains, and cars. Or it can mean a system whose workings are mysterious; we can observe its inputs and outputs, but we cannot tell how one becomes the other.

Pasquale's gloss on the term carries [[source:ashby-1956-introduction-to-cybernetics|Ashby's]] sense — observe the inputs and outputs, cannot tell how one becomes the other — and adds a second: the device that records everything. The book is about systems that are both at once, watching while unwatched.

on Black-box method, Algorithmic opacity

We do not live in a peaceable kingdom of private walled gardens; the contemporary world more closely resembles a one-way mirror. Important corporate actors have unprecedented knowledge of the minutiae of our daily lives, while we know little to nothing about how they use this knowledge to influence the important decisions that we—and they—make.

The asymmetry that makes opacity political: it is not that the algorithm is hard to understand in the abstract, but that its workings are kept secret by parties who see everything about us. [[concept:algorithmic-opacity|Opacity]] here is a relation of power, not only an epistemic problem.

on Algorithmic opacity