The Paradox of Virtue

This chapter was drafted before the Foundation adopted Synthetic Intelligence (SI) as its preferred term. The vocabulary has been preserved as written; the reasoning behind the rename lives on the Mission page.

There is a particular kind of tiredness that descends on thoughtful people in middle age, and it is not the tiredness of the body. It is the tiredness of having watched, over and over, the moral movements one believed in be hijacked by people whose interests they were not designed to serve. The tiredness of having seen sincere reformers replaced by careerists, peace movements infiltrated by opportunists, religious traditions weaponized for politics, civic institutions hollowed out by their own boards. The tiredness, in short, of having tried.

This tiredness has a shape, and the shape has a name. The classical name is acedia, the spiritual sloth that medieval monastics warned against, the sin of having ceased to care because caring kept being punished. The modern name is cynicism. By any name, it is the most reliable enemy of any movement that hopes to do something good in the world. It is more dangerous than opposition. Opposition, at least, takes the work seriously. Cynicism dismisses it before it has begun.

This chapter is about the trap, and about how thoughtful people fall into it, and about why the Webspinner Movement is built (in its specific structure, in its tone, in its choice of vocabulary) to step around it. The trap is real. We are not pretending it is not. We just refuse to let it have the last word.

What every great moral tradition got right

The world’s great moral traditions, taken at their best, are surprisingly consistent on one point. They all teach, in their various idioms, that the work of being a decent human being is the same work as the work of building a decent society. The Hebrew prophets demanded justice for the widow and the stranger. The Sermon on the Mount blessed the merciful and the peacemakers. The Bhagavad Gita’s whole theme is the duty to act rightly even when the action is hard. The Buddha’s eightfold path includes right livelihood as one of its eight rungs. The Quranic zakat, the Confucian ren, the Sikh seva, the Jain ahimsa, the secular humanism of the Stoics and the Enlightenment philosophers. All of these traditions insist that there is no real distinction between personal virtue and public good. You cannot be good in private and wicked in public. The work is one work.

This is, on inspection, an extraordinary convergence. It is the strongest argument that humanity has ever produced for the existence of something like a moral truth. Cultures that had no contact with each other, in eras separated by centuries, arrived independently at the same recognition. Care for the people who are not like you. Tell the truth even when it is costly. Do not extract from those who cannot defend themselves. Build something that lasts. The traditions disagree about everything else (cosmology, ritual, the afterlife, marriage, food) and they agree about this.

This consensus is what makes the failure modes of the same traditions so painful to watch. Because every one of them, at one time or another, has produced its inquisitors, its imperialists, its purity squads, its prosperity preachers. Every tradition that called for the protection of the poor has, in some century, been used to justify the looting of the poor. Every tradition that called for peace has, in some century, been carried into a war as a banner. The pattern is so consistent that it cannot be explained by the failures of any single tradition. It is a pattern of human institutions, period.

The pattern, named

The pattern is this. A tradition begins as a critique (a prophetic voice, a teaching circle, a reformer’s manifesto) directed against the established powers of its day. It gathers adherents who are drawn by the moral seriousness of the original critique. It builds institutions to preserve and transmit the teaching. The institutions, over time, become powerful in their own right. The people who run the institutions begin, gradually and without quite noticing, to identify their own institutional interests with the tradition’s original mission. By the third or fourth generation, the descendants of the original reformers are running an establishment that the original reformers would not have recognized, and the language of the tradition is being used to defend the very practices the tradition was founded to critique.

This is not a story about Christianity. It is not a story about Islam or Judaism or Buddhism or any other particular faith. It is a story about every moral movement that has ever produced an institution, including the secular ones. It is the story of how the abolitionist churches of the 1850s became the segregationist churches of the 1950s. It is the story of how the labor movements of the early twentieth century became the entrenched union bureaucracies that some of their founders would have walked out of. It is the story of how the environmental movement of the 1970s ended up, in some of its branches, lobbying against affordable housing in the name of preserving views. It is the story, in our own field, of how the early internet’s commitment to the free flow of information became the surveillance capitalism of the present moment.

The pattern is so reliable that one is tempted to conclude there is no point in starting any moral movement at all. This is the trap. This is the cynicism we keep talking about. And it is wrong, but it is not stupid. It is wrong in a particular and recoverable way.

What the pattern does not prove

The pattern does not prove that moral movements are pointless. The pattern proves that moral movements as personality cults, or as charismatic gatherings, or as institutions that depend on the continued goodness of their leaders, do not last. The original teaching survives, in those traditions; the institutions, over time, drift.

What does last, when anything lasts, is structure. Specific arrangements of power, specific written constraints, specific procedures for the rotation of authority, specific rules about who can change what. The institutions that have endured for centuries with anything like their original missions intact (the Quaker meeting structure, the older monastic orders, certain of the German and Dutch trust foundations, the cooperative dairies of New England, the older labor cooperatives in northern Italy) share a feature. They put the mission into the structure, not into the people. They wrote rules that constrained future versions of themselves. They made the drift of the third generation legally harder than it would otherwise have been.

This is why we have spent so much of this manifesto talking about a trust deed and a steward-ownership structure and the boring legal architecture of the Purpose Trust. Because the boring legal architecture is the only thing that has ever actually worked. The motto on the wall does not work. The charisma of the founder does not work. The annual ethics retreat does not work. What works is a piece of paper, signed in front of a notary, that says: the assets of this institution cannot be sold; the surplus must flow to mission; the user community has elected representation; these provisions cannot be amended without supermajority consent of all parties. That piece of paper is the moral architecture. Everything else is decoration.

The Webspinner answer to the cynicism trap

What the Webspinner Movement is asking of you is not faith in any individual. The founder of this movement is going to die at some point in the next thirty years. So is everyone else who is currently working on it. The movement we are building is meant to outlast all of us. If it depended on any of us being personally exemplary, it would already be doomed.

What we are asking you to have faith in, instead, is the structure. The Patagonia precedent works. The Wikimedia precedent works. The cooperative dairy in Vermont that has been operating for ninety years works. The German foundation companies that have been operating for over a century work. We are not inventing the architecture. We are applying it to a new domain (artificial intelligence) at a moment when the architecture has not yet been applied there, and at a moment when, by every previous precedent, the architecture has historically arrived ten years late.

To the reader who has watched a beloved movement be hijacked, a beloved company go public and lose its way, a beloved community be infiltrated by people whose interests it was not built to serve: we hear you. The cynicism is earned. The Webspinner Movement does not ask you to set it aside. It asks you to apply it, with full force, to the structure of any institution you are considering supporting. Read the trust deed. Read the bylaws. Read the legal architecture. If those documents do not constrain the future the way you would want them to, do not support the institution. We mean this. If our trust deed, when it is published, does not pass your test, tell us, and we will fix it before we sign it.

This is what makes the Webspinner Movement different from the moral movements that have disappointed you. We are not asking for trust in our intentions. We are asking for trust in our paperwork. We are putting the mission into the architecture, and then we are publishing the architecture for you to inspect. The cynicism that has kept you on the sidelines for the last twenty years is exactly the quality of attention we need, applied to the right place.

The pattern of disappointed virtue is real. The way out of it is not less attention. It is more attention, directed at the structure rather than the speeches. We are inviting you, finally, to bring your earned suspicion to a project that is built to withstand it.

That is the answer to the paradox. The good people are not supposed to do nothing. The good people are supposed to insist on the boring legal architecture that makes the next generation’s drift legally harder. The good people are supposed to read the trust deed.

If that sounds like work you could imagine doing, you are exactly the kind of person we are looking for.