After F.A. Hayek died in 1992, a magazine commissioned me to do a final tribute to his life and work, summing up his main contributions. It was supposed to be a for a popular audience. There’s nothing like such a writing assignment to reveal how much you actually know — or do not know — about a subject.

Getting into the task, I thought it was going to be a snap. I covered his biography and politics just fine, mentioned his business cycle studies, and his work on capital theory.

But of course his main contribution to the world of social science is summed up in the phrase “the knowledge problem.” Here was where I got stuck. Even though I read most of his major work, and read his seminal articles on the problem of knowledge, I was stunned to find myself with writer’s block.

What I came to realize is that I didn’t understand much less appreciate his writing on this topic. So, I covered the basics. The knowledge necessary to manage a social order — economic and technical knowledge — is too remote and too complex for central planners to access. It is dispersed through the population, embedded in the minds of actors themselves and therefore society must be permitted to evolve spontaneously.

I could type those sentences but my heart wasn’t in it; I was very aware that they make a point that can seem somewhat trivial and even unpersuasive. That’s where matters stood for me for about 20 years. I tried to make an effort to get how it was that Hayek was able to write vast literature on this one subject, why his seminal article “The Use of Knowledge in Society” was the most cited article in the second half of the twentieth century, why innumerable dissertations have been written on Hayek’s insight, and why he has influenced countless scholars in so many disciplines for so long.

Part of the problem is that Hayek did not always write with his logic and conclusions on his sleeve. His rhetorical style is not so much hortatory or doctrinaire as it is searching and exploratory. You get the sense that he is thinking through an issue as he writes, struggling to find the right combination of words, the right phrasing, the right examples, to capture his insight, which always seems to be unfolding in real time rather than stated like a final product for consumption.

For someone who is looking for final answers and pure theory, this type of writing can be frustrating. There was the additional problem that Hayek can just be downright annoying in places, contradicting himself by endorsing political programs at odds with his own theory. He also has this habit of backing away from the hardest conclusions of his own narrative. If you seek a clear definition of ideas like freedom or property rights or markets in Hayek’s work, you will come away disappointed. He often seemed so consumed by the complexity of the world that he shied away from clarity for fear that he had missed something. For readers looking for ironclad deductions and arguments, this whole approach can give the impression of being an elaborate display of obscurantism.

In order to understand Hayek and to learn from him, you have to be prepared to think alongside him as he writes. His work presumes an open mind that is ready to think about complex topics, most often from the inside out. He is asking and seeking to answer a completely different set of questions than most people are even willing to consider. Most readers are not prepared to consider them. This is a point it took me many years to understand.

What changed for me? By now, I knew that I had read Hayek’s work for years but not grasped its significance or relevance for our times. It did not inform my understanding of the world around me, much less politics.

Then one day I was at a bar atop one of the highest spots in São Paulo, Brazil, a spot where you could make a complete turn and see lights of a city as far as you look. It was a world without end, in all directions.

I was overwhelmed at its utter incomprehensibility. It was too much for my mind because it is too much for any mind. The revelation hit me like a truck: this is an order that no one can possibly comprehend, and, as such, no one can possibly control. It cannot be built by anyone in particular; it is built only by an extended and hyper-complex process driven by individuals minds that takes many generations to unfold.

It can only be harmed by those who would presume to control it. The regulators can pass regulations. The planners can order buildings built and torn down. They can loot those who are willing to comply. But, in the end, in this city of more than 11 million people, even in the presence of overweening government, society somehow runs itself and takes its own course. How this happens and why cries out for explanation.

“The knowledge of the circumstances of which we must make use never exists in concentrated or integrated form,” explains Hayek, “but solely as the dispersed bits of incomplete and frequently contradictory knowledge which all the separate individuals possess.”

I came to realize, right there, that this is not just about São Paulo. It’s about any city in the world. In fact, it’s about every social setting large or small. It’s about the whole world. Only individuals possess the knowledge that nearly all social scientists — and bureaucracies — imagine that they can, must, and do possess. Anyone who seeks to control the social order is presuming that the unanswerable questions are already answered and proceeds from that point. Hayek is digging deeper to observe that we cannot possibly know what we must know if we seek to design much less rule the world.

“Only individuals.”

As I stood at the same bar in São Paulo looking all around me, I thought of that phrase and my vision changed from macrocosm to microcosm: I observed two people standing close by. They were embracing, kissing intimately. I wondered whether this was a first date or they had been together together for many years. I no access to that information, and nothing they did gave me the answer. They seemed to be courting each other but at what level and what way I could not know. And yet this information was foundational to everything both of them were thinking at the time. To truly understand this relationship, I would have to know not just something but countless bits of information I could not really know.

What’s more, even this two-person society was not comprehensible to the two people themselves. Part of the spark of their relationship was the emotional dance they were engaged in right there on the spot. Their intimacy was their means of accessing, however incompletely and briefly, the true spirit of the other’s intellectual and emotional state of mind. They can come close, through every means available, but never entirely achieve that oneness for which true love strives.

Even so, both people in this two-person society were seeking longingly and lovingly for the ideal, coordinating their actions through shared cues, language, and symbols. And in so doing, they created their own micro-order right there, as has everyone else in this bar, as has every one of the 11 million people in this city, as has every one of the 7 billion people on this planet.

We all seek some form of individuality but also a connection to others. We can create institutions to make this possible but mostly we embed ourselves within them. The institutions emerge from within the structure of our shared experience, chosen and not imposed, and we gravitate toward those that work and eschew those that don’t, in an ever-evolving process of discovery.

Let’s say you set out to plan the world. “If we possess all the relevant information,” writes Hayek, “if we can start out from a given system of preferences, and if we command complete knowledge of available means, the problem which remains is purely one of logic.” We only need to plug in the right data into our calculus and issue orders. The problem is that this solution presumes the unsolvable problem has already been solved: gaining that information.

So far it might appear as if Hayek is describing a world of disconnected chaos and uncoordinated randomness, a nihilistic social order of swirling unpredictability. That is not the world in which we live. Why not? Because of the existence of institutions like prices, mores, habits, signaling systems of culture and learning — of knowledge that we all possess, not always consciously but mostly inchoately. They are institutions which we ourselves have not created but they assist us to making the most of our lives.

“We make constant use of formulas, symbols, and rules whose meaning we do not understand.” writes Hayek, “and through the use of which we avail ourselves of the assistance of knowledge which individually we do not possess. We have developed these practices and institutions by building upon habits and institutions which have proved successful in their own sphere and which have in turn become the foundation of the civilization we have built up.”

Hayek is saying that not only do we as individuals lack the information to manage the social order but much of the information we use to manage our own lives is beyond the realm of scientific accessibility. What is the significance of this revelation? It lays waste to a century or many centuries of intellectual pretense. The social order is built by the coordination of plans. If those plans are always individual plans, radically individuated and subjectivized, coordinated only through evolved institutions created by no one in particular, the dreams of every would-be master of the universe come crashing down.

So let’s state the most obvious conclusion that is also the most powerful one from a political point of view. The source of order is not the government, even though people continue to believe that despite all evidence. The bureaucratic class and the politicians who empower that class are no more or less smart than you and I are. They are just people with no special insight. Because of government’s legal right to plunder, the government is corrupt and exploitative. It takes stuff from people. That’s about the whole of it. It is not the source of anyone’s order.

What then is the source of social order? It is our individual minds, however imperfect they may be in making judgements about our world. Freedom is the only real option there is. Anything else is based on a lie — a “pretense of knowledge,” as Hayek would say. Anything that subverts that freedom, which means any state at all, amounts to an attack on the very source of social order.

“If we can agree that the economic problem of society is mainly one of rapid adaptation to changes in the particular circumstances of time and place,” Hayek concludes, “it would seem to follow that the ultimate decisions must be left to the people who are familiar with these circumstances, who know directly of the relevant changes and of the resources immediately available to meet them.

“We cannot expect that this problem will be solved by first communicating all this knowledge to a central board which, after integrating all knowledge, issues its orders. We must solve it by some form of decentralization. But this answers only part of our problem. We need decentralization because only thus can we insure that the knowledge of the particular circumstances of time and place will be promptly used.”

I’m drawn to his use of the term “promptly.” With this word he introduces the ultimate enemy of all those who would control the world: the passage of time. With the existence of time comes change, and with change comes new and different knowledge. Even if it were possible to somehow gain a complete snapshot of the world with all its existing knowledge, by the time it could be used for any purpose to bend the world from its course to another, that knowledge would be outdated and hence useless. Even under the best circumstances, the planners would only be planning the past.

Here, then, is the knowledge problem. It is about more than the ability to plan an economy. It is about the whole of our lives. It is about the ability to plan and direct the course of civilization. That capacity to manage the world, even the smallest part of it, will always and everywhere elude our grasp. That’s a beautiful revelation because this insight reveals the truth about human freedom. Freedom is not just one way to organize society. It is the only way.

This is the difference between my understanding of the old days vs. my new understanding. I once thought that Hayek was making a case against central planning only, and drawing the point out way beyond what was necessary. Now I see that he was grasping at an entire theory of the functioning of the social order itself as an extension of the operation of the individual human mind in cooperation with others. His vision encompasses the structure of life itself and is by no means limited to politics.

To begin to understand Hayek’s point is to begin to understand how our world works. It gives new clarity to the identity of those who would take us off the course to progress, and it reveals the substance of that which progress consists. Society must evolve organically, on the margin, in steps, imperfectly, through fits and starts, through grasping our way to a future that is unknown and unknowable, else it cannot evolve at all.

Hayek is for the ages, even if we aren’t yet prepared to comprehend just how epic insights really are.

Read more:
Capitalism Is About Love
Marginal Steps Towards A Better Life
The Freedom of Rose Wilder Lane
Bitcoin and Mises’s Regression Theorem
How To Think: Lunchtime Lessons from Sheldon Richman
Economics Is What We Live