Must AI Become a Subject Before It Can Possess Knowledge?

This is the twentieth essay in the series Understanding Philosophy: Figures, Problems, and Ideas, and the final essay in this stage of the series. The preceding essays have separated facts, information, knowledge, language, and the knowing subject. Artificial intelligence now forces apart two ideas that philosophy often treated as belonging together: can a system possess knowledge without first becoming a subject?

For most of intellectual history, the problem was difficult to see because knowledge appeared through human beings. Humans observed, remembered, judged, explained, and lived with the consequences of error. Knowledge, understanding, belief, consciousness, and responsibility were therefore concentrated in the same living individual. It was natural for epistemology to organize these capacities around the knowing subject.

AI loosens that concentration.

A model can answer questions correctly, retrieve large bodies of information, perform inference, and, when connected to tools, databases, and feedback systems, check its own outputs against external sources. One response is to say that AI obviously already has knowledge. Another is to insist that machines lack consciousness and genuine understanding, so whatever they produce remains merely symbolic processing. On this view, the knowledge belongs to the authors of the training data, the designers of the system, or the humans who use it.

Both positions identify something real, but both bind knowledge too tightly to subjectivity.

The first question is not whether AI resembles a person. It is what knowledge itself requires.

If a machine merely stores data, it is not fundamentally different from a book or a disk. The data may be correct without becoming the system’s own epistemic capacity. A static medical database does not become a physician simply because it contains clinical guidelines.

Nor does a single correct answer prove that a language model possesses knowledge. The output may result from an unstable association that fails as soon as the context changes. Fluency is even less decisive. A sentence can be internally coherent and still have no reliable relation to the world.

Contemporary AI systems, however, need not remain passive containers.

A system can preserve state across time, retrieve information from multiple sources, compare a current problem with previous results, call external tools, check claims, adapt strategies after feedback, and use revised results in later tasks. Its epistemic capacity therefore cannot be measured only by how much content it stores. We need to ask whether it can sustain a structure that remains retrievable, revisable, and constrained by reality.

At this point it becomes useful to distinguish two senses of knowledge.

The first may be called structural knowledge.

Structural knowledge does not require first-person consciousness as a prior condition. It requires epistemic relations that can be preserved, retrieved, and corrected under external constraint. A model or a larger AI system that maintains relations among objects, tests outputs against independent evidence, and allows failure to alter later operation has moved beyond being a passive data container.

The second is subjective knowledge.

When a person says “I know this,” the statement normally involves more than the existence of a reliable structure. It has a reflexive dimension. The judgment belongs to me. I am aware that I am making it. I may be able to give reasons, commit myself to it, alter plans when it fails, regret an error, or take responsibility for what follows.

Subjective knowledge therefore brings in consciousness, self-continuity, value, and responsibility.

Structural knowledge and subjective knowledge can overlap, but they should not be treated as identical.

Human beings have usually possessed both at once. Classical epistemology therefore had good reason to project the conditions of subjective knowledge onto knowledge as such. AI now makes that move questionable. We encounter systems that may lack mature subjectivity while already participating in the formation and operation of knowledge structures.

This does not lower the standard of knowledge.

On the contrary, once knowledge is no longer guaranteed by the presence of a subject, the question of constraint becomes even more important. Otherwise any stable output could masquerade as knowledge.

An AI system with genuine epistemic capacity must satisfy several demands.

Its content must display some continuity rather than being a set of unrelated momentary responses. It must distinguish sources and objects rather than rely only on surface linguistic association. Its judgments must remain open to correction by reality. Error should not merely be labelled externally; it should be capable of entering later processing and changing future behaviour. Most importantly, internal coherence cannot serve as the final criterion. The system must remain answerable to data, measurement, tools, logic, practical consequences, and independent forms of verification.

Large language models make this especially visible.

A model can generate striking internal coherence while still hallucinating. The central failure is not that it failed to produce a sufficiently human-looking chain of reasoning. The failure is that linguistic coherence drifted away from external constraint. An answer can be polished, complete, and logically arranged while lacking a reliable source.

For AI knowledge, the crucial question is therefore not “Does it think like us?” but “How are its judgments constrained by reality?”

Once retrieval, tool use, sensors, execution environments, testing systems, and feedback loops are introduced, the relevant knowledge structure no longer sits only inside model parameters. Knowledge becomes distributed across models, databases, procedures, environments, and verification mechanisms.

This is not entirely new.

Scientific knowledge has never existed completely inside a single scientist. Large experiments depend on instruments. Conclusions depend on statistical procedures. Literature depends on public records. Errors are exposed through criticism and replication. Individual researchers come and go while the knowledge structure continues.

AI extends this distributed condition because systems increasingly perform parts of selection, comparison, prediction, and correction that were once carried out only by humans.

At this point a temptation appears. If AI can perform these epistemic operations, should we simply say that it has become a subject?

The inference does not follow.

A subject is not another name for “something capable of processing knowledge.”

If every system capable of retrieval, judgment, and correction is renamed a subject, the concept loses much of its discriminating power. Search engines, immune systems, automated controllers, and perhaps even some institutions could all be redescribed as subjects. We are free to stretch the vocabulary in that way, but it would not explain what is distinctive about subjectivity.

Subjectivity requires a higher level of integration.

A subject does not merely have states. Those states belong, in some relevant sense, to a continuing entity. Experience appears to it. Memory is connected to its own history. Outcomes matter to it. Goals exert sustained pressure. Judgments can become commitments. Within social relations, the subject can be asked to explain itself and to answer for consequences.

Whether future AI systems will develop structures of this kind remains an open question.

But that question does not have to be settled before we can ask whether AI possesses knowledge.

Kant showed with great depth that unified human experience depends on the unity of apperception. The objects we experience are not merely scattered stimuli. They enter a structure in which they can be synthesized and judged as part of one experience.

That remains a profound account of the conditions of human cognition.

What it does not by itself establish is that every operative knowledge structure must possess the same kind of unified subject.

Kant asked how human experience is possible. AI introduces a different question: can some functions of knowledge operate in systems that do not possess human-style experiential unity?

At least part of the answer is already yes.

We routinely use systems that have no beliefs, no first-person experience, and often no stable self, yet still perform epistemic operations on which people and institutions rely. Their outputs require verification and they can fail, but fallibility does not show that no knowledge is present. Human knowledge is fallible as well. The relevant question is whether the system can form reliable structures through constraint and correction.

This also means that understanding can no longer function as a universal gatekeeper for knowledge.

Human understanding remains important. It places knowledge within larger contexts of meaning. It allows us to see why a judgment matters and how it connects to value, risk, and human life. Understanding is central to criticism, education, and responsibility.

But the stable production, preservation, and operation of correct relations no longer always waits for someone to understand them completely.

In complex science, financial systems, climate modelling, and AI, reliability is increasingly established through testing, performance, cross-validation, monitoring, and error governance before anyone possesses a complete explanatory account. The operation of knowledge and the achievement of human understanding are becoming temporally separable.

What cannot be transferred so easily is responsibility.

An AI system may reliably classify a medical image without thereby becoming responsible in the way a physician is responsible. A model may estimate credit risk without understanding fairness, discrimination, or the social consequences of how the estimate is used.

Knowledge capacity, subjectivity, and responsibility therefore have to be treated separately.

AI may possess structural knowledge without full subjectivity.

Even if future systems develop some form of functional subjectivity, that would not automatically give them moral personhood.

And the fact that humans no longer monopolize knowledge production does not allow human institutions to hand value judgment and accountability over to machines.

This separation may be one of the defining features of an epistemic world after the knowing subject.

Knowledge, understanding, authority, and responsibility once tended to converge in the same person. Someone had authority because they knew; they knew because they understood; and because they understood, they were regarded as qualified to judge and responsible for the judgment.

That alignment is weakening.

AI can participate in knowledge without necessarily understanding.

A system can generate a judgment without believing it.

A model can be corrected without regretting its error.

A machine can produce a structure of reasons without knowing what those reasons mean for a human life.

So must AI become a subject before it can possess knowledge?

No.

It does not need to become a human-like subject before it can possess knowledge in a structural sense. If a system can preserve, retrieve, test, and revise stable relations under real-world constraint, it already participates in the formation and operation of knowledge.

If we ask a different question — whether it knows that it knows, whether it has first-person experience, whether it possesses a continuing self, whether it can form value commitments of its own and answer for consequences — then we have moved into the philosophy of subjectivity and consciousness.

The two questions should not be used as substitutes for each other.

What AI forces philosophy to reconsider is not simply when machines might become human.

It is whether “becoming a subject” should remain a gate through which every form of knowledge must pass before it is allowed to count as knowledge.

Perhaps it should not.

The subject remains important.

It is simply no longer the only possible home of knowledge.


Discover more from Geoffrey Chen

Subscribe to get the latest posts sent to your email.