At first glance, there is an obvious objection.
Modern artificial intelligence can require enormous computational resources. Large language models may contain billions of parameters and depend on powerful accelerators, large amounts of memory, and, in many cases, remote data centers.
How could an operating system possibly contain dozens — perhaps hundreds — of intelligent modules without becoming impossibly resource-hungry?
The answer is specialization.
Living OS does not need hundreds of copies of ChatGPT.
A module responsible for thermal management does not need to write poetry, understand politics, recognize thousands of objects, or speak twenty languages.
It needs to predict temperature, understand workload patterns, recognize abnormal behavior, and choose between a limited number of safe actions.
A storage module has a different narrow world.
So does a network module.
So does a battery-management module.
The smaller and more precisely defined the problem, the smaller the intelligence required to solve it can potentially become.
And not every intelligent module needs to be a language model — or even a Transformer.
Depending on the task, the appropriate mechanism might be a tiny neural network, a decision tree, a Bayesian model, an anomaly detector, reinforcement learning, or a hybrid system combining learned behavior with conventional algorithms.
This is not merely theoretical.
TinyML already demonstrates that machine-learning inference can run directly on microcontrollers and digital signal processors with extremely limited memory and computational resources [13]. Research into on-device learning is pushing this further, exploring ways for models to adapt locally while reducing memory requirements, computational cost, and energy consumption [14–15].
For Living OS, however, there is another important principle:
an intelligent module should have a resource budget.
It should know how much memory, storage, processor time, accelerator time, and energy it is permitted to consume.
If its function can be performed by a smaller model, it should become smaller.
If a learned behavior can be converted into a simpler deterministic algorithm without losing the required quality, it should be.
If accumulated observations no longer improve its decisions, they should not be preserved indefinitely.
In other words, optimization applies not only to the hardware being managed.
It applies to the intelligence doing the managing.
This creates a very different model from today's race toward ever larger general-purpose AI systems.
Living OS would rely on the smallest sufficient intelligence for each task.
A large external model may still be useful when the system encounters a genuinely difficult problem — perhaps during the analysis of unfamiliar hardware, the construction of a complex compatibility layer, or a task requiring broad reasoning.
But such external intelligence should be an additional resource, not a condition for the operating system's existence.
The essential functions of the machine must remain local and autonomous.
The computer should still understand its hardware.
It should still protect itself.
It should still adapt.
It should still remember.
Even when the Internet disappears.
And that last word — remember — leads to what may be the most important part of the entire architecture.
Because an operating system that can survive changing hardware is interesting.
An operating system that can preserve the continuity of the person using it is something much more significant.