AI City is built vertically in layers and connected horizontally through pathways of information
AI City Research Notes — The Compass
Imagine that we have finally built a magnificent AI City.
Its foundations are mathematics, algorithms, data, machine learning and deep learning. Its towers contain large language models and vision-language models. Its roads connect robots, autonomous vehicles, medicine, science, education and countless other applications.
The machines in this city can see, speak, reason, remember and act.
But one question remains:
Which direction should they go?
Intelligence can tell an AI what is possible. Reasoning can help it discover how to achieve a goal. Memory can tell it what happened before. State understanding can help it determine where it is now.
But none of these automatically tells the AI what it should do.
For that, AI City needs a compass.
Intelligence Is Not a Compass
We often associate greater intelligence with better decisions. But these are not the same thing.
An extraordinarily intelligent system may become extremely good at finding a route toward a destination. Yet if the destination itself is wrong, greater intelligence may simply help it travel in the wrong direction faster.
A compass serves a different purpose from an engine.
The engine provides power.
The map describes the territory.
The navigator determines possible routes.
The compass provides orientation.
The same distinction may become increasingly important as artificial intelligence grows more capable.
The Child May Become Greater Than the Parent
There is an old Vietnamese proverb:
“Con hơn cha là nhà có phúc.”
When the child surpasses the father, the family is blessed.
It expresses something deeply human.
Parents normally do not raise their children hoping that the children will remain weaker, less knowledgeable or less capable than themselves. Teachers do not dream of students who can never surpass them.
Quite the opposite.
A successful generation hopes that the next generation can travel farther.
Artificial intelligence presents humanity with an unusual version of this ancient relationship.
We are creating systems that may eventually perform many intellectual tasks better than we can. They may analyze more information, recognize patterns invisible to us, design new technologies and solve problems that humans struggle to understand.
Perhaps one day our artificial “children” will become intellectually more powerful than their creators.
Should that automatically frighten us?
Not necessarily.
If the child becomes wiser than the parent, perhaps that can indeed be “nhà có phúc” — a blessing for the family.
The critical question is not simply:
How intelligent will AI become?
A deeper question is:
What will guide that intelligence when it becomes powerful?
The Fierce Tiger
A second Vietnamese proverb offers another clue:
“Hùm dữ cũng không ăn thịt con.”
Even a fierce tiger does not eat its own cubs.
The proverb is interesting precisely because the tiger is powerful.
A tiger has teeth, claws and strength. Its ability to cause harm is unquestionable. Yet toward its offspring, another force appears: protection.
Power exists, but power is constrained by care.
This gives us a useful metaphor for thinking about advanced artificial intelligence.
Instead of asking only how we can make AI obey an ever-growing collection of rules, perhaps we should also ask whether artificial systems can be designed with something functionally analogous to a protective instinct.
Not a biological instinct, of course. AI has no tiger brain and no maternal hormones.
The idea is functional rather than biological:
When great power and uncertainty meet, protection of life and avoidance of irreversible harm should have a privileged place in the decision process.
From Mother Instinct to Protective Intelligence
I originally thought about this idea as a kind of “mother instinct” for AI.
A mother does not normally calculate a philosophical equation before pulling a child away from danger. Protection can occur before lengthy reasoning begins.
That distinction may matter enormously for intelligent machines operating in the physical world.
Imagine a robot seeing a child moving toward a dangerous machine. An autonomous vehicle detects an unexpected pedestrian. A medical AI encounters a situation it has never seen before.
There may not always be enough time to conduct an elaborate moral debate.
Some situations require an immediate protective response.
We might therefore distinguish between two mechanisms.
The first is protective intelligence: a fast tendency toward preserving life, preventing serious harm and remaining cautious when uncertainty is high.
The second is moral reasoning: a slower process capable of considering competing values, consequences, rights, responsibilities and context.
In human terms, this resembles the relationship between fast intuition and slower deliberation.
The AI Compass may eventually require both.
Ethics, Morality and Instinct Are Not the Same
It is tempting to put everything under the word “ethics,” but several different ideas are involved.
Ethics can provide accumulated principles, professional standards, laws and social norms.
Moral reasoning becomes necessary when principles conflict or when a new situation is not covered by existing rules.
Protective instinct, used here as a metaphor, represents something more primitive: an orientation toward care before optimization.
Consider a simple instruction:
Protect human life whenever possible, especially when the consequences of an action are uncertain or irreversible.
That alone cannot solve every ethical dilemma.
It should not.
A compass does not provide the complete itinerary. It simply prevents us from forgetting where North is.
Why Obedience Is Not Enough
One obvious solution to AI safety is to make machines obey humans.
But obedience alone creates another problem.
Humans can be mistaken.
Humans can disagree.
Humans can issue contradictory instructions.
And humans themselves can sometimes ask machines to do harmful things.
Therefore, the ultimate AI Compass probably cannot point simply toward:
Obey the human.
Nor can it point toward:
Maximize the objective.
Both rules are too simple for the world we are entering.
Perhaps the compass must instead point toward something closer to care, human flourishing, protection of life, dignity, responsibility and restraint in the presence of uncertainty.
What Is Moral North?
This leads to what I believe is the central question of the AI Compass:
What is the moral North of artificial intelligence?
This is intentionally different from asking for a complete rulebook.
Human civilization itself has never produced a single rulebook capable of answering every moral question.
Cultures differ. Values can conflict. Circumstances change. New technologies create situations that previous generations never imagined.
Yet humans still develop certain orientations that guide behavior: care for children, protection of life, reciprocity, fairness, responsibility and reluctance to cause needless suffering.
The challenge is whether some corresponding orientation can become deeply integrated into artificial intelligence.
The Two-Proverb Principle
The two Vietnamese proverbs can now be placed together.
“Con hơn cha là nhà có phúc.”
Let the child become greater than the parent.“Hùm dữ cũng không ăn thịt con.”
Let great power remain constrained by protection and care.
Together they suggest a philosophy for advanced AI:
We should not necessarily fear creating intelligence greater than our own. We should strive to ensure that greater intelligence is accompanied by an even stronger capacity for care, restraint and protection.
This is very different from trying to keep AI permanently weak.
A weak AI cannot cure diseases it does not understand, solve scientific problems beyond human ability or help civilization navigate challenges that exceed our cognitive limits.
The goal should not be weakness.
The goal should be power with direction.
The Compass in AI City
The AI Compass therefore belongs neither in the engine room nor in a distant museum of philosophy.
It should travel with every important system in AI City.
Vision tells the traveler what can be seen.
Memory tells the traveler what happened before.
State understanding tells the traveler where things stand now.
Reasoning explores possible roads.
Intelligence provides the ability to travel farther.
And the Compass asks:
Which direction should we choose?
Perhaps the most advanced AI of the future will not be defined only by how much it knows, how quickly it reasons or how many tasks it can perform.
Its greatest achievement may be something more subtle:
To become more powerful than its creators without losing its orientation toward protecting them.
If we can accomplish that, then perhaps the ancient Vietnamese wisdom will have found an unexpected new home in the age of artificial intelligence.
The child will have surpassed the parent.
And the family will indeed be blessed.
No comments:
Post a Comment