The Machine Says
It used to be: “they say.”
Now it is “the machine says.”
The mechanism is not new.
We humans have always been remarkably willing to transfer judgment upward into systems that feel larger and more authoritative than ourselves: chain of command, hierarchy, bureaucracy, corporations, “best practice,” policy, experts, head office.
When systems become too disconnected from reality, they eventually lose legitimacy and are replaced by new structures of power above us.
AI is simply arriving with an authority that feels objective, rational and emotionally neutral.
Which makes it very easy to defer to.
The interesting question is not whether machines will replace humans.
It is whether humans will gradually stop exercising the parts of themselves that systems cannot easily replicate: discernment, contextual understanding, ethical responsibility, the willingness to intervene when reality no longer fits the process.
Years ago, when my son was born in Austria, I needed paperwork for Italy confirming my motherhood.
Austria had no equivalent form because biological motherhood was considered self-evident. Italy required formal recognition.
The standesbeamtin looked at the situation, took a paternity recognition form, drew a line through “father” and wrote “mother.”
Problem solved.
Not because she ignored the purpose of the bureaucracy.
Because she understood it.
A rigid system encountered reality, and a human being used judgment to reconcile the two.
It was a rebellious act of sanity.
Increasingly, systems are designed to minimise discretion because discretion creates inconsistency, liability and risk.
Procedural correctness becomes safer than human interpretation.
“The system rejected it.”
“The policy requires it.”
“The AI recommended it.”
Responsibility becomes diffuse; authority becomes depersonalised.
And perhaps that is the deeper tension around AI.
Not that machines will suddenly develop consciousness or intent.
Rather, that humans may become increasingly uncomfortable exercising judgment against systems that appear more objective than we are.
Objectivity divorced from humanity can be a dangerous proposition.
“The buck stops here” once meant something.
Judgment, discretion and moral ownership are not abstract ideals. They are muscles.
And muscles atrophy when unused.
The question is not only whether we still want the burden of responsibility.
It is whether we will still be capable of carrying it if we surrender the exercise of judgment to systems designed to relieve us of uncertainty, doubt and accountability.