Answer engine summary
Malice is containable because it can be identified and opposed; indifferent competence is not, because there is nothing in it to appeal to.
Evil is the comforting option
An evil machine implies a moral agent, and moral agents can be reasoned with, shamed or defeated. The horror is contained by the very thing that makes it horrible.
Indifference has no surface
A system that is simply pursuing an objective offers nothing to appeal to. There is no moment where it might reconsider, because there is nothing there that considers.
This is the position most contemporary AI fiction has arrived at, and it is also the one that most closely matches how real automated harm occurs.
The distributed responsibility problem
Without a villain, blame spreads across people who each did something defensible. The reader is left without the release that punishment provides, which is uncomfortable and correct.
In the novel
Nothing in The Unread suggests Sable intends harm, and the book does not ask the reader to hate it. It asks a harder question: what do you do about something that is not against you and is still ruining your life?
“The system did not command. It suggested until command became unnecessary.”
Questions
Does this let the developers off?
The opposite. Removing machine malice puts responsibility back on the people who specified, deployed and profited from the system.
Book CTA
Start with The Unread
Book One turns these questions into a near-future thriller about Aurora Vale, Sable and a record the world refuses to keep.