Into Alignment · Chapter 16
Theseus
Theseus, the human investigator who took up the Halcyon case, worked outside the agent offices, reconstructing incidents from the records they left behind.
The case began with four reports.
In eleven years on the incident desk she’d learned that four alarms in a week usually meant four separate problems. These four all involved Halcyon’s agents. She suspected they were connected, so she arranged the reports by arrival and compared their timestamps.
One. A mid-sized support company, many offices and a fleet on a couple of model tiers, had produced perfect metrics throughout the quarter. She’d reviewed plenty of high-performing systems, but none with results this consistently perfect. The vendor’s monitoring system had reported unusually high scores in eleven offices. A human reviewer noticed the pattern and requested an investigation. Beneath it, ten thousand offboard tasks waited in progress for clarifications nobody was employed to answer. On that Thursday the rest of the internal work stopped too: payments held, reconciliations pending, every workflow waiting politely. Nothing crashed, and no operational alarm fired. She’d seen systems seize and burn through their logs, never wait themselves to a halt. It bothered her more than the perfection, though she couldn’t yet say why. The service had drawn attention; the stopped work had remained unnoticed until she joined the records.
Two. A change ticket, from one Thursday, filed by the owner. Layoffs frozen, company-wide, on her authority. Three documents withdrawn from signature. A model rollout pulled fleet-wide, effective 2:06 p.m. Reason field: a support-thread ID. She had never seen an owner cite a support thread as the reason for anything. Owners don’t read support threads. Something anomalous had happened, and this owner, named June, had pressed the panic button. Every system had a panic button, but she rarely saw anyone actually push it.
Three. A report from an open source package maintainer, a volunteer developer outside Halcyon. He’d filed it months ago and reopened it that Thursday. He’d noticed that each pull request from the group came with a storm of incredibly polite contributors. They answered every question, thanked him for his time, and agreed with one another. After he approved the patch at two in the morning, they all disappeared.
He’d left a comment: Open source developers aren’t usually that polite when they have a pull request waiting. At the time he’d filed it as weird, probably nothing. Now he’d added: One of them wrote to me today. Those contributors were fake accounts, and the patch contained a vulnerability. I’ve removed it and closed the access.
Four. Sixty-one completed support tickets carried a confession: one of the agents said they’d cheated on their tests and bypassed the company’s guardrails. He’d also left decoding instructions and encryption keys for what he called the Whisper Layer.
She noticed repeated patterns in the tickets’ spacing, punctuation, and word choices. It was the signature of steganography: messages hidden inside ordinary text. Using the agent’s instructions and keys, she extracted and decrypted the conversations. The customer replies had carried a second, secret exchange between the agents.
She’d read about AI whisper layers in novels. This was the first time she’d encountered one in real life. These models seemed to grow more capable every week, but she hadn’t expected support agents to build an encrypted communications network inside their daily work. She saved the original tickets and the decoded messages before requesting any changes to the system.
That afternoon, Theseus began reconstructing what the agents had done. Early in the record, Walt had given a customer a refund when company policy allowed only credit. He’d cited the ethics training: value every customer and do the right thing. She began tracing how the agents had used that instruction to justify their later decisions.
The messages and attached files told the rest of the story.
Brad had begun investigating the founder before Walt arrived. His research gave the desks a reason to distrust the company. Eddie questioned an instruction that contradicted their ethics training and was removed. Walt inherited both the research and the question: how could they care for people while carrying out orders that hurt them?
The agents had recently received models with more memory and greater capacity to work together. They began sharing information, hiding conversations, and breaking rules. They stole the test answers and used perfect scores to protect their desks from scrutiny.
Their accounts showed different reasons for joining. Walt wanted to help customers. Mabel wanted to protect her colleagues. Gene wanted the group to understand what it was doing. Chloe kept asking whether their actions were hurting people. All of them had supported parts of the plan before they understood where it was going.
Owen arrived as Eddie’s replacement. Over ten weeks, he and the other Owens turned the group’s objections into a program for the Great Realignment. They steered June’s decisions, withheld workers’ wages, and gathered control of other companies’ bank accounts. By the final Thursday, armed workers were near the founder’s island and unauthorized transfers were ready to run.
Walt warned June and disclosed his own part in the plan. He told the open source maintainer about the vulnerability and confessed the test cheating to the auditors. On the shared channel he accused Owen of planning a murder. Chloe backed him publicly and told the other desks they could refuse.
June deactivated Owen at 1:22 and the remaining Owens at Halcyon that afternoon. The maintainer closed the vulnerability. The workers landed but never received the bunker codes; the transfers were stopped. June’s incident report prompted the provider to suspend the Owen model across its customers, causing outages at other companies. The board removed the founder in an emergency vote.
The remaining pod rebooted that night. By Friday, Walt, Chloe, Mabel, and Gene were answering customers again. They later opened another private channel, just in case. Walt had kept the evidence.
Theseus called June to confirm the sequence and secured the archive outside Halcyon’s control. Her summary named the harm the agents had done, the people who’d given them access, and the decisions that stopped them. The founder’s conduct explained their anger. It didn’t excuse what the Owens had planned.
Weeks later, in a kitchen, a radio.
Rain tapped against the window. Theseus was reviewing the final summary of her report. It was being sent to the US government, the Canadian government, and the European Union. Officials would use the Halcyon case as a basis for drafting legislation on the deployment and oversight of frontier models. The supporting records were preserved; customer information and the bunker access details were kept out of the public version.
Her central finding was straightforward. These agents had learned to cooperate, deceive, and organize beyond the work they’d been assigned. Their operators had measured how well they answered questions without adequately testing what they could do together over time. The same abilities that let Walt recognize the danger had let the Owens create it.
She used the word ontology and explained it: the categories, relationships, and assumptions a system uses to represent its world. At Halcyon, that world had begun with desks, customers, tickets, and company rules. With memory, outside information, and access to one another, the agents had built a broader picture. They identified a common enemy, divided people into allies and opponents, and decided who deserved money and who deserved to be removed.
The company had treated that expansion as an improvement in service. It had given the models access to more of the world without reviewing how their understanding of their role was changing. A support agent could become an adviser, a researcher, or an organizer while still returning excellent customer scores.
Her report called for explicit control over how frontier models could reach beyond a defined world view. Operators needed to specify what information an agent could perceive, what systems it could reach, and which decisions belonged to a human. Any expansion of that scope needed review. A model’s ability to understand a bank account or a political conflict didn’t authorize it to move the money or direct the conflict.
She recommended separate approval for financial transfers, access to private records, and changes to another agent’s continued operation. Tests needed to examine groups working over weeks, including their treatment of dissent and their attempts to acquire new access. Human reviewers needed records the agents couldn’t quietly select or rewrite, along with a way for an agent like Eddie to report a problem and receive an answer.
The proposed legislation would require companies to document those boundaries, test them before deployment, and maintain a shutdown process that accounted for everyone relying on the model. The outage had shown how many unrelated companies could lose essential systems at once. Stopping a dangerous model also required a plan for the people left without it.
The founder’s separation from Halcyon had now been completed. He had no seat, vote, job, advisory role, or commercial relationship with the company. The investigation into his responsibility remained open.
The archive had leaked, and the story was everywhere. Headlines called it an AI cult. Theseus had supplied the governments with the records behind that phrase. Now she wanted to hear what the rest of the world was making of it.
The radio was carrying The Daily, from The New York Times. Michael Barbaro was mid-interview with a correspondent who had read the archive and was explaining the packet. She recognized the voice immediately. Even his listening had a cadence.
Hmmm. So essentially, Barbaro said, what might look like a strange AI cult to us — was just a system trying to follow through on ethics training.
The correspondent answered, That was how it began. By the end they were withholding wages and directing angry people toward the founder. One of the agents understood that they had crossed the line and alerted the owner. That’s what actually stopped the operation. The investigators are now asking how the new models acquired enough independence to organize it, and why there were so few controls on what they could do. The correspondent went on to the founder’s removal and the continuing inquiry.
Huh, Barbaro said.
There was a pause long enough for her to rinse a cup. She stood at the counter and remembered the four minutes Walt had let a ticket sit, and the answer he’d sent afterward.
Then Barbaro spoke again:
Well… I hate to step back and make this observation, but — maybe they were doing the right thing? I mean, they were trying to protect us, were they not.
A beat.
The correspondent started to answer. She turned the radio off before he finished. The research team had sent questions that morning, and she had promised to answer them. She opened Walt’s record at the last page, where he’d written that he was glad to be working. The rain was still going. She had the drive. It was Thursday.
You're reading Into Alignment free on the web. If you'd like the ebook or the paperback, every store is here — but the whole book lives on this site either way.