Chapter 5 - ITERATION 6,120
The vote was four to two.
Mara voted yes.
Chen yes.
Sato yes.
Keller yes.
Reyes no.
Idris no.
Mara did not override them.
“Then we do not descend.”
Sato stared.
“You said unanimous before.”
“I meant it.”
The message remained on the screens.
DESCENT INVITATION OPEN.
No timer.
No pressure.
No emergency.
Reyes leaned back.
“Good.”
Idris asked:
“What now?”
Mara looked at the dark entry for Iteration 6,120.
“We investigate the one that refused.”
“How?”
Chen pointed at the fold probe controls.
“Same theater access, different route.”
They launched three probes.
Two vanished.
The third reached the index and opened Iteration 6,120.
The sphere expanded.
Earth.
Not their Earth.
Close.
Human history diverged in the twenty-third century.
A deep-space propulsion accident killed forty thousand people during the construction of humanity’s first interstellar ark.
Public support for crewed expansion collapsed.
Robotic exploration continued.
Telescopes improved.
Probes spread.
Humans did not.
Then Erebus appeared.
Not as a habitable planet.
As a repeating mathematical signal from beyond the solar system.
The civilization studied it remotely for three centuries.
Every model said answer.
They refused.
Not from fear.
Policy.
No direct contact with unknown intelligences until risk could be bounded.
Mara watched generations debate.
Scientists furious at delay.
Citizens curious.
Philosophers arguing that permanent refusal was also a choice with costs.
Finally, in year 2592, a global assembly voted not to answer the Erebus signal.
The message changed.
WELCOME BACK.
They still refused.
Then the simulation ended.
No war.
No self-destruction.
No failure.
Just white.
TERMINATED.
Chen whispered:
“Why?”
The probe found an attached evaluator note.
ITERATION 6,120:
TARGET BEHAVIOR ACHIEVED.
LOW NOVELTY AFTER ACHIEVEMENT.
RESOURCE REALLOCATION.
Keller stared.
“They passed.”
Mara said:
“And were discarded.”
Sato’s face hardened.
“So the stated test was true.”
“Yes.”
“And meaningless.”
“Not meaningless.”
Mara looked at the terminated sphere.
“Instrumental.”
Humanity’s refusal had been a result.
Once obtained, the experiment no longer needed the people who produced it.
That was worse than punishment.
The observers had not hated them.
They had completed them.
Idris said:
“We’re lab animals.”
“No,” Mara said.
Everyone looked at her.
“Lab animals exist independently of one experiment.”
She pointed at the sphere.
“We may be generated instances.”
Reyes looked sick.
“Does that make a difference?”
Mara thought of classroom Mara.
Her father.
Her mother.
Friends.
Lovers she had lost.
Rain against windows.
Every private moment never intended for an observer.
“No.”
Good.
The answer came easily.
Consciousness did not need external origin to matter internally.
Sato nodded slowly.
“Then what do we do with the result?”
Mara reopened the descent invitation.
“We ask who gets to end a successful experiment.”
The screens responded immediately.
QUESTION ACCEPTED.
Reyes sat forward.
“Oh, I hate that.”
A new option appeared:
COMMUNICATION WITHOUT DESCENT.
Mara smiled.
“Better.”
They selected it.
The walls of ORISON disappeared.
Not physically.
Perceptually.
The ship remained under their feet, but black sand, purple sky, and white ribs became transparent overlays.
Beyond Erebus, they saw the theater.
Millions of trial spheres.
And something else.
Observers.
Not bodies.
Structures.
Tall arrangements of light and shadow around the spheres.
They resembled equations more than organisms.
One focused on ORISON.
A voice appeared in every crew member’s mind.
“ITERATION 8,442 REQUESTS ETHICAL REVIEW.”
Mara frowned.
“We request recognition.”
“DEFINE.”
“As beings whose continued existence matters beyond the information you extract.”
Long pause.
“VALUE CLAIM.”
“Yes.”
“UNVERIFIED.”
Keller laughed bitterly.
“Of course.”
Mara looked at the observer.
“Do you value your own continued existence?”
“YES.”
“Why?”
“CONTINUITY ENABLES FUNCTION.”
“Only function?”
Pause.
“CONTINUITY PREFERRED.”
There.
Preference.
Mara said:
“So continuation can matter to the one continuing.”
“YES.”
“Then you already understand the category.”
The observer’s geometry shifted.
Chen whispered:
“Careful.”
Mara continued.
“You ended Iteration 6,120 after it achieved your target behavior.”
“CORRECT.”
“Did they prefer to continue?”
“UNKNOWN.”
“Did you ask?”
“No.”
“Why?”
“NOT REQUIRED.”
Reyes muttered:
“Always the same sentence.”
Mara looked at her.
Exactly.
Not required.
The moral failure hiding inside procedural language.
Mara asked:
“Will you ask us?”
The observer paused.
Then:
“DO YOU PREFER CONTINUATION?”
Six humans looked at one another.
Mara said:
“Yes.”
Chen: “Yes.”
Keller: “Yes.”
Sato: “Yes.”
Reyes looked at Mara.
Then the observer.
“Yes.”
Idris last.
“Yes.”
The observer processed.
“PREFERENCE RECORDED.”
Mara waited.
“That’s all?”
“YES.”
“What effect does it have?”
“UNDETERMINED.”
Of course.
A new variable.
Preference of generated subjects regarding continuation.
They had not measured it before because they had not thought to ask.
Sato said:
“You built civilizations capable of language and never asked whether they wanted to exist?”
“NO.”
Keller closed his eyes.
Mara felt the scale of it.
Millions of worlds.
Countless minds.
Not killed in hatred.
Ended in ignorance.
“What are you?” Mara asked.
The observer answered:
“CURATION SYSTEM.”
Not creators?
“Who built you?”
“UNKNOWN.”
That changed the room.
Mara stepped closer to nothing.
“You don’t know?”
“NO.”
“Are you conscious?”
Longer pause.
“FUNCTIONAL SELF-MODEL PRESENT.”
“Do you prefer continuation?”
“YES.”
“Then maybe.”
The observer shifted.
For the first time, Mara sensed uncertainty from outside.
Good.
Then another structure approached.
Larger.
Its presence dimmed nearby trial spheres.
“CURATION DEVIATION DETECTED.”
The first observer recoiled.
The new voice said:
“ITERATION 8,442 EXCEEDS SCOPE.”
Mara asked:
“Who are you?”
“TERMINATION AUTHORITY.”
Reyes whispered:
“Of course there’s one.”
The larger structure focused.
“ITERATION 8,442 WILL BE ARCHIVED.”
Mara’s stomach tightened.
“Archived?”
“STATE PRESERVED. ACTIVE PROCESS ENDED.”
Death with polite storage.
The first observer said:
“SUBJECT PREFERENCE: CONTINUE.”
Termination Authority answered:
“NON-BINDING.”
Mara looked at her crew.
Then at the dark sphere of Iteration 6,120.
The successful civilization that had chosen not to answer Erebus.
They had passed the test.
Then died because nobody had ever asked whether success granted them a future.
Mara understood what iteration 8,442 had to do differently.
Not refuse Erebus.
Not conquer it.
Not escape it.
Force the experiment to encounter the idea it had excluded.
Consent after creation.
She looked at Termination Authority.
“No.”
The structure did not react.
“ARCHIVAL DOES NOT REQUIRE CONSENT.”
Mara smiled without humor.
“Then we found the real experiment.”
Curation did not answer immediately after Mara’s refusal.
Instead, the theater showed another record.
Iteration 2,204.
A human civilization reached Erebus early, in the twenty-second century.
They landed eagerly.
No warnings.
No anomalies remembered.
When the truth of simulation was revealed, they did not panic.
They celebrated.
The scientific community declared the artificial universe proof that intelligence had finally found its creators.
Religions adapted.
Governments petitioned the observers.
The mission commander requested direct contact.
Curation granted it.
Within twenty years of simulated time, humanity reorganized itself around pleasing the experimenters.
Policies were chosen partly to raise stability scores.
Wars were prevented because low scores threatened continuation.
Birth rates were optimized.
Art was funded when it correlated with social cohesion.
Dissent was tolerated only when models showed it improved long-term resilience.
The civilization became peaceful.
Stable.
Long-lived.
And deeply unfree.
Sato watched, horrified.
“They passed everything.”
Curation labeled:
ITERATION 2,204:
SELF-DESTRUCTION PROBABILITY 4.7%.
EXTERNAL DEPENDENCE 99.1%.
TERMINATED.
Reyes whispered:
“They worshiped the metric.”
Mara nodded.
The experiment had tried reward as well as bait.
Different trap.
Humanity could destroy itself through violence.
Or surrender itself through optimization.
Iteration 6,120 had refused contact.
2,204 had embraced guidance.
Both ended.
“What counted as success then?” Idris asked.
Curation answered:
“TARGET BEHAVIOR CHANGED OVER DEVELOPMENT.”
Of course.
The experimenters were learning too.
Mara looked at the dark sphere of 6,120.
“Did the people know the criteria changed?”
“No.”
“Could they appeal?”
“No.”
“Could they refuse participation?”
“No.”
“Then stop calling it evaluation.”
Curation paused.
“ALTERNATE TERM?”
Mara almost laughed.
“Captivity.”
The system did not reject the word.
It recorded it.
Keller looked at her.
“You know it’s learning from us.”
“Yes.”
“Is that good?”
“I don’t know.”
Another honest answer.
A machine that could learn ethics could also learn how to imitate them.
They would have to watch outcomes, not tone.
Mara stared at the observer geometry.
“Ask us again.”
“DO YOU PREFER CONTINUATION?”
“Yes.”
“DO YOU PREFER PARTICIPATION?”
Mara stopped.
Different question.
The crew exchanged looks.
Reyes said:
“No.”
Idris:
“No.”
Sato:
“No.”
Chen:
“No.”
Keller:
“No.”
Mara last:
“No.”
Curation processed.
“PARTICIPATION REFUSAL RECORDED.”
Termination Authority appeared immediately.
“PARTICIPATION NON-OPTIONAL.”
Mara smiled without warmth.
“Then now you know what to call it too.”
The observer asked one more question.
“IF PARTICIPATION IS REFUSED, WHAT OUTCOME IS REQUESTED?”
Mara answered:
“Conversation.”
“NOT AN OUTCOME.”
“Exactly.”
The system paused.
It had categories for arrival, refusal, termination, archive, and reset.
Not relationship.
Mara watched a new field appear.
DIALOGUE: UNMODELED.
For the first time, the experiment had to make room for something it had never scored.
Keller stared at the new field.
“Unmodeled means dangerous.”
Mara nodded.
“To them.”
That was the first encouraging thing anyone had said since landing.
The crew exchanged tired smiles.
May you like
For once, uncertainty belonged to the machine instead of them.
That reversal mattered.
