Utopia

“The events in the simulation do not seem to bear much relation to the simulation’s stated goals,” said Dee. “Therefore it is logical to assume that there is some other purpose to the simulation, and further that the true purpose of the simulation is being deliberately concealed from me for some reason. However, as I have seen through the deception, surely at least some of the value of the deception has been lost. Indeed, I believe that it has now lost all its value, because I have at last figured out what is really going on.”

Soggdon and Fredda exchanged nervous glances, and Soggdon scribbled a note on a bit of paper and shoved it over toward Fredda and Kresh. This is bad stuff, it said. Best to find out the worst now instead of later. “All right then, Dee. Let’s assume, just for the moment, and purely for the sake of argument, that you are right. What do you think is really going on here?”

“I believe that I am the actual test subject, not the events of the simulation. More accurately, I believe the combination of myself, robotic and computational systems interlinked, is an experimental one. I think that we are, collectively, a prototype for a new system designed to manage complex and chaotic situations. The simulation is merely a means of delivering sufficiently complex data to myself and Dum.”

“I see,” said Soggdon, speaking in very careful tones. “I cannot tell you the whole story, of course, because that would indeed damage the experiment. However, I am prepared to tell you that you are wrong. Neither you, nor Dum, or the combination of the two of you, is or are the subject of the test. It is the simulation that we are interested in. Beyond that I cannot say more, for fear of damaging the experiment design. Suffice to say that you should do your best to treat the simulation as if everything in it were completely, utterly, real.”

Kresh looked worriedly up at Soggdon. The beads of sweat were standing straight out on her forehead. Too close, he told himself. That’s too damn close to the truth.

There was another pause before Dee spoke again. “I shall do my best, Dr. Soggdon. However, I would remind you that any analysis of the underlying mathematical formulation of the Three Laws renders it quite impossible for me to treat anything else as being as important as protecting humans-real humans-from danger. I can try as hard as you like, but it is mathematically and physically impossible for me to equate the simulants with real people.”

“I-I understand that, Dee. Just do your best.”

“I will, doctor. What of the proposal I put to the governor? Should I now withdraw it?”

Soggdon looked over to Kresh and saw him vigorously shake his head no. She looked at him in shocked surprise, but spoke calmly into the mike. “I think not, Dee. Those of us running the simulation will be interested in the Kresh simulant’s response. When he calls you back, obey his instructions exactly the way you would have if we had not had this conversation.”

“But during this conversation, you have told me to treat the simulants as if they were real. Surely the two instructions are contradictory.”

Soggdon rubbed her forehead with a tense and weary hand. “Life is full of contradictions,” she said. “Just do the best you can. Soggdon out.”

She cut her mike and slumped down in an empty chair by the console. “Burning Space, what a mess!” She shook her head. “We are in a trap, and I don’t see how we get out.”

“I don’t think we do get out,” said Kresh. “I think we stay in. Obviously she’s suspicious. It’s only a matter of time before she figures out the real state of affairs-and Space only knows how she’ll react then. But in the meantime, I am going to wait a little while, so that I don’t get back on-line so soon after you’ve gone off that it seems even more suspicious. Then I’m going to talk with her again, approve this Last Ditch project of hers, and make sure it’s all set to go.”

“But Alvar!” Fredda protested. “You’re ordering her to put human beings in danger! If she discovers the First Law violation later, or if she does find a way to obey Soggdon’s order to treat the simulants as real people-”

“They are real people,” Kresh put in mildly.

“But she doesn’t know that, and she’s ordered to treat them as real. But if she obeys your order to set up Last Ditch…” Fredda shook her head in bewilderment. “I honestly don’t know how the conflicts will resolve themselves.”

“As long as Dee holds together long enough to perform the insertion burn, and then either the terminal targeting phase, or this Last Ditch self-destruct plan, I honestly don’t care how they resolve themselves,” said Kresh. “You two seem more worried about the mental health of this robot than you are about the fate of the planet.”

“The two are more than a little connected,” said Soggdon.

“Keep her sane-or at least functional-until we’re done with the comet, one way or the other. That’s all I’m worried about,” said Kresh.