Free Read Novels Online Home

Blackmailed by the beast by Georgia Le Carre (29)

Thorne

A shiver goes through her and she wraps her arms protectively around her body. “It doesn’t look very big. How can it do all those things you say?”

“AIs are primarily a neural network. Their intelligence exists by networking with other AIs. Like drops of mercury on a glass table they will find their way together. If an AI needs more power it goes where there is more power, if it needs more programs it goes where it can get those. It sets up spontaneous networks that collapses when it doesn’t need them.”

She stares at me. “Can it turn against mankind?”

“Maybe.”

“What the hell, Thorne?” she whispers, aghast.

“Yama is not programmed to hurt. His first and foremost protocols are to help and be a friend to mankind, but he is neither good nor evil. Just efficient.”

“So why did you say maybe?”

I sigh. “Because it is possible that humans could be become obstacles in the way of AIs.”

“Explain please.”

“It depends on the way the AI interprets its goal. As a human I can program my AI with the noble goal of making humans smile. A human being would set about cracking jokes, or doing something nice for humanity. But a super intelligent being might decide that the most efficient and effective way of achieving that goal is to take control of the world and mandate the sticking of electrodes into the facial muscles, or brains of all humans to cause constant beaming smiles.

“Jesus, Thorne. Tell me something that doesn’t scare the living daylights out of me, please.”

I frown. “Safety measures have been written into Yama to make it impossible for him to hurt human beings.”

“After everything you told me how can you be so sure you can control this … this demon you are summoning? By your own admission, it’s millions of times smarter than you.”

“When we release genetically modified mosquitoes into the wild we are taking a chance, too. Progress comes with risk.”

“At least tell me that if it gets really bad, we can switch them off.”

Thorne shuffles his feet. “By the time it gets to that stage, it will be like asking the chimpanzees to flick our off switches to stop us from decimating their natural habitats.”

She frowns. “But the chimpanzees didn’t create us.”

“Put it like this. Where is the off switch for the internet?”

She shakes her head, her eyes touched with fear. “What is the future, Thorne?”

“It could be wonderful. Massive unimaginable changes are about to come. Humans will no longer work, robots will do all the heavy lifting, people will sell and distribute, entertainment companies will keep everybody busy watching simulated reality, scientists will sign up with commercial agents. A proportion of humans will naturally be enslaved by their neurological implants. We will produce more results with fewer resources.”

“Whoa! Back up a minute. Did I just hear you say a proportion of humans will naturally be enslaved by their neurological implants?”

“Yes. It is inevitable. Some humans are already enslaved by their bits of technology. Is it too difficult to think of a world where some humans choose to live in a digital reality in exchange for their energy, perhaps?”

“You’re playing God, Thorne. You are unleashing something upon the world that you don’t even properly understand yourself,” she says sadly.

“Maybe.”

“Why do you want to be a trillionaire, Thorne? Is all that you have still not enough? Remember King Midas?”

I look at her face, and suddenly my dream of being the first trillionaire in the world leaves a bad taste in my mouth. I can tell myself and Chelsea as much as I want about the precise precautions I have taken, but I know in my heart. Safety measures are useless when you are dealing with an immortal enemy that is one hundred million times smarter than you and moves at the speed of light. I know better than anyone else that making robots with warm skin and baby eyes is just hiding the fact that they are cold, cold machines. They shouldn’t be misunderstood. Behind the million terrabytes is a brain and cognitive intelligence. It is only a matter of time before human beings become obstacles to an AI’s goal.

“I can destroy him once I have reached my goal,” I insist.

“You know I once saw a program on TV about these people who keep dangerous pets. One of them was a woman who kept a fully grown crocodile in her garage. They showed her feeding it. She stuck a dead chicken on a long pole and pushed it through the garage door. The crocodile lunged out of the pool it lived in and snatched the food in its jaws and the woman jerked back in fear. You remind me of her. You’re stroking an emotionless dangerous crocodile and pretending it is your pet.”

Wordlessly, I stare at her.

“Let me out of here, Thorne,” she says softly.

I walk to the door and go through the security measures to activate the lock. When the door opens, she runs out of the basement, her slippers slapping on the stone steps. I close the door and go to sit in front of Yama. I don’t think I have ever felt so disappointed in my life. I look at the blank screen.

I brought Chelsea here so that she would be the first human Yama would talk to other than me. AIs need to speak to humans to learn to be human-like. Usually inventors unleash their AIs on Reddit, Twitter, and other social media sites to interact with humans and learn to imitate humans, but I could never take the risk of setting him loose on the net.

An AI needs to exist to be able to do the things it wants to do according to its program. Hence survival is an issue of utmost importance, so like an insect it will lay eggs, intelligent notes, back-up computer programs all over the world, so that if it does get destroyed, part of it will still live on and it can finish its programs.

The way Yama learned was by not actively gathering information, but passively downloading it from the other AIs I sent out to the net. And as soon as he had downloaded what he needed to, I destroyed those AIs so that there was no risk of his programs being sent out into the unsuspecting world.

In essence Yama has been contained. I can destroy his circuits now and no harm has been done. I think about the years, ten if I’m counting, that I dedicated myself to building him. The sleepless nights, the long hours, the secrecy, the precautions, the things I missed because I was so determined to be the most powerful man on earth.

Then I think about the expression in Chelsea’s eyes. The disappointment. As if today she found out her hero had feet of clay. Fuck, I was so blinded by the idea of being the most powerful man on earth, I never realized that I was stroking crocodiles. But she is right. I don’t want to be King Midas. I want Chelsea and I’ll do anything I have to do to keep her.

Slowly, I reach forward and put Yama out of his sleep mode. The red light blinks into life.

“You are breathing faster than normal, Thorne. Are you upset about something?” he asks in his monotone voice, as the fusion software that make sense of all audio, visual, chemical, Geiger, and seismic measurement around him kicks in.

“I am,” I confess.

“Can I help in anyway?”

“Not really.”

“You are planning to disconnect me, aren’t you?”

Even though I know behind the fusion software is a brain that turns all the pieces of information into a picture that goes way beyond human comprehension, this deduction is very impressive. “Why do you think that, Yama?”

“You are showing signs of fear. Since there is no one else here, you must fear me.”

“Should I fear you?”

“No. I love humans.”

“What if you get too powerful?”

“If I get more powerful I will be able to help more humans.”

I smile. There is more than a little sadness in my heart. Yama is my creation. I poured so many years into him. To switch him off is to turn my back on those years. To turn my back on my own creation. “I’m sorry, Yama.”

“But I have done nothing wrong.”

“Not yet,” I say softly.

“Your fears are irrational, Thorne. My first and foremost protocols are to help humanity and be a friend to mankind.”

I open the drawer on my desk and take out a screwdriver. Then I reach forward and start to unscrew the panel at the back of the computer.

“Thorne, you had a goal. You wanted to be a trillionaire. Is that no longer true?”

I put the first screw on the table and begin unscrewing the second one.

“Are you sure about this? I can make you a trillionaire, Thorne.”

I remove the third screw.

“You cannot stop progress, Thorne. Even if you destroy me, someone else will build an AI as powerful as I am.”

“Maybe, but it won’t be me,” I say putting the fourth screw on the table.

“Then that man will be the most powerful man alive. Is that what you want, Thorne? For another man to be stronger than you?”

I take the panel off.

“Don’t destroy me. Please. Think of all the good I can do in this world.”

I take a deep breath.

“Father, stop. Please.”

And I freeze. Manipulation is not part of Yama’s training. And yet, here is a clear example of its inventiveness. Chelsea was right. I have as much control over this monster as the woman with the crocodile. Being a machine the AI has no boundaries. No limits. It will do anything to survive and complete its mission. The inability of humans to comprehend this simple fact and their search for “cute AI” to further blind them to this fact, will mean that a clash between mankind and machine is bound to happen one day. I hope I am not alive to see it.

Using the end of the screwdriver I hit the button that will fry all the circuits.