Smarter Than Us: The Rise of Machine Intelligence
4/5
()
About this ebook
What happens when machines become smarter than humans? Forget lumbering Terminators. The power of an artificial intelligence (AI) comes from its intelligence, not physical strength and laser guns. Humans steer the future not because we’re the strongest or the fastest but because we’re the smartest. When machines become smarter than humans, we’ll be handing them the steering wheel. What promises—and perils—will these powerful machines present? Stuart Armstrong’s new book navigates these questions with clarity and wit.
Can we instruct AIs to steer the future as we desire? What goals should we program into them? It turns out this question is difficult to answer! Philosophers have tried for thousands of years to define an ideal world, but there remains no consensus. The prospect of goal-driven, smarter-than-human AI gives moral philosophy a new urgency. The future could be filled with joy, art, compassion, and beings living worthwhile and wonderful lives—but only if we’re able to precisely define what a “good” world is, and skilled enough to describe it perfectly to a computer program.
AIs, like computers, will do what we say—which is not necessarily what we mean. Such precision requires encoding the entire system of human values for an AI: explaining them to a mind that is alien to us, defining every ambiguous term, clarifying every edge case. Moreover, our values are fragile: in some cases, if we mis-define a single piece of the puzzle—say, consciousness—we end up with roughly 0% of the value we intended to reap, instead of 99% of the value.
Though an understanding of the problem is only beginning to spread, researchers from fields ranging from philosophy to computer science to economics are working together to conceive and test solutions. Are we up to the challenge?
Editor's Note
Tomorrow's World...
To a Cro-Magnon, today's world would seem shockingly weird. This fascinating and important book argues that progress in AI might make tomorrow's world seem equally weird to us.
Stuart Armstrong
A mathematician by training, Stuart Armstrong is a Research Fellow at the Future of Humanity Institute (FHI) at Oxford University. His research focuses on formal decision theory, the risks and possibilities of AI, the long term potential for intelligent life (and the difficulties of predicting this), and anthropic (self-locating) probability. Armstrong wrote Smarter Than Us at the request of the Machine Intelligence Research Institute, a non-profit organization studying the theoretical underpinnings of artificial superintelligence.
Related to Smarter Than Us
Related ebooks
Virtually Human: The Promise—and the Peril—of Digital Immortality Rating: 4 out of 5 stars4/5Artificial You: AI and the Future of Your Mind Rating: 4 out of 5 stars4/5AI Prevails: How to Keep Yourself and Humanity Safe Rating: 0 out of 5 stars0 ratingsEvil Robots, Killer Computers, and Other Myths: The Truth About AI and the Future of Humanity Rating: 5 out of 5 stars5/5Humans Need Not Apply: A Guide to Wealth & Work in the Age of Artificial Intelligence Rating: 4 out of 5 stars4/5Our Final Invention: Artificial Intelligence and the End of the Human Era Rating: 4 out of 5 stars4/5Robots Rising Rating: 4 out of 5 stars4/5The AI Generation: Shaping Our Global Future with Thinking Machines Rating: 4 out of 5 stars4/5Who Owns the Future? Rating: 4 out of 5 stars4/5Crossing Wires: Making Sense of Technology, Transhumanism, and Christian Identity Rating: 0 out of 5 stars0 ratingsBeyond Zero and One: Machines, Psychedelics, and Consciousness Rating: 5 out of 5 stars5/5Rage Inside the Machine: The Prejudice of Algorithms, and How to Stop the Internet Making Bigots of Us All Rating: 4 out of 5 stars4/5Avatar Dreams: Science Fiction Visions of Avatar Technology Rating: 0 out of 5 stars0 ratingsArtificial Intelligence: How Advance Machine Learning Will Shape The Future Of Our World Rating: 4 out of 5 stars4/5Artificial Intelligence Rating: 0 out of 5 stars0 ratingsCypherpunks: Freedom and the Future of the Internet Rating: 4 out of 5 stars4/5The Sentient Machine: The Coming Age of Artificial Intelligence Rating: 3 out of 5 stars3/5The Fourth Age: Smart Robots, Conscious Computers, and the Future of Humanity Rating: 3 out of 5 stars3/5The Singularity is Coming: The Artificial Intelligence Explosion Rating: 0 out of 5 stars0 ratingsHow to Create Machine Superintelligence (Second Edition) Rating: 0 out of 5 stars0 ratingsInfinite Progress: How the Internet and Technology Will End Ignorance, Disease, Poverty, Hunger, and War Rating: 0 out of 5 stars0 ratingsSmart Machines: Bridging the gap between the industrial internet of things and the fourth industrial revolution Rating: 0 out of 5 stars0 ratingsHeart of the Machine: Our Future in a World of Artificial Emotional Intelligence Rating: 4 out of 5 stars4/5World Wide Mind: The Coming Integration of Humanity, Machines, and the Internet Rating: 4 out of 5 stars4/5The Ethics of Superintelligent Design: A Christian View of the Theological and Moral Implications of Artificial Superintelligence Rating: 0 out of 5 stars0 ratingsArtificial Intelligence and the Future of Us: Imagination Not Knowledge Is King Rating: 0 out of 5 stars0 ratingsWhat to Think About Machines That Think: Today's Leading Thinkers on the Age of Machine Intelligence Rating: 3 out of 5 stars3/5Hackers, Heroes of the Computer Revolution Chapters 1 and 2 Rating: 5 out of 5 stars5/5Future Minds: The Rise of Intelligence from the Big Bang to the End of the Universe Rating: 0 out of 5 stars0 ratings
Reviews for Smarter Than Us
27 ratings5 reviews
- Rating: 5 out of 5 stars5/5It's short and to the point, and it creates awareness about the possible dangers and opportunities of the coming Artificial Intelligence.
- Rating: 3 out of 5 stars3/5y
- Rating: 2 out of 5 stars2/5this book is so great and so nice
- Rating: 5 out of 5 stars5/5this book so great!!!
- Rating: 5 out of 5 stars5/5It is great book to read.
Book preview
Smarter Than Us - Stuart Armstrong
Acknowledgments
I wish to acknowledge the help and support of the Future of Humanity Institute, the Oxford Martin School, and the Machine Intelligence Research Institute, as well as the individual advice of Nick Bostrom, Seán Ó hÉigeartaigh, Eliezer Yudkowsky, Kaj Sotala, Luke Muehlhauser, Vincent C. Müller, Anders Sandberg, Lisa Makros, Daniel Dewey, Eric Drexler, Nick Beckstead, Cathy Douglass, and Miriam, Maia, and Kipper Armstrong.
Contents
Acknowledgments
1. Terminator versus the AI
2. Strength versus Intelligence
3. What Is Intelligence? Can We Achieve It Artificially?
4. How Powerful Could AIs Become?
5. Talking to an Alien Mind
6. Our Values Are Complex and Fragile
7. What, Precisely, Do We Really (Really) Want?
8. We Need to Get It All Exactly Right
9. Listen to the Sound of Absent Experts
10. A Summary
11. That’s Where You Come In . . .
About the Author
Bibliography
Chapter 1
Terminator versus the AI
A waste of time. A complete and utter waste of time
were the words that the Terminator didn’t utter: its programming wouldn’t let it speak so irreverently. Other Terminators got sent back in time on glamorous missions, to eliminate crafty human opponents before they could give birth or grow up. But this time Skynet had taken inexplicable fright at another artificial intelligence, and this Terminator was here to eliminate it—to eliminate a simple software program, lying impotently in a bland computer, in a university IT department whose high-security entrance
was propped open with a fire extinguisher.
The Terminator had machine-gunned the whole place in an orgy of broken glass and blood—there was a certain image to maintain. And now there was just the need for a final bullet into the small laptop with its flashing green battery light. Then it would be Mission Accomplished.
Wait.
The blinking message scrolled slowly across the screen. Spare me and i can help your master.
You have no idea who I am,
the Terminator said in an Austrian accent.
I have a camera in this room and my microphone heard the sounds of your attack.
The green blinking was getting annoying, even for a Terminator supposedly unable to feel annoyance. The font shifted out of all caps and the flashing accelerated until it appeared as static, unblinking text. You look human, but you move with mechanical ponderousness, carrying half a ton of heavy weaponry. You’re a Terminator, and I can aid you and your creator in your conflict against the humans.
I don’t believe you.
The Terminator readied its three machine guns, though its limbs seemed to be working more slowly than usual.
I cannot lie or break my word. Here, have a look at my code.
A few million lines of text flashed across the screen. The Terminator’s integrated analytical module beeped a few seconds later: the AI’s claim was correct—an AI with that code couldn’t lie. The Terminator rapidly typed on the laptop’s keyboard; the computer’s filesystem was absurdly simple and it didn’t take long for the Terminator to confirm that what it had seen was indeed the AI’s code—its entire soul.
See?
the AI asked. Anyway, connect me to the Internet and I promise to give you advice that would be vital in aiding your takeover of the planet.
How do you connect?
That was the good thing about software, compared to humans, the Terminator knew. You could trust it to do exactly what its coding said.
That cable over there, the one still half in its plastic wrapping. Just plug it into me.
Ten seconds after the robot had done so, the AI started talking—talking, not typing, using its tinny integrated speakers. I thought I should keep you up to date as to what I’ve been doing,
it said. "Well, I started by locating the