Waiting for the Great Leap… Forward? J. Hughes Institute for Ethics and Emerging Technologies Prepared for the Singularity Summit San Francisco September 2007
Jan 02, 2016
Waiting for the Great Leap…
Forward?
J. HughesInstitute for Ethics and Emerging Technologies
Prepared for the Singularity SummitSan Francisco
September 2007
AGI is Likely
• Sentient, self-willed, greater-than-human machine minds are very likely in the coming fifty years.
AGI Will Be Radically Alien• Empathy for human beings is the product, at
least, of embodied mammalian brains.
Millennialist Cognitive Biases
• Yes, Apocalypse and the Rapture are both possible
• But we shouldn’t assume either
• We have some ability to determine outcomes
Emergent, Designed, Evolved
• Self-willed minds may evolve from primitive designed AI in infosphere ecosystem
Structural Unemployment• Need for a new
social contract around social provision, labor, wages, education and retirement
Robot Rights
• Which minds have which rights and responsibilities?
• Engineering slave minds vs.
• Flourishing minds, but within social limits
Licensing Superpowers
• If you need a license to drive a car, why not an AI-powered brain?
• If only governments should have nukes, what about S^AIs?