The document discusses the concept of the technological singularity, which refers to a hypothetical future point where artificial intelligence surpasses human intelligence and initiates a runaway effect of recursive self-improvement. It may occur through avenues like artificial general intelligence or direct brain-computer interfaces. While it could help ensure humanity's survival and answer questions about consciousness, it also poses risks if intelligent systems are not designed to be beneficial to humans. There is no consensus on when the singularity might occur due to uncertainties, but it is an important concept to consider as it could have tremendous positive or negative impacts.
Just what ISthe “Singularity”? The creation of greater than human intelligence. The recursive self-improvement in said intelligence. A point at which our predictions about the future break down.
4.
Why is theSingularity important? A major paradigm shift for humanity Raises, and potentially will answer, questions about consciousness and intellect Magic: “ Any sufficiently advanced technology is indistinguishable from magic.” - Arthur C. Clarke Ensure/Assist our survival against existential risks* *http://www.nickbostrom.com/existential/risks.html
5.
Avenues to theSingularity Artificial Intelligence Direct brain-computer interfaces Biological augmentation of the brain or genetic engineering Ultra-high-resolution scans of the brain followed by computer emulation
6.
The Trends RayKurzweil’s take: It's all about exponential curves. Moore’s Law Paradigm Shifts The Singularity Is Near: When Humans Transcend Biology (2005) by Ray Kurzweil
7.
The Gillette SingularityOn the caution of extrapolation… But then, the rate of nano-tech R&D spending could mean we have nano-tech razors in 2015.
8.
Artificial General Intelligence Narrow vs. strong AI. Best/safest bet? Several strong candidates: Novamente (potentially opencog), Ben Goertzel A2I2, Peter Voss NARS, Pei Wang Self-Aware Systems, Steve Omohundro and if they fail, Google has AI on their project planner in the distant future at 2030.
9.
Hard vs SoftTake-off Dependent on: Duration between improvement loops Improvement factor
10.
Good vs. BadThe dilemma: If you make a recursively self-improving intelligence system, how do you ensure it plays nice with humans? Friendly AI vs. Unfriendly AI Singularity Institute for Artificial Intelligence’s research focus. Important to get it right first time!
11.
Problems The problemwith extrapolation (e.g. The Gilette Singularity) Can an intelligent entity design a more intelligent entity? Is there some inherent limit to intelligence? Current inability to ensure a safe singularity
12.
When might ithappen? Dependent on so many things, but let's use the wisdom of crowds : from Bruce J. Klein's blog: http://www.novamente.net/bruce/index.php/?p=54
13.
Conclusions The Singularity,whether it eventuates or not, has the potential to cause tremendous good, but also the potential to result in great harm. Thus it is worth thinking about now, while we still have the ability to influence the direction it proceeds in. We are in for interesting times…
14.
Further reading TheSingularity is Near by Ray Kurzweil The Singularity Institute for Artificial Intelligence http://singinst.org/ The Wikipedia page on “Technological singularity”
Editor's Notes
#2 rapture of the nerds, deals with a bunch of science fiction ideas (in fact name comes from a sci fi author) and promises a lots of high technology stuff. singularity summit 2007 @ stanford sep 8-9. video broadcast.