OpenAI
Founded | December 11, 2015 |
---|---|
Founders | Elon Musk, Sam Altman, and others |
Location |
|
Products | OpenAI Gym |
Key people | Ilya Sutskever, Ian Goodfellow, Greg Brockman |
Endowment | $1 billion pledged (2015) |
Mission | Friendly artificial intelligence |
Website |
www |
OpenAI is a non-profit artificial intelligence (AI) research company, associated with business magnate Elon Musk, that aims to carefully promote and develop friendly AI in such a way as to benefit, rather than harm, humanity as a whole. The organization aims to "freely collaborate" with other institutions[2] and researchers by making its patents and research open to the public.[3] The company is supported by over US$1 billion in commitments; however, only a tiny fraction of the $1 billion pledged is expected to be spent in the first few years.[4] The founders are motivated in part by concerns about existential risk from artificial general intelligence.[3][5]
Motives
Some scientists, such as Stephen Hawking and Stuart Russell, believe that if advanced AI someday gains the ability to re-design itself at an ever-increasing rate, an unstoppable "intelligence explosion" could lead to human extinction. Elon Musk characterizes AI as humanity's biggest existential threat. OpenAI's founders structured it as a non-profit free of financial stockholder obligations, so that they could focus its research on creating a positive long-term human impact.[4]
OpenAI states that "it's hard to fathom how much human-level AI could benefit society," and that it's equally difficult to comprehend "how much it could damage society if built or used incorrectly".[4] Research on safety cannot safely be postponed: "because of AI's surprising history, it's hard to predict when human-level AI might come within reach."[6] OpenAI states that AI "should be an extension of individual human wills and, in the spirit of liberty, as broadly and evenly distributed as possible..."[4] Co-chair Sam Altman expects the decades-long project to surpass human intelligence.[7]
Vishal Sikka, the CEO of Infosys, stated that an "openness" where the endeavor would "produce results generally in the greater interest of humanity" was a fundamental requirement for his support, and that OpenAI "aligns very nicely with our long-held values" and their "endeavor to do purposeful work".[8] Cade Metz of Wired suggests that corporations such as Amazon may be motivated by a desire to use open-source software and data to level the playing field against corporations like Google and Facebook that own enormous supplies of proprietary data. Altman states that Y Combinator companies will share their data with OpenAI.[7]
Strategy
Musk poses the question: "what is the best thing we can do to ensure the future is good? We could sit on the sidelines or we can encourage regulatory oversight, or we could participate with the right structure with people who care deeply about developing AI in a way that is safe and is beneficial to humanity." Musk acknowledges that "there is always some risk that in actually trying to advance (friendly) AI we may create the thing we are concerned about"; nonetheless, the best defense is "to empower as many people as possible to have AI. If everyone has AI powers, then there's not any one person or a small set of individuals who can have AI superpower."[9]
Musk and Altman's counter-intuitive strategy of trying to reduce the risk that AI will cause overall harm, by giving AI to everyone, is controversial within the community of people like Musk who are concerned with existential risk from artificial intelligence. Philosopher Nick Bostrom is skeptical of Musk's approach: "If you have a button that could do bad things to the world, you don't want to give it to everyone."[5] During a 2016 conversation about the technological singularity, Altman said that "we don’t plan to release all of our source code" and mentioned a plan to "allow wide swaths of the world to elect representatives to a new governance board". Greg Brockman stated that "Our goal right now... is to do the best thing there is to do. It’s a little vague."[10]
OpenAI Gym
On April 27, 2016, OpenAI released a public beta of "OpenAI Gym", a platform for reinforcement learning research that aims to provide an easy-to-setup general-intelligence benchmark with a wide variety of different environments (somewhat akin to, but broader than, the ImageNet Large Scale Visual Recognition Challenge used in supervised learning research), and that hopes to standardize the way in which environments are defined in AI research publications, so that published research becomes more easily reproducible.[11][12]
Participants
The two co-chairs of the project are:[13]
- Tesla Motors founder Elon Musk, whose 2015 assets are estimated at $13 billion[14]
- Sam Altman, president of the startup accelerator Y Combinator
Other backers of the project include:[9]
- LinkedIn co-founder Reid Hoffman, whose 2015 assets are estimated at $4 billion[14]
- PayPal co-founder Peter Thiel, whose 2015 assets are estimated at $3 billion[14]
- Greg Brockman, former chief technology officer at Stripe
- Jessica Livingston, a founding partner of the startup accelerator Y Combinator
- Amazon Web Services, Amazon’s cloud-services subsidiary
- Infosys, an Indian IT consulting firm
High-profile staff include:
- Research director: Ilya Sutskever, a former Google expert on machine learning[9]
- CTO: Greg Brockman[9]
The group started in early January 2016 with nine researchers. According to Wired, Brockman met with Yoshua Bengio, one of the "founding fathers" of the deep learning movement, and drew up a list of the "best researchers in the field". Microsoft's Peter Lee has stated that the cost of a top AI researcher exceeds the cost of a top NFL quarterback prospect. While OpenAI pays corporate-level (rather than nonprofit-level) salaries, it doesn't currently pay AI researchers the same salaries as those same researchers can make at Facebook or Google. Nevertheless, Sutskever stated that he was willing to leave Google for OpenAI "partly of because of the very strong group of people and, to a very large extent, because of its mission." Brockman stated that "the best thing that I could imagine doing was moving humanity closer to building real AI in a safe way." OpenAI researcher Wojciech Zaremba stated that he turned down "borderline crazy" offers of two to three times his market value to join OpenAI instead.[5]
See also
- Machine Intelligence Research Institute
- Future of Humanity Institute
- Future of Life Institute
- OpenCog
- Vicarious
References
- ↑ Markoff, John (December 11, 2015). "Artificial-Intelligence Research Center Is Founded by Silicon Valley Investors". The New York Times. Retrieved December 12, 2015.
- ↑ Gershgorn, Dave (December 11, 2015). "New 'OpenAI' Artificial Intelligence Group Formed By Elon Musk, Peter Thiel, And More". Popular Science. Retrieved December 12, 2015.
- 1 2 Lewontin, Max (14 December 2015). "Open AI: Effort to democratize artificial intelligence research?". The Christian Science Monitor. Retrieved 19 December 2015.
- 1 2 3 4 "Tech giants pledge $1bn for 'altruistic AI' venture, OpenAI". BBC News. 12 December 2015. Retrieved 19 December 2015.
- 1 2 3 Cade Metz (27 April 2016). "Inside OpenAI, Elon Musk's Wild Plan to Set Artificial Intelligence Free". Wired magazine. Retrieved 28 April 2016.
- ↑ Mendoza, Jessica. "Tech leaders launch nonprofit to save the world from killer robots". The Christian Science Monitor.
- 1 2 Metz, Cade (15 December 2015). "Elon Musk's Billion-Dollar AI Plan Is About Far More Than Saving the World". Wired. Retrieved 19 December 2015.
Altman said they expect this decades-long project to surpass human intelligence.
- ↑ Vishal Sikka (14 December 2015). "OpenAI: AI for All". InfyTalk. Infosys. Retrieved 22 December 2015.
- 1 2 3 4 "Silicon Valley investors to bankroll artificial-intelligence center". The Seattle Times. 13 December 2015. Retrieved 19 December 2015.
- ↑ "Sam Altman's Manifest Destiny". The New Yorker (10 October 2016). Retrieved 4 October 2016.
- ↑ Dave Gershgorn (27 April 2016). "Elon Musk's Artificial Intelligence Group Opens A 'Gym' To Train A.I.". Popular Science. Retrieved 29 April 2016.
- ↑ Greg Brockman; John Schulman (27 April 2016). "OpenAI Gym Beta". OpenAI Blog. OpenAI. Retrieved 29 April 2016.
- ↑ Kraft, Amy (14 December 2015). "Elon Musk invests in $1B effort to thwart the dangers of AI". CBS News. Retrieved 19 December 2015.
- 1 2 3 Liedtke, Michael. "Elon Musk, Peter Thiel, Reid Hoffman, others back $1 billion OpenAI research center". San Jose Mercury News. Retrieved 19 December 2015.