370
个编辑
更改
跳到导航
跳到搜索
第1,715行：
第1,715行： − + 第1,723行：
第1,723行： − + 第1,730行：
第1,730行： − AI和自动化潜在的负面影响在安德鲁杨2020年竞选美国总统的过程中体现出来。联合国 UNICRI AI和机器人中心主任伊拉克利·贝瑞德兹表示: ”我认为AI危害会体现在犯罪分子或大型恐怖组织利用AI破坏大型流程或通过数字战争造成损失，或者可能是机器人、无人机、AI以及其他可能非常危险的东西的结合。当然，其还有失业等风险。如果大量的人失去工作，而且没有解决方案，这将是极其危险的。致命的自主武器系统之类的东西应该得到合适的控制，否则就可能会被大量滥用。”+ − + − − − − − − 第1,750行：
第1,744行： − 物理学家斯蒂芬 · 霍金、微软创始人比尔 · 盖茨和 SpaceX 公司创始人埃隆 · 马斯克对AI进化到人类无法控制的程度表示担忧，霍金认为这可能“会导致人类末日”。+ − − − 第1,765行：
第1,756行： − 在《超级智能》一书中，哲学家尼克 · 博斯特罗姆提出了一个AI将对人类构成威胁的论点。他认为，如果足够智能的AI选择有目标地行动，它将表现出收敛的行为，如获取资源或保护自己不被关机。如果这个AI的目标没有人性，比如一个AI被告知要尽可能多地计算圆周率的位数，那么它可能会伤害人类，以便获得更多的资源或者防止自身被关闭，最终更好地实现目标。博斯特罗姆还强调了向高级AI充分传达人类价值观存在的困难。他假设了一个例子来说明一种南辕北辙的尝试: 给AI一个让人类微笑的目标。博斯特罗姆认为，如果这种情况下的AI变得非常聪明，它可能会采用大多数人类都会感到恐怖的方法，比如“在人类面部肌肉中插入电极，使其产生持续的笑容” ，因为这将是实现让人类微笑的目标的有效方法。AI研究人员斯图亚特.J.罗素在他的《人类相容》一书中回应了博斯特罗姆的一些担忧，同时也提出了一种开发可证明有益的机器可能涉及逆强化学习的方法，这种机器侧重解决不确定性和顺从人类的问题。+ − + − Concern over risk from artificial intelligence has led to some high-profile donations and investments. A group of prominent tech titans including Peter Thiel, Amazon Web Services and Musk have committed $1 billion to OpenAI, a nonprofit company aimed at championing responsible AI development. The opinion of experts within the field of artificial intelligence is mixed, with sizable fractions both concerned and unconcerned by risk from eventual superhumanly-capable AI.<ref>{{cite journal − 其他技术行业的领导者相信AI在目前的形式下是有益的，并将继续帮助人类。甲骨文首席执行官马克 · 赫德表示，AI“实际上将创造更多的就业机会，而不是减少就业机会” ，因为管理AI系统需要人力。Facebook 首席执行官马克 · 扎克伯格相信AI将“解锁大量正面的东西” ，比如治愈疾病和提高自动驾驶汽车的安全性。2015年1月，马斯克向未来生命研究所捐赠了1000万美元，用于研究AI决策。该研究所的目标是“用智能管理”日益增长的技术力量。马斯克还为 DeepMind 和 Vicarious 等开发AI的公司提供资金，以“跟进AI的发展”因为认为这个领域“可能会产生危险的后果”。 − }}</ref> Other technology industry leaders believe that artificial intelligence is helpful in its current form and will continue to assist humans. Oracle CEO [[Mark Hurd]] has stated that AI "will actually create more jobs, not less jobs" as humans will be needed to manage AI systems.<ref>{{Cite web|url=https://searcherp.techtarget.com/news/252460208/Oracle-CEO-Mark-Hurd-sees-no-reason-to-fear-ERP-AI|title=Oracle CEO Mark Hurd sees no reason to fear ERP AI|website=SearchERP|language=en|access-date=2019-05-06}}</ref> Facebook CEO [[Mark Zuckerberg]] believes AI will "unlock a huge amount of positive things," such as curing disease and increasing the safety of autonomous cars.<ref>{{Cite web|url=https://www.businessinsider.com/mark-zuckerberg-shares-thoughts-elon-musks-ai-2018-5|title=Mark Zuckerberg responds to Elon Musk's paranoia about AI: 'AI is going to... help keep our communities safe.'|last=|first=|date=25 May 2018|website=Business Insider|access-date=2019-05-06}}</ref> In January 2015, Musk donated $10 million to the [[Future of Life Institute]] to fund research on understanding AI decision making. The goal of the institute is to "grow wisdom with which we manage" the growing power of technology. Musk also funds companies developing artificial intelligence such as [[DeepMind]] and [[Vicarious (company)|Vicarious]] to "just keep an eye on what's going on with artificial intelligence.<ref>{{cite web|title = The mysterious artificial intelligence company Elon Musk invested in is developing game-changing smart computers|url = http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|website = Tech Insider|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030165333/http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|archivedate = 30 October 2015|df = dmy-all}}</ref> I think there is potentially a dangerous outcome there."<ref>{{cite web|title = Musk-Backed Group Probes Risks Behind Artificial Intelligence|url = https://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|website = Bloomberg.com|accessdate = 30 October 2015|first = Jack|last = Clark|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|archivedate = 30 October 2015|df = dmy-all}}</ref><ref>{{cite web|title = Elon Musk Is Donating $10M Of His Own Money To Artificial Intelligence Research|url = http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|website = Fast Company|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|archivedate = 30 October 2015|df = dmy-all|date = 2015-01-15}}</ref> − + + − 如果要实现不受控制的高级AI，假设的AI必须超越或者说在思想上超越整个人类，一小部分专家认为这种可能性在足够遥远未来才会出现，不值得研究。其他反对意见则以AI的角度来看，人类要么具有内在价值，要么具有可交流的价值。 第1,787行：
第1,775行： + + + 第1,867行：
第1,858行： − −
→潜在危害 Potential harm{{anchor|Potential_risks_and_moral_reasoning}}
===潜在危害 Potential harm{{anchor|Potential_risks_and_moral_reasoning}} ===
===潜在危害===
Widespread use of artificial intelligence could have unintended consequences that are dangerous or undesirable. Scientists from the Future of Life Institute, among others, described some short-term research goals to see how AI influences the economy, the laws and ethics that are involved with AI and how to minimize AI security risks. In the long-term, the scientists have proposed to continue optimizing function while minimizing possible security risks that come along with new technologies.
Widespread use of artificial intelligence could have unintended consequences that are dangerous or undesirable. Scientists from the Future of Life Institute, among others, described some short-term research goals to see how AI influences the economy, the laws and ethics that are involved with AI and how to minimize AI security risks. In the long-term, the scientists have proposed to continue optimizing function while minimizing possible security risks that come along with new technologies.
AI的广泛使用可能会产生危险或导致意外后果。生命未来研究所(Future of Life Institute)等机构的科学家提出了一些短期研究目标，以此了解AI如何影响经济、与AI相关的法律和道德规范，以及如何将AI的安全风险降到最低。从长远来看，科学家们建议继续优化功能，同时最小化新技术带来的可能的安全风险。
AI的广泛使用可能会产生危险或导致意外后果。生命未来研究所(Future of Life Institute)等机构的科学家提出了一些短期研究目标，以此了解AI如何影响经济、与AI相关的法律和道德规范，以及如何将AI的安全风险降到最低。从长远来看，科学家们建议继续优化功能，同时最小化新技术带来的可能的安全风险。<ref>Russel, Stuart., Daniel Dewey, and Max Tegmark. Research Priorities for Robust and Beneficial Artificial Intelligence. AI Magazine 36:4 (2015). 8 December 2016.</ref>
The potential negative effects of AI and automation were a major issue for Andrew Yang's 2020 presidential campaign in the United States. Irakli Beridze, Head of the Centre for Artificial Intelligence and Robotics at UNICRI, United Nations, has expressed that "I think the dangerous applications for AI, from my point of view, would be criminals or large terrorist organizations using it to disrupt large processes or simply do pure harm. [Terrorists could cause harm] via digital warfare, or it could be a combination of robotics, drones, with AI and other things as well that could be really dangerous. And, of course, other risks come from things like job losses. If we have massive numbers of people losing jobs and don't find a solution, it will be extremely dangerous. Things like lethal autonomous weapons systems should be properly governed — otherwise there's massive potential of misuse."
The potential negative effects of AI and automation were a major issue for Andrew Yang's 2020 presidential campaign in the United States. Irakli Beridze, Head of the Centre for Artificial Intelligence and Robotics at UNICRI, United Nations, has expressed that "I think the dangerous applications for AI, from my point of view, would be criminals or large terrorist organizations using it to disrupt large processes or simply do pure harm. [Terrorists could cause harm] via digital warfare, or it could be a combination of robotics, drones, with AI and other things as well that could be really dangerous. And, of course, other risks come from things like job losses. If we have massive numbers of people losing jobs and don't find a solution, it will be extremely dangerous. Things like lethal autonomous weapons systems should be properly governed — otherwise there's massive potential of misuse."
AI和自动化潜在的负面影响在安德鲁·杨2020年竞选美国总统的过程中体现了出来。联合国人工智能与机器人中心主任伊拉克利·贝瑞德兹表示: ”我认为AI危害会体现在犯罪分子或大型恐怖组织利用AI破坏大型流程或通过数字战争造成损失，也可能是机器人、无人机、AI以及其他可能非常危险的东西的结合。当然，其还有失业等风险。如果大量的人失去工作，而且没有解决方案，这将是极其危险的。另外，致命的自动化武器系统之类的东西应该得到合适的控制，否则就可能会被大量滥用。”
====存在风险 Existential risk ====
====存在风险====
{{Main|Existential risk from artificial general intelligence}}
{{Main|Existential risk from artificial general intelligence}}
Physicist Stephen Hawking, Microsoft founder Bill Gates, and SpaceX founder Elon Musk have expressed concerns about the possibility that AI could evolve to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".
Physicist Stephen Hawking, Microsoft founder Bill Gates, and SpaceX founder Elon Musk have expressed concerns about the possibility that AI could evolve to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".
物理学家斯蒂芬·霍金、微软创始人比尔·盖茨和 SpaceX 公司创始人埃隆·马斯克对AI进化到人类无法控制的程度表示担忧，霍金认为这可能“会导致人类末日”。<ref>{{cite news|last1=Rawlinson|first1=Kevin|title=Microsoft's Bill Gates insists AI is a threat|url=https://www.bbc.co.uk/news/31047780|work=BBC News|accessdate=30 January 2015|url-status=live|archiveurl=https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780|archivedate=29 January 2015|df=dmy-all|date=2015-01-29}}</ref><ref name="Holley">{{Cite news|title = Bill Gates on dangers of artificial intelligence: 'I don't understand why some people are not concerned'|url = https://www.washingtonpost.com/news/the-switch/wp/2015/01/28/bill-gates-on-dangers-of-artificial-intelligence-dont-understand-why-some-people-are-not-concerned/|work= The Washington Post|date = 28 January 2015|access-date = 30 October 2015|issn = 0190-8286|first = Peter|last = Holley|url-status=live|archiveurl = https://web.archive.org/web/20151030054330/https://www.washingtonpost.com/news/the-switch/wp/2015/01/28/bill-gates-on-dangers-of-artificial-intelligence-dont-understand-why-some-people-are-not-concerned/|archivedate = 30 October 2015|df = dmy-all}}</ref><ref>{{Cite news|title = Elon Musk: artificial intelligence is our biggest existential threat|url = https://www.theguardian.com/technology/2014/oct/27/elon-musk-artificial-intelligence-ai-biggest-existential-threat|work= The Guardian|accessdate = 30 October 2015|first = Samuel|last = Gibbs|url-status=live|archiveurl = https://web.archive.org/web/20151030054330/http://www.theguardian.com/technology/2014/oct/27/elon-musk-artificial-intelligence-ai-biggest-existential-threat|archivedate = 30 October 2015|df = dmy-all|date = 2014-10-27}}</ref>
{{quote|text=The development of full artificial intelligence could spell the end of the human race. Once humans develop artificial intelligence, it will take off on its own and redesign itself at an ever-increasing rate. Humans, who are limited by slow biological evolution, couldn't compete and would be superseded.|author=[[Stephen Hawking]]<ref>{{Cite news|title = Stephen Hawking warns artificial intelligence could end mankind|url = https://www.bbc.com/news/technology-30290540|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030054329/http://www.bbc.com/news/technology-30290540|archivedate = 30 October 2015|df = dmy-all|work = [[BBC News]]|date = 2014-12-02|last1 = Cellan-Jones|first1 = Rory}}</ref>}}
In his book Superintelligence, philosopher Nick Bostrom provides an argument that artificial intelligence will pose a threat to humankind. He argues that sufficiently intelligent AI, if it chooses actions based on achieving some goal, will exhibit convergent behavior such as acquiring resources or protecting itself from being shut down. If this AI's goals do not fully reflect humanity's—one example is an AI told to compute as many digits of pi as possible—it might harm humanity in order to acquire more resources or prevent itself from being shut down, ultimately to better achieve its goal. Bostrom also emphasizes the difficulty of fully conveying humanity's values to an advanced AI. He uses the hypothetical example of giving an AI the goal to make humans smile to illustrate a misguided attempt. If the AI in that scenario were to become superintelligent, Bostrom argues, it may resort to methods that most humans would find horrifying, such as inserting "electrodes into the facial muscles of humans to cause constant, beaming grins" because that would be an efficient way to achieve its goal of making humans smile. In his book Human Compatible, AI researcher Stuart J. Russell echoes some of Bostrom's concerns while also proposing an approach to developing provably beneficial machines focused on uncertainty and deference to humans, possibly involving inverse reinforcement learning.
In his book Superintelligence, philosopher Nick Bostrom provides an argument that artificial intelligence will pose a threat to humankind. He argues that sufficiently intelligent AI, if it chooses actions based on achieving some goal, will exhibit convergent behavior such as acquiring resources or protecting itself from being shut down. If this AI's goals do not fully reflect humanity's—one example is an AI told to compute as many digits of pi as possible—it might harm humanity in order to acquire more resources or prevent itself from being shut down, ultimately to better achieve its goal. Bostrom also emphasizes the difficulty of fully conveying humanity's values to an advanced AI. He uses the hypothetical example of giving an AI the goal to make humans smile to illustrate a misguided attempt. If the AI in that scenario were to become superintelligent, Bostrom argues, it may resort to methods that most humans would find horrifying, such as inserting "electrodes into the facial muscles of humans to cause constant, beaming grins" because that would be an efficient way to achieve its goal of making humans smile. In his book Human Compatible, AI researcher Stuart J. Russell echoes some of Bostrom's concerns while also proposing an approach to developing provably beneficial machines focused on uncertainty and deference to humans, possibly involving inverse reinforcement learning.
在《超级智能》一书中，哲学家尼克·博斯特罗姆提出了一个AI将对人类构成威胁的论点。他认为，如果足够智能的AI选择有目标地行动，它将表现出收敛的行为，如获取资源或保护自己不被关机。如果这个AI的目标没有人性，比如一个AI被告知要尽可能多地计算圆周率的位数，那么它可能会伤害人类，以便获得更多的资源或者防止自身被关闭，最终更好地实现目标。博斯特罗姆还强调了向高级AI充分传达人类价值观存在的困难。他假设了一个例子来说明一种南辕北辙的尝试: 给AI一个让人类微笑的目标。博斯特罗姆认为，如果这种情况下的AI变得非常聪明，它可能会采用大多数人类都会感到恐怖的方法，比如“在人类面部肌肉中插入电极，使其产生持续的笑容” ，因为这将是实现让人类微笑的目标的有效方法。<ref>{{cite web|url=https://www.ted.com/talks/nick_bostrom_what_happens_when_our_computers_get_smarter_than_we_are/transcript|title=What happens when our computers get smarter than we are?|first=Nick|last=Bostrom|publisher=[[TED (conference)]]|date=2015}}</ref>AI研究人员斯图亚特.J.罗素在他的《人类相容》一书中回应了博斯特罗姆的一些担忧，同时也提出了一种开发可证明有益的机器可能涉及逆强化学习的方法<ref name="HC"/>{{rp|191–193}}，这种机器侧重解决不确定性和顺从人类的问题。<ref name="HC">{{cite book |last=Russell |first=Stuart |date=October 8, 2019 |title=Human Compatible: Artificial Intelligence and the Problem of Control |url= |location=United States |publisher=Viking |page= |isbn=978-0-525-55861-3 |author-link=Stuart J. Russell |oclc=1083694322|title-link=Human Compatible }}</ref>{{rp|173}}
Concern over risk from artificial intelligence has led to some high-profile donations and investments. A group of prominent tech titans including [[Peter Thiel]], Amazon Web Services and Musk have committed $1 billion to [[OpenAI]], a nonprofit company aimed at championing responsible AI development.<ref>{{cite web|url=https://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|title=Tech titans like Elon Musk are spending $1 billion to save you from terminators|first=Washington|last=Post|url-status=live|archiveurl=https://web.archive.org/web/20160607121118/http://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|archivedate=7 June 2016|df=dmy-all}}</ref> The opinion of experts within the field of artificial intelligence is mixed, with sizable fractions both concerned and unconcerned by risk from eventual superhumanly-capable AI.<ref>{{cite journal
Concern over risk from artificial intelligence has led to some high-profile donations and investments. A group of prominent tech titans including [[Peter Thiel]], Amazon Web Services and Musk have committed $1 billion to [[OpenAI]], a nonprofit company aimed at championing responsible AI development.<ref>{{cite web|url=https://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|title=Tech titans like Elon Musk are spending $1 billion to save you from terminators|first=Washington|last=Post|url-status=live|archiveurl=https://web.archive.org/web/20160607121118/http://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|archivedate=7 June 2016|df=dmy-all}}</ref> 人工智能领域内专家们的意见是混杂的，担忧和不担忧超越人类能力的AI的观点都占有很大的分额。<ref>{{cite journal}}</ref> Facebook CEO [[Mark Zuckerberg]] believes AI will "unlock a huge amount of positive things," such as curing disease and increasing the safety of autonomous cars.<ref>{{Cite web|url=https://www.businessinsider.com/mark-zuckerberg-shares-thoughts-elon-musks-ai-2018-5|title=Mark Zuckerberg responds to Elon Musk's paranoia about AI: 'AI is going to... help keep our communities safe.'|last=|first=|date=25 May 2018|website=Business Insider|access-date=2019-05-06}}</ref> In January 2015, Musk donated $10 million to the [[Future of Life Institute]] to fund research on understanding AI decision making. The goal of the institute is to "grow wisdom with which we manage" the growing power of technology. Musk also funds companies developing artificial intelligence such as [[DeepMind]] and [[Vicarious (company)|Vicarious]] to "just keep an eye on what's going on with artificial intelligence.<ref>{{cite web|title = The mysterious artificial intelligence company Elon Musk invested in is developing game-changing smart computers|url = http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|website = Tech Insider|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030165333/http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|archivedate = 30 October 2015|df = dmy-all}}</ref> I think there is potentially a dangerous outcome there."<ref>{{cite web|title = Musk-Backed Group Probes Risks Behind Artificial Intelligence|url = https://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|website = Bloomberg.com|accessdate = 30 October 2015|first = Jack|last = Clark|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|archivedate = 30 October 2015|df = dmy-all}}</ref><ref>{{cite web|title = Elon Musk Is Donating $10M Of His Own Money To Artificial Intelligence Research|url = http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|website = Fast Company|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|archivedate = 30 October 2015|df = dmy-all|date = 2015-01-15}}</ref>
}}</ref> Other technology industry leaders believe that artificial intelligence is helpful in its current form and will continue to assist humans. Oracle CEO Mark Hurd has stated that AI "will actually create more jobs, not less jobs" as humans will be needed to manage AI systems. Facebook CEO Mark Zuckerberg believes AI will "unlock a huge amount of positive things," such as curing disease and increasing the safety of autonomous cars. In January 2015, Musk donated $10 million to the Future of Life Institute to fund research on understanding AI decision making. The goal of the institute is to "grow wisdom with which we manage" the growing power of technology. Musk also funds companies developing artificial intelligence such as DeepMind and Vicarious to "just keep an eye on what's going on with artificial intelligence. I think there is potentially a dangerous outcome there."
对人工智能潜在风险的担忧引来了一些大额的捐献和投资。一些科技巨头，如彼得·蒂尔、亚马逊云服务、以及马斯克已经把10亿美金给了OpenAI，一个拥护和聚焦于开发可靠的AI的非盈利公司。<ref>{{cite web|url=https://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|title=Tech titans like Elon Musk are spending $1 billion to save you from terminators|first=Washington|last=Post|url-status=live|archiveurl=https://web.archive.org/web/20160607121118/http://www.chicagotribune.com/bluesky/technology/ct-tech-titans-against-terminators-20151214-story.html|archivedate=7 June 2016|df=dmy-all}}</ref> 人工智能领域内专家们的观点是混杂的，担忧和不担忧超人类AI的意见都占有很大的份额。其他技术行业的领导者相信AI在目前的形式下是有益的，并将继续帮助人类。甲骨文首席执行官马克·赫德表示，AI“实际上将创造更多的就业机会，而不是减少就业机会” ，因为管理AI系统需要人力<ref>{{Cite web|url=https://searcherp.techtarget.com/news/252460208/Oracle-CEO-Mark-Hurd-sees-no-reason-to-fear-ERP-AI|title=Oracle CEO Mark Hurd sees no reason to fear ERP AI|website=SearchERP|language=en|access-date=2019-05-06}}</ref> 。Facebook 首席执行官马克·扎克伯格相信AI将“解锁大量正面的东西” ，比如治愈疾病和提高自动驾驶汽车的安全性<ref>{{Cite web|url=https://www.businessinsider.com/mark-zuckerberg-shares-thoughts-elon-musks-ai-2018-5|title=Mark Zuckerberg responds to Elon Musk's paranoia about AI: 'AI is going to... help keep our communities safe.'|last=|first=|date=25 May 2018|website=Business Insider|access-date=2019-05-06}}</ref>。2015年1月，马斯克向未来生命研究所捐赠了1000万美元，用于研究AI决策。该研究所的目标是“用智能管理”日益增长的技术力量。马斯克还为 DeepMind 和 Vicarious 等开发AI的公司提供资金，以“跟进AI的发展”<ref>{{cite web|title = The mysterious artificial intelligence company Elon Musk invested in is developing game-changing smart computers|url = http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|website = Tech Insider|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030165333/http://www.techinsider.io/mysterious-artificial-intelligence-company-elon-musk-investment-2015-10|archivedate = 30 October 2015|df = dmy-all}}</ref>因为认为这个领域“可能会产生危险的后果”<ref>{{cite web|title = Musk-Backed Group Probes Risks Behind Artificial Intelligence|url = https://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|website = Bloomberg.com|accessdate = 30 October 2015|first = Jack|last = Clark|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.bloomberg.com/news/articles/2015-07-01/musk-backed-group-probes-risks-behind-artificial-intelligence|archivedate = 30 October 2015|df = dmy-all}}</ref><ref>{{cite web|title = Elon Musk Is Donating $10M Of His Own Money To Artificial Intelligence Research|url = http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|website = Fast Company|accessdate = 30 October 2015|url-status=live|archiveurl = https://web.archive.org/web/20151030202356/http://www.fastcompany.com/3041007/fast-feed/elon-musk-is-donating-10m-of-his-own-money-to-artificial-intelligence-research|archivedate = 30 October 2015|df = dmy-all|date = 2015-01-15}}</ref>。
为了实现不受控制的先进人工智能的危险，假设的人工智能必须超越或超越整个人类，一小部分专家认为这种可能性在未来足够遥远，不值得研究。其他反对意见则围绕着从人工智能的角度来看， '''<font color=#32cd32> 人类有内在或可聚合的价值。</font>'''
为了实现不受控制的先进人工智能的危险，假设的人工智能必须超越或超越整个人类，一小部分专家认为这种可能性在未来足够遥远，不值得研究。其他反对意见则围绕着从人工智能的角度来看， '''<font color=#32cd32> 人类有内在或可聚合的价值。</font>'''
如果要实现不受控制的高级AI，这个假想中的AI必须超越或者说在思想上超越全人类，一小部分专家认为这种可能性在足够遥远未来才会出现，不值得研究。其他反对意见则认为，从AI的角度来看，人类或者具有内在价值，或者具有可交流的价值。
--[[用户:Thingamabob|Thingamabob]]（[[用户讨论:Thingamabob|讨论]]） 不太能翻译 Other counterarguments revolve around humans being either intrinsically or convergently valuable from the perspective of an artificial intelligence.一句
--[[用户:Thingamabob|Thingamabob]]（[[用户讨论:Thingamabob|讨论]]） 不太能翻译 Other counterarguments revolve around humans being either intrinsically or convergently valuable from the perspective of an artificial intelligence.一句
目前，包括美国、中国、俄罗斯和英国在内的50多个国家正在研究战场机器人。许多人担心来自超级智能AI的风险，也希望限制人造士兵和无人机的使用。
目前，包括美国、中国、俄罗斯和英国在内的50多个国家正在研究战场机器人。许多人担心来自超级智能AI的风险，也希望限制人造士兵和无人机的使用。
===道德机器 Ethical machines ===
===道德机器 Ethical machines ===