大量研究表明,具有人类竞争情报的人工智能系统可能对社会和人类构成深刻风险,并得到顶尖人工智能实验室的认可。正如得到广泛赞同的Asilomar人工智能原理,先进的人工智能可能代表着地球生命史上的一场深刻变革,应该以相应的关心和资源进行规划和管理。不幸的是,这种水平的规划和管理并没有发生,尽管最近几个月来,人工智能实验室陷入了一场失控的竞赛,开发和部署更强大的数字思维,没有人——甚至他们的创造者——能够理解、预测或可靠地控制。
AI systems with human-competitive intelligence can pose profound risks to society and humanity, as shown by extensive research,and acknowledged by top AI labs. As stated in the widely-endorsed Asilomar AI Principles, Advanced AI could represent a profound change in the history of life on Earth, and should be planned for and managed with commensurate care and resources. Unfortunately, this level of planning and management is not happening, even though recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control.
当代人工智能系统在一般任务上正变得具有人类竞争力,我们必须问自己:应该让机器用宣传和谎言淹没我们的信息渠道吗?应该自动化了所有的工作吗,包括令人满意的工作吗?应该让我们开发出非人类的思想,最终可能会在数量上超过我们,比我们聪明,被淘汰,甚至取代我们?应该让我们会冒着失去文明控制的风险吗?
Contemporary AI systems are now becoming human-competitive at general tasks, and we must ask ourselves: Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization?