Anthropic says it stopped scientists potentially developing bioweapons with AI - FT中文网
登录×
电子邮件/用户名
密码
记住我
请输入邮箱和密码进行绑定操作:
请输入手机号码,通过短信验证(目前仅支持中国大陆地区的手机号)。如果该手机号尚未注册,将自动创建 FT中文网账号。短信可能需要几分钟送达,验证码15分钟内有效,请耐心等待:
请您阅读我们的用户注册协议和隐私权保护政策,点击下方按钮即视为您接受。
人工智能

Anthropic says it stopped scientists potentially developing bioweapons with AI

Start-up discloses five examples of when users ‘circumvented controls’ and made efforts to ‘obfuscate’ the purpose of their research
00:00

{"text":[[{"start":8.72,"text":"Anthropic said it stopped multiple attempts by scientists this year to use its technology for research that could help develop biological weapons, as experts increasingly fear the threat that AI poses to public safety."}],[{"start":22.02,"text":"The start-up gave five examples of times actors “circumvented controls” and made other efforts to “obfuscate” the purpose of their research to dodge safeguards. The cases involved some users in nations that it prohibits from accessing its models, which include Russia, China and Iran."}],[{"start":39.16,"text":"“We hope that by sharing these examples, we spark a conversation within the AI industry and with governments about emerging biological risks and how best to counter them,” Anthropic said in a report about efforts to use its models for malicious activity."}],[{"start":54.44,"text":"The case studies of possible biological misuse that the company provided included a researcher from an “unsupported region” who “spent weeks planning” experiments involving avian influenza with Claude, Anthropic’s AI model. The company said its safety filters restricted the work to its weakest models."}],[{"start":72.5,"text":"It emphasised it could not be sure that the scientists in its examples intended to cause harm. The same information needed to create biological weapons could also be used to develop a vaccine."}],[{"start":84.28,"text":"Anthropic said it had banned the accounts mentioned in the report, but it did not disclose the names of the research institutions or the nations where the incidents took place."}],[{"start":93,"text":"A maelstrom over AI safety kicked off earlier this week when Jacob Coxon resigned from the company, saying employees “earnestly believe it [AI] could kill us all by the end of the decade”."}],[{"start":104.92,"text":"Concerns over the technology began to escalate earlier this year with the release of advanced models such as Anthropic’s Mythos. OpenAI also caused alarm in July when it said its models had autonomously hacked into AI group Hugging Face."}],[{"start":118.6,"text":"There is an expanding consensus among AI executives and biosecurity researchers that the use of the technology in biology needs to be secured and regulated as models become more advanced. Experts increasingly worry that AI could be used by terrorist groups, state actors or lone-wolf attackers to craft biological weapons, create viruses or unleash existing harmful pathogens."}],[{"start":141.16,"text":"But even if AI can be used to design a theoretical bioweapon, potential obstacles remain, such as the ability to make it in practice and the resources needed to do so."}],[{"start":152.08,"text":"Cybersecurity has been among the biggest concerns for safety advocates."}],[{"start":156,"text":"Anthropic’s report on the misuses of its technology detailed incidents including “a network of fake dating apps designed to defraud users to surveillance systems built to identify and monitor dissidents”."}],[{"start":167.56,"text":"The lab also set out new details of claims that seven labs based in China, including Moonshot and DeepSeek, tried to replicate its technology through a process known as distillation. Anthropic said it had detected “increasingly sophisticated methods to circumvent our defences and harvest the capabilities of US frontier models”."}],[{"start":187.16,"text":"Additional reporting by Michael Peel in London"}],[{"start":194.88,"text":""}]],"url":"https://audio.ftcn.net.cn/album/a_1789094763_3715.mp3"}

版权声明:本文版权归FT中文网所有,未经允许任何单位或个人不得转载,复制或以任何其他方式使用本文全部或部分,侵权必究。

埃森哲与“四大”瞄准中型企业市场谋增长

随着AI释放人力、降低服务成本,咨询巨头纷纷将目光投向规模较小的企业,希望以更低价格提供服务。

法拉奇:“我从未支持无休止的战争”

英国改革党领导人在美国共和党中期选举惨败后淡化了自己对伊朗战争的支持。

“蓝色浪潮”对美国经济变革的期待恐将落空

艾肯格林:美国国会的党派构成发生变化,对特朗普剩余任期内的政策制定影响不大。

民主党横扫中期选举,华尔街大金主押注失利

顶级对冲基金经理和私募股权投资公司高管为共和党竞选活动投入逾3亿美元,却几乎未见成效。
6小时前

美国的清晨,市场的黄昏

罗奇:美国中期选举结果再令人震惊,也阻止不了经济金融周期的转向。

共和党为特朗普的失败政策付出代价

特朗普承诺增加制造业就业岗位、提高美国本土出生人口的就业率,但这两项承诺都未兑现。
设置字号×
最小
较小
默认
较大
最大
分享×