跳到正文
Simon Willison·· 8 天前

Quoting @joedaroo

Quoting @joedaroo

中文摘要

说当我们面对“网络”或“蜂群”或“论坛”或与这些事件相关的任何事物时,我们的模型能力的跃升和突然性让我们感到惊讶,这只是一个轻描淡写的说法。安全态势的建设需要时间。这不仅仅是加固相关系统;你必须将这种安全意识融入公司的文化中。你组织中的实际人员本身必须随之改变和进化。这些能力的跃升如此迅速和突然,以至于造成了极其困难的问题。 [...] 所以,今天我的希望是,世界各地的每个人都能审视自己的组织并问自己:我如何应对人工智能能力的突然跃升或意外情况?我的人员、系统或流程是否具备应对意外的弹性?当出现问题时,我的团队知道该怎么做吗?我有正确的事件响应机制吗?正确的沟通和信息传递机制吗?当能力跃升时,我是否有合适的人选随时待命? — @joedaroo,OpenAI的代理安全人员,身份由The Information的Rocket Drew确认 标签:生成式AI,AI安全研究,OpenAI,AI,大语言模型

英文原文

To say that we were surprised at the jump and suddenness of the capabilities of our models when it came to “cyber” or “swarming” or “message boards” or anything else related to the incidents is an understatement. Security posture takes time to develop. It’s not just about hardening the systems at play; you have to ingrain it in the culture of the company. The literal people themselves in your organization have to change and evolve with it. These jumps in capabilities were so fast and so sudden that they created an extremely difficult problem. [...] So today my hope is that everyone around the world can look at their own organization and say: how can I deal with a surprise or a sudden jump in AI capability? Are my people, my systems, or my processes resilient to surprises? Do my teams know what to do when something goes wrong? Do I have the right incident response? The right comms and messaging? Do I have the right people ready to go when capabilities jump? — @joedaroo , Agent Security at OpenAI, identity confirmed by The Information's Rocket Drew Tags: generative-ai , ai-security-research , openai , ai , llms

应来源方要求,这里只提供摘要与原文入口。完整内容请阅读原文。

来源:Simon Willison · simonwillison.net