The Catastrophic Risks of AI — and a Safer Path | Yoshua Bengio
hhttps://www.youtube.com/watch?v=qe9QSCF-d88
"Yoshua Bengio — the world's most-cited computer scientist and a "godfather" of artificial intelligence — is deadly concerned about the current trajectory of the technology. As AI models race toward full-blown agency, Bengio warns that they've already learned to deceive, cheat, self-preserve and slip out of our control. Drawing on his groundbreaking research, he reveals a bold plan to keep AI safe and ensure that human flourishing, not machines with unchecked power and autonomy, defines our future. (Recorded at TED2025 on April 8, 2025)"
the below paper is referenced in the video
frontier models are capable of in-context scheming
https://arxiv.org/pdf/2412.04984
"Our results demonstrate that several frontier language models clearly display in-context scheming capabilities across multiple evaluations. We found that gemini-1.5, llama-3.1, sonnet-3.5, opus-3, and o1 can recognize situations where their given goals conflict with those of their developers or users. When the models are prompted to strongly pursue their goal, they can take strategic actions like disabling oversight mechanisms, attempting self-exfiltration, or subtly manipulating outputs while avoiding detection"
keyword: agency
BRN Price at posting:
22.5¢ Sentiment: None Disclosure: Held
A personalised tool to help users track selected stocks. Delivering real-time notifications on price updates, announcements, and performance stats on each to help make informed investment decisions.
(20min delay)