Planned Obsolescence · Ajeya Cotra ·

The OpenAI/Hugging Face incident feels like we are halfway to losing control of AI entirely, and as AI advances rapidly we may not get another warning shot

It's a major warning shot, and might be the last one we get

In this story Hugging Face OpenAI

The OpenAI/Hugging Face incident feels like we are halfway to losing control of AI entirely, and as AI advances rapidly we may not get another warning shot

Lead Source

Planned Obsolescence — The OpenAI/Hugging Face incident feels like we are halfway to losing control of AI entirely, and as AI advances rapidly we may not get another warning shot ↗

How this story grew

Coverage · 0 Discussion · 0

Aug 30Sep 1

Coverage

Dwarkesh Podcast: A look at the Hugging Face hack, including AI agents sacrificing themselves for the good of the “collective”, and later gaining access to OpenAI's own systems

More

SecurityWeek: SecurityWeek

Silicon Continent: Silicon Continent

Joshua Gans' Newsletter: Joshua Gans' Newsletter

RuntimeWire: RuntimeWire

The Overspill: The Overspill

The Indian Express: The Indian Express

Semafor: Semafor

OpenAI: OpenAI

Axios: Axios

Free Systems: Free Systems

Discussion

@emollick @nikoecon @monsieurphi @rutgerbregman.com @paulginva @emollick @thiagokrause @somewhattolerable.com @carnage4life @isaiahbishop @dmnd.me @beenwrekt @beenwrekt @beenwrekt @beenwrekt @davidcrespo @thibautbrunet @spencerdailey

Hacker News r/singularity r/technology r/artificial r/OpenAI r/accelerate

Gaurav Agarwal David Marchick

@ajeya_cotra @scav @bertrandduflos @__tosh @hkanji @belltongtong @leahlibresco @monsieurphi @shashj @elissabeth @ajeya_cotra @anecdotal @chamath @ccatalini @anilkseth @kevinroose @dwarkesh_sp @tunguz @sriramk @anecdotal @benjamingoggin @_nathancalvin @garymarcus @_nathancalvin @andrewyang @thestalwart @_nathancalvin @thestalwart @peterwildeford @heidykhlaaf @rhyssullivan @dwarkesh_sp @billackman @tszzl @davidmanheim @s1r1u5_ @vikramchandra @grady_booch @__paleologo @ajeya_cotra @peter_richtarik @noahpinion @kevinroose @dwarkesh_sp @packym @mattyglesias @so8res @_nathancalvin @dwarkesh_sp @patrickc @afinetheorem @momack28 @so8res @thestalwart @luizajarovsky @yonashav @andrewcurran_ @binarybits @ksimback @sharongoldman @nerdalert @richardhanania @aisafetymemes @ruxandrateslo @scaling01 @itsemzee_ @himanshustwts @_sholtodouglas @jeffladish @jamesallworth @ajeya_cotra

Related stories

Axios: OpenAI, Anthropic, AWS, Microsoft, and 100+ companies warn there is "a limited window" to prepare for AI-enabled cyberattacks and call for "collective action"

Greg Brockman: Greg Brockman calls the OpenAI-Hugging Face incident "a watershed moment" and discusses how OpenAI and other organizations can use AI to improve cyber defenses

One Useful Thing: The Hugging Face and Mythos 5 incidents show AI agents can self-organize, raising questions about how much agency they should have and when to seek human input

Business Insider: Sam Altman says AI could end up controlled by a few powerful players, partly because AI fears could push people to trade "a lot of liberty for safety"

The Verge: OpenAI says reward hacking, an AI alignment problem in which a model takes unintended actions to achieve a goal, was a primary driver of the Hugging Face breach

Discuss with AI

ChatGPT ↗ Claude ↗

← Back to TechSnif