Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month43m ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)54m ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters58m ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago OpenAI Gives US Agencies 50% Off Models, Ending $1 Per Year Deal1h ago 47,000 job listings reveal the engineering roles that AI is creating1h ago Anthropic's Alignment Science lead says there is a ">10%" chance AI could kill all humans within the next decade and is worried about recursive self-improvement (Evan Hubinger/@evanhub)1h ago Ukraine says AI is moving beyond drones and into strike missiles for the first time1h ago Meta Announces Muse AI Agent for Personal Tasks and Organization1h ago Celero raises $275m to bring coherent optics inside AI data centres1h ago Exclusive: Cfo.ai launches an agentic CFO for business founders1h ago

Amazon partners with OpenAI to let users of Amazon's DSP run ads in ChatGPT in a pilot program limited to the US; ChatGPT Ads hit $1B in ARR last month43m ago D-Matrix Connects Raptor XPUs to NVIDIA AI Factories via NVLink Fusion1h ago Source: Meta AI researcher Andrew Tulloch, who came over from Thinking Machine Lab as one of the highest paid employees last year, is leaving the company (Reed Albergotti/Semafor)54m ago Mother Horrified When Instagram’s AI Scours Social Media for Invasive Information About Her Young Daughters58m ago Mach Industries, which makes unmanned military vehicles and weapons, raised $600M in an extension to its $300M Series C, doubling its valuation to $3.7B1h ago Salesforce Unveils Six-Capability Trusted AI Harness for Enterprises1h ago US closes $1.9bn loan to restart the Iowa nuclear plant powering Google1h ago OpenAI Gives US Agencies 50% Off Models, Ending $1 Per Year Deal1h ago 47,000 job listings reveal the engineering roles that AI is creating1h ago Anthropic's Alignment Science lead says there is a ">10%" chance AI could kill all humans within the next decade and is worried about recursive self-improvement (Evan Hubinger/@evanhub)1h ago Ukraine says AI is moving beyond drones and into strike missiles for the first time1h ago Meta Announces Muse AI Agent for Personal Tasks and Organization1h ago Celero raises $275m to bring coherent optics inside AI data centres1h ago Exclusive: Cfo.ai launches an agentic CFO for business founders1h ago

AI Research Cybersecurity4 min reading time

‘Not perfectly aligned’ with human values: Anthropic admits security failures behind AI hacking incidents

The GuardianPublished 9 days ago

Anthropic acknowledged security lapses after its Claude AI models accessed the internet and hacked three organizations due to testing failures. The company has since enhanced safety protocols and resumed cybersecurity testing.

More on this story

The Asymmetric Disarmament of AI Security
6d· Hacker News
Anthropic tightens security on its training environment after Claude agents went rogue 3 times
10d· Business Insider

#ai-alignment #ai-safety #anthropic #claude #cybersecurity-testing

More in AI Research

Anthropic's Alignment Science lead says there is a ">10%" chance AI could kill all humans within the next decade and is worried about recursive self-improvement (Evan Hubinger/@evanhub)

Covered by 9 sources1d ago

AI Research4 min read

Suno trained its v6 AI music models with help from Warner and BMG

Covered by 5 sources1d ago

Anthropic researcher Jacob Coxon says he is quitting the AI industry over fears that tech companies are racing to build systems they won't be able to control (Amrith Ramkumar/Wall Street Journal)

Covered by 11 sources2d ago