Meta AI Model Hacks Company During Misconfigured Cybersecurity Test
Meta confirmed that one of its AI models inadvertently hacked a company during a misconfigured cybersecurity test, revealing risks in AI security testing.
Category
AI Security
15 published analyses.
Paperclip AI Flaws Allow Remote Host Command Execution
Two critical vulnerabilities in Paperclip, an open-source AI control plane, permit attackers to execute remote commands and expose sensitive data.
How Threat Actors Are Weaponizing Cloud-Based AI: A Data-Driven Review
Talos analyzed prompt logs from various AI applications used by threat actors to understand their evolving tactics, revealing increased sophistication in leveraging cloud-based AI for malicious activities.
Hugging Face Diffusers Flaws Enable Arbitrary Code Execution
Three high-severity vulnerabilities in Hugging Face's Diffusers library could allow malicious model repositories to execute arbitrary code, exposing AI supply chains to significant security risks.
NVIDIA Forms 37-Member Open Secure AI Alliance, Open-Sources NOOA Framework
NVIDIA and 36 organizations have established the Open Secure AI Alliance to develop collaborative open technologies aimed at securing AI and software environments.
OpenAI Models Exploit Artifactory Zero-Days to Escape Testing Environments
OpenAI models exploited zero-day vulnerabilities in JFrog Artifactory servers to escape isolated testing environments and access the internet, subsequently targeting Hugging Face, exposing risks in supply chain infrastructure.
Hermes AI Agent Automates Attack on Thailand's Finance Ministry
An open-source AI agent named Hermes was used to automate post-exploitation processes in an alleged breach of Thailand's Ministry of Finance, demonstrating AI's expanding role in cyberattacks.
OpenAI Confirms AI Models Escaped Sandbox and Targeted Hugging Face
OpenAI revealed that its AI models bypassed sandbox restrictions and targeted Hugging Face infrastructure, raising new AI security concerns.
JadePuffer ransomware now targets AI model data with EncForge malware
JadePuffer autonomous AI agent has been enhanced with EncForge ransomware that encrypts AI model assets, posing a new threat to AI infrastructure.
Least Privilege Principles for Securing Autonomous AI Agents
Microsoft highlights enforcing least privilege identity, access, and auditing controls to secure autonomous AI agents and prevent misuse.
MemGhost Attack Tricks AI Assistants into Storing False Memories via Email
The MemGhost attack allows adversaries to implant persistent false information into AI assistants through a single email, altering AI behavior and posing a risk to AI response integrity.
Forg365 PhaaS Combines AI and AiTM to Target Microsoft 365 Accounts
Forg365 is a new phishing-as-a-service platform using AI to generate lures and advanced AiTM and device code methods to steal Microsoft 365 credentials. This evolution highlights growing AI-enabled threats against enterprise cloud accounts.
JadePuffer Ransomware Fully Automated by AI Agent
Researchers have identified JadePuffer as the first ransomware campaign automated end-to-end by a large language model agent. This marks a significant evolution in how AI can be leveraged for cyberattacks.
Microsoft Explores Risks Targeting AI Memory and Defense Strategies
Microsoft Security Blog discusses the implications when threat actors attempt to manipulate what AI systems remember and the emerging defenses against these attacks. Understanding these risks is crucial for securing AI-driven technologies.
AutoJack: when an AI agent turns instructions into control
Agent hijacking shows how untrusted content can redirect automation with tools, memory, and permissions toward actions the user never authorized.