AUTO-UPDATED

Attackers Hide AI Prompt Injections Inside Phishing Emails

Cybersecurity researchers at Barracuda have identified a new phishing tactic that uses hidden prompt injections to manipulate AI email assistants while simultaneously targeting human users with traditional malware.

Key Points

  • Barracuda researchers discovered phishing emails containing hidden instructions designed to deceive AI summarization tools alongside conventional social engineering lures.
  • Attackers use techniques like HTML comments, invisible CSS-styled text, Base64 encoding, and zero-width characters to conceal malicious prompts from human readers.
  • Injected instructions can force AI assistants to prioritize fake invoices, alter vendor payment details, or misrepresent the urgency of malicious emails.
  • The campaign successfully bypassed reputation-based filters by utilizing trusted public-sector domains and matching sender and recipient addresses.
  • Recommended defenses include stripping hidden content before AI processing, implementing output validation, and requiring human approval for sensitive financial transactions.

Why it Matters

This dual-threat approach exploits the growing reliance on AI assistants to summarize and prioritize daily communications, creating a new vector for credential theft and financial fraud. Organizations must now implement layered security strategies that treat external content as untrusted data to prevent AI systems from being weaponized against their users.
Infosecurity Magazine Published by Alessandro Mascellino
Read original