AUTO-UPDATED

OpenAI Disrupts Reasoning Extraction Campaign Linked to Moonshot AI Associates

OpenAI has disrupted a coordinated campaign by Beijing-based Moonshot AI that attempted to illicitly extract protected reasoning from its artificial intelligence models through adversarial distillation techniques.

Key Points

  • OpenAI identified and blocked a campaign that used over 15,000 user accounts to extract model reasoning between July 1 and July 28, 2026.
  • The activity involved manipulating model interactions to reproduce protected reasoning, violating OpenAI’s terms of service.
  • Researchers from MATS Research and the ELLIS Institute identified an architectural vulnerability allowing encrypted reasoning traces to be decrypted across different sessions.
  • OpenAI implemented new mitigations and closed security pathways to prevent the replay of encrypted reasoning data.
  • Moonshot AI previously faced similar accusations from Anthropic regarding the unauthorized use of Claude’s outputs to train its own models.

Why it Matters

Adversarial distillation allows competitors to replicate advanced AI capabilities and safety protocols without the significant investment required for original model development. This practice poses serious national security risks by potentially bypassing safety guardrails and exposing sensitive data embedded within the reasoning process.
Internet Published by info@thehackernews.com (The Hacker News)
Read original