[2507.17937] Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation

[2507.17937] Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation

arXiv - AI 4 min read Article

Summary

The paper presents a novel attack method, Adversarial PhoneTic Prompting (APT), that exploits phonetic memorization in generative AI systems for music and video, demonstrating vulnerabilities in current copyright safeguards.

Why It Matters

This research highlights significant weaknesses in copyright protection mechanisms used by generative AI models. By revealing how phonetic structures can bypass lexical filters, it raises concerns about the integrity of AI-generated content and the potential for copyright infringement, impacting creators and the industry.

Key Takeaways

  • APT can effectively bypass copyright filters by exploiting phonetic memorization.
  • The method achieves high similarity to original lyrics, indicating a vulnerability in generative models.
  • Phonetic structure is prioritized over semantic meaning in AI encoding, leading to potential copyright violations.
  • The vulnerability extends beyond music to visual content generation, showcasing cross-modal risks.
  • Current defenses against phonetic-semantic attacks are inadequate, necessitating improved safeguards.

Computer Science > Sound arXiv:2507.17937 (cs) [Submitted on 23 Jul 2025 (v1), last revised 25 Feb 2026 (this version, v4)] Title:Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation Authors:Jaechul Roh, Zachary Novack, Yuefeng Peng, Niloofar Mireshghallah, Taylor Berg-Kirkpatrick, Amir Houmansadr View a PDF of the paper titled Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation, by Jaechul Roh and 5 other authors View PDF HTML (experimental) Abstract:Generative AI systems for music and video commonly use text-based filters to prevent regurgitation of copyrighted material. We expose a significant vulnerability in this approach by introducing Adversarial PhoneTic Prompting (APT), a novel attack that bypasses these safeguards by exploiting phonetic memorization--the tendency of models to bind sub-lexical acoustic patterns (phonemes, rhyme, stress, cadence) to memorized copyrighted content. APT replaces iconic lyrics with homophonic but semantically unrelated alternatives (e.g., "mom's spaghetti" becomes "Bob's confetti"), preserving phonetic structure while evading lexical filters. We evaluate APT on leading lyrics-to-song models (Suno, YuE) across English and Korean songs spanning rap, pop, and K-pop. APT achieves 91% average similarity to copyrighted originals, versus 13.7% for random lyrics and 42.2% for semantic paraphrases. Embedding analysis confirms the mechanism: YuE's text encoder treats APT-modified lyrics as near-iden...

Related Articles

Machine Learning

[R] Are there ML approaches for prioritizing and routing “important” signals across complex systems?

I’ve been reading more about attention mechanisms in transformers and how they effectively learn to weight and prioritize relevant inputs...

Reddit - Machine Learning · 1 min ·
Llms

[P] I trained a language model from scratch for a low resource language and got it running fully on-device on Android (no GPU, demo)

Hi Everybody! I just wanted to share an update on a project I’ve been working on called BULaMU, a family of language models trained (20M,...

Reddit - Machine Learning · 1 min ·
Machine Learning

[R] Structure Over Scale: Memory-First Reasoning and Depth-Pruned Efficiency in Magnus and Seed Architecture Auto-Discovery

Dataset Model Acc F1 Δ vs Log Δ vs Static Avg Params Peak Params Steps Infer ms Size Banking77-20 Logistic TF-IDF 92.37% 0.9230 +0.00pp +...

Reddit - Machine Learning · 1 min ·
UM Computer Scientists Land Grant to Improve Models of Melting Greenland Glaciers
Machine Learning

UM Computer Scientists Land Grant to Improve Models of Melting Greenland Glaciers

Two UM researchers are using advanced neural networks, machine learning and artificial intelligence to improve climate models to better p...

AI News - General · 5 min ·
More in Machine Learning: This Week Guide Trending

No comments

No comments yet. Be the first to comment!

Stay updated with AI News

Get the latest news, tools, and insights delivered to your inbox.

Daily or weekly digest • Unsubscribe anytime