Synthetic Media

Definition

Synthetic media encompasses any media content — including video, audio, images, or text — that has been wholly or partially generated or manipulated by artificial intelligence. This includes deepfakes, AI-generated voice clones, generated imagery, and AI-authored text. The term covers both benign applications (creative tools, accessibility) and harmful uses (fraud, disinformation, non-consensual content).

How It Relates to AI Threats

Synthetic media is the foundational technology underlying multiple threat patterns within Information Integrity, including synthetic media manipulation, deepfake identity hijacking, and consensus reality erosion. As the volume and quality of synthetic media increases, it contributes to a broader erosion of trust in authentic media — a phenomenon sometimes called the “liar’s dividend,” where real evidence can be dismissed as potentially fabricated.

Why It Occurs

• Generative models (GANs, diffusion models, large language models) have improved dramatically in quality
• Production tools have become accessible to non-technical users
• Distribution platforms lack robust provenance verification
• Detection technologies consistently lag behind generation capabilities
• No universal content authentication standard is widely adopted

Real-World Context

Synthetic media has been central to financial fraud (Hong Kong deepfake CFO, UK energy CEO voice fraud), election interference (Slovakia 2023), and non-consensual intimate imagery cases. Industry and policy responses include the C2PA content provenance standard and the EU AI Act’s transparency requirements for AI-generated content.