● Draft – legal and case law references not yet verified
Summary
This use case examines how AI-generated video, synthetic audio and text can amplify misinformation and undermine electoral integrity. Convincing fabricated content can impersonate political figures, mislead voters and weaken trust in authentic information. Responses include content transparency, platform risk mitigation and international cooperation through initiatives such as the non-binding UN Global Digital Compact.
The Problem
Generative AI makes misleading political content easier to produce and distribute at scale, while voters may struggle to distinguish authentic material from fabrications. The central challenge is protecting informed electoral participation without suppressing legitimate political expression, satire or debate.
Fabricated statements and misleading election information can distort public debate and interfere with informed participation. Safeguards should protect the electoral process rather than advantage particular political viewpoints.
Deceptive synthetic content can manipulate voters by misrepresenting who said something or what occurred. Voters need reliable context to form political judgments independently.
Clear disclosure of synthetic content helps voters assess its origin and credibility. Labels should not imply that all AI-generated content is false or that unlabelled content is necessarily authentic.
AI providers, content publishers and platforms have distinct responsibilities for preventing and addressing electoral deception. Moderation and mitigation measures should be explainable and open to challenge to reduce arbitrary restrictions on political speech.
These provisions establish machine-readable marking obligations for providers of systems generating synthetic content and disclosure duties for deployers producing deepfakes or public-interest text, subject to specified exceptions and qualifications.
Very large online platforms and search engines must assess and mitigate systemic risks, including actual or foreseeable negative effects on civic discourse and electoral processes.
Where electoral AI activities process personal data, they require lawful, fair and transparent processing, with additional restrictions for data revealing political opinions.
Within the Charter’s scope, measures restricting electoral content must respect freedom of expression and information and satisfy the requirements governing limitations on fundamental rights.
Sources
Court & Regulator Decisions
Annulment of the 2024 Romanian presidential electionNeeds review
Constitutional Court of Romania · Decision no. 32 of 6 December 2024 · 2024
The annulment illustrates how coordinated online manipulation can threaten electoral legitimacy, without establishing that generative AI caused the interference.
Key Takeaways
Combine synthetic-content marking and disclosure with verification; labels alone do not establish truth.
Assess election-specific risks, including impersonation and misleading voting information, and adopt proportionate mitigation measures.
Protect legitimate political debate and satire through clear moderation rules and accessible challenge mechanisms.
Use international cooperation to complement enforceable legal duties, distinguishing non-binding commitments from binding requirements.