How deepfakes of Peter Dutton are spreading on Chinese app RedNote | ABC Investigations

Key Concepts:

• Defake: An AI-generated audio or video that convincingly mimics a real person's voice and/or appearance.
• Misinformation: False or inaccurate information, especially that which is deliberately intended to deceive.
• Rednote: A Chinese social media platform popular among Chinese Australians.
• Marginal Seats: Electoral districts where the outcome is uncertain and could be won by either major party.
• AEC: Australian Electoral Commission.

Peter Dutton Defake and Misinformation Campaign

A defake video featuring Peter Dutton's voice, generated using AI, has surfaced on the Chinese social media platform Rednote. The defake uses audio from Dutton's 2024 comments regarding the display of indigenous flags at press conferences ("If we're asking people to to identify with different flags no other country does that").

Content and Purpose of the Defake

The defake video misrepresents Dutton's position, implying that he intends to eliminate the indigenous flag altogether if elected. This is a distortion of his actual statements.

Dissemination on Rednote

The video is being shared on Rednote, a social media platform with a significant user base of Chinese Australians, many of whom reside in marginal electoral seats. This makes the spread of misinformation particularly concerning due to its potential impact on election outcomes.

Source and Motives

The video was created by a mortgage broker based in both China and Sydney. He has refused to answer questions about the video's creation and purpose. He has also created other videos falsely claiming that Dutton plans to expel Chinese migrants if elected.

Wider Misinformation on Rednote

The ABC has uncovered a broader pattern of misinformation targeting both Peter Dutton and the Albanese government on Rednote.

Lack of Fact-Checking and Oversight

Rednote lacks a policy for fact-checking political misinformation. The AEC is also not currently monitoring the platform. This absence of oversight allows misleading scare campaigns to proliferate unchecked.

Potential Impact on Election

The unchecked spread of misinformation on Rednote raises concerns that one or more key seats in the upcoming election could be swayed by these misleading campaigns.

Synthesis/Conclusion:

The emergence of AI-generated defakes and their dissemination on social media platforms like Rednote, coupled with the lack of fact-checking mechanisms, poses a significant threat to the integrity of the electoral process in Australia. The targeted nature of the misinformation, aimed at specific demographics in marginal seats, further amplifies the potential for manipulation and underscores the urgent need for platforms and regulatory bodies to address this growing challenge.