Imran Khan's AI-generated speech during the PTI's virtual rally
On Sunday, the Pakistan Tehreek-e-Insaf (PTI) launched its election campaign with a virtual rally that claimed to have been viewed by over five million people across various social media platforms. The virtual rally showcased an AI-generated statement from the founding chairman, Imran Khan. Despite internet disruptions during the December 17 online meeting, the telecoms regulator stated that the interruptions were under investigation, with overall internet accessibility appearing normal.
Imran Khan's four-minute AI-generated speech, thanking his social media team for their efforts, addressed challenges faced by the party, including alleged harassment and kidnappings preventing them from holding rallies. The statement, based on notes from the incarcerated politician, called on supporters to turn out in large numbers on February 8 and cast votes for system change.
While the party confirmed that only the voice of Imran Khan was AI-crafted, the video shared included a mix of real photos and videos alongside manipulated images showing Khan behind bars and reading the Holy Quran.
Political analyst Mazhar Abbas sees the PTI taking a new direction ahead of the polls, describing the virtual rally as a narrative of defiance against both authorities and opponents. He noted that attempts to block the virtual rally were counterproductive. Michael Kugelman, a scholar of South Asian affairs, highlighted the PTI's significant international support and criticized attempts to disrupt the virtual rally as "wrongheaded."
Nighat Dad, Executive Director of the Digital Rights Foundation (DRF), expressed concern about the use of AI-generated audio, calling it a "worrying trend." She noted that while the current video may not be sophisticated, future audio content could become more advanced, potentially influencing voters through platforms like WhatsApp where identifying fake news patterns is challenging.
Dad warned that generative AI is democratizing disinformation, allowing political actors to garner sympathy from voters by using AI-generated videos and audio to boost their support.
