A World Economic Forum survey revealed that the risk of misinformation in India is now considered more severe than that of infectious diseases or illicit economic activities over the next two years.
In one of these videos, produced using AI, Prime Minister Modi is seen in a moment of ecstatic celebration, dancing enthusiastically on stage to a lively Bollywood song while a cheering crowd applauds fervently in the background. The prime minister himself shared the video on his social media, praising the creativity and energy displayed during the electoral fervor, describing it as a true delight.
While these videos can be viewed as artistic expressions and demonstrations of political support, they also raise important questions about the ethical and responsible use of technology, particularly in the context of elections. The spread of AI-generated content can significantly influence public opinion and shape political narratives, increasing the need for greater transparency and regulation in this field.
In a further development, another video, following the same production style, captures the prime minister’s rival, Mamata Banerjee, in a dance scene wearing traditional Indian attire, while excerpts of her speech criticizing defectors from her party who joined Modi’s are played in the background. The uniqueness of this video lies in the combination of dance with the political context, creating an engaging and controversial narrative. The police have launched an investigation into this video, expressing concerns that its dissemination could potentially “affect law and order.”
These different reactions to AI-generated videos highlight the growing concerns surrounding the use and misuse of technology as it becomes a powerful tool in the political arena. As the world’s most populous country prepares for its national election, regulators and security authorities are increasingly alert to the challenges that technological manipulation may pose to the integrity of the democratic process and social stability.
AI-generated videos, which feature nearly flawless movements of shadows and hands, have the potential to deceive even digitally literate individuals. However, the risks are even greater in a country where a significant portion of its 1.4 billion inhabitants faces technological challenges, and where manipulated content can easily incite sectarian tensions, especially during the electoral period.
A survey conducted by the World Economic Forum and published in January highlights that the risk of misinformation in India is now considered more severe than that of infectious diseases or illicit economic activities over the next two years. This warning underscores the urgency of addressing the spread of false and manipulated information, which can have profound consequences for the country’s political and social stability.
Consultant Sagar Vishnoi, who is advising several political parties on AI use in India’s elections, has warned about the increasing risk of misinformation exacerbated by this technology. He emphasizes that India already faces a significant challenge in this regard and that AI could accelerate the spread of false information at up to 100 times the speed.
Vishnoi also points out the vulnerability of the elderly, who typically have less experience with technology and are therefore more susceptible to falling for misleading narratives facilitated by AI-generated videos. He warns that such phenomena could have severe consequences, including the intensification of hatred against certain communities, castes, or religions, exacerbating social divisions and undermining national cohesion. This concern underscores the urgent need for regulation and awareness to mitigate the harmful impacts of AI-driven misinformation.
The 2024 national election, which is currently underway and will conclude on June 1, marks a historic moment as the first time artificial intelligence is being widely implemented. Initially, the examples were relatively harmless, with some politicians using the technology to create personalized videos and audio messages for their campaigns.
However, more serious cases of AI misuse have dominated headlines since April. These include the spread of deepfakes involving Bollywood actors criticizing Prime Minister Modi, as well as fake videos implicating two of the prime minister’s top advisors in illicit activities, leading to the arrest of nine people.
These incidents highlight the potential dangers associated with technological manipulation in an electoral context, raising concerns about the integrity of the democratic process. As technology advances, it is crucial to implement stringent measures to curb the misuse of AI and ensure fair and transparent elections.
Last week, India’s Election Commission issued a stern warning to political parties, cautioning against the use of artificial intelligence to spread misinformation. In an effort to curb this harmful practice, the Commission outlined seven provisions under information technology and other laws that impose prison sentences of up to three years for crimes such as forgery, rumor-mongering, and incitement to hostility.
A national security official in New Delhi expressed concern that fake news could incite unrest. The widespread availability of AI tools facilitates the fabrication of such fake news, especially during the election period, posing significant challenges for effective countermeasures.
The use of artificial intelligence and deepfakes is becoming increasingly prevalent in elections worldwide, including in countries like the United States, Pakistan, and Indonesia. The recent spread of these videos in India highlights the challenges authorities face in curbing technological manipulation and protecting the integrity of the democratic process. This global trend underscores the urgent need for regulation and oversight to safeguard the credibility of elections worldwide.
In light of these challenges, it is essential that electoral authorities and lawmakers adopt robust measures to combat the spread of AI-driven misinformation. Beyond the established penalties, investing in public education on identifying and countering disinformation, strengthening fact-checking mechanisms, and promoting transparency in political communication are crucial steps.
The integrity of elections is a fundamental pillar of democracy, and the growing influence of artificial intelligence requires a proactive and coordinated response to protect this principle. Only through a collective effort by authorities, political parties, civil society, and technology companies can we ensure that elections remain a genuine reflection of the popular will, thereby preserving the health and stability of democracies worldwide.
