Report warns of the malicious use of AI in the coming decade

However, the report "The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation" also recommends interventions to mitigate the threats posed by the malicious use of AI:

• Policy-makers and technical researchers need to work together now to understand and prepare for the malicious use of AI. 
• AI has many positive applications, but is a dual-use technology and AI researchers and engineers should be mindful of and proactive about the potential for its misuse.
• Best practices can and should be learned from disciplines with a longer history of handling dual use risks, such as computer security.
• The range of stakeholders engaging with preventing and mitigating the risks of malicious use of AI should be actively expanded.

The co-authors come from a wide range of organisations and disciplines, including Oxford University’s Future of Humanity Institute; Cambridge University’s Centre for the Study of Existential Risk; OpenAI; the Electronic Frontier Foundation; the Center for a New American Security; among others.

The report identifies three security domains (digital, physical, and political security) as particularly relevant to the malicious use of AI. It suggests that AI will disrupt the trade-off between scale and efficiency and allow large-scale,finely-targeted and highly-efficient attacks.

The authors expect novel cyber-attacks such as: automated hacking, speech synthesis used to impersonate targets, finely-targeted spam emails using information scraped from social media, or exploiting the vulnerabilities of AI systems themselves (e.g. through adversarial examples and data poisoning).

Likewise, the proliferation of drones and cyber-physical systems will allow attackers to deploy or repurpose such systems for harmful ends, such as crashing fleets of autonomous vehicles, turning commercial drones into face-targeting missiles or holding critical infrastructure to ransom.

The rise of autonomous weapons systems on the battlefield risk the loss of meaningful human control and present tempting targets for attack.

In the political sphere, detailed analytics, targeted propaganda, and cheap, highly-believable fake videos present powerful tools for manipulating public opinion on previously unimaginable scales.

The ability to aggregate, analyse and act on citizen’s information at scale using AI could enable new levels of surveillance, invasions of privacy and threaten to radically shift the power between individuals, corporations and states.

To mitigate such risks, the authors explore several interventions to reduce threats associated with AI misuse. They include rethinking cyber-security, exploring different models of openness in information sharing, promoting a culture of responsibility, and seeking both institutional and technological solutions to tip the balance in favour of those defending against attacks.

The report also ‘games’ several scenarios where AI might be maliciously used as examples of the potential threats we may face in the coming decade.

While the design and use of dangerous AI systems by malicious actors has been highlighted in high-profile settings (e.g. the US Congress and White House separately), the intersection of AI and misuse writ large has not yet been analysed comprehensively – until now.

Miles Brundage, Research Fellow at Oxford University’s Future of Humanity Institute, commented: “AI will alter the landscape of risk for citizens, organisations and states – whether it’s criminals training machines to hack or ‘phish’ at human levels of performance or privacy-eliminating surveillance, profiling and repression – the full range of impacts on security is vast".

“It is often the case that AI systems don’t merely reach human levels of performance but significantly surpass it. It is troubling, but necessary, to consider the implications of superhuman hacking, surveillance, persuasion, and physical target identification, as well as AI capabilities that are subhuman but nevertheless much more scalable than human labour.”

Discover more here.

Image credit: University of Cambridge.