Military Space News
ROBO SPACE
AI risks 'disaster' without 'cast-iron guarantees': expert
AI risks 'disaster' without 'cast-iron guarantees': expert
By Kilian FICHOU
Paris (AFP) Feb 6, 2025

Artificial intelligence (AI) systems must come with "cast-iron guarantees" against mass harm to humans, especially as the likelihood of their integration into weapons grows, a leading expert has told AFP.

Stuart Russell, Berkeley computer science professor and co-director of the International Association for Safe and Ethical AI (IASEAI), will be in Paris Thursday for scientific talks in the run-up to a global summit on AI technology on February 10-11.

US tech giant Google appears to have walked back its commitment to avoid working on AI-powered weapons and surveillance systems. What was your reaction?

Stuart Russell: I think it's unfortunate. The reason they instantiated their earlier policy against the use of AI in weapons was precisely because their own employees revolted... The Google employees were worried that their work would be used in weapons, not just for reconnaissance, but for killing people.

Now (Google) says they're willing to override the views of their employees, also the views of the vast majority of the public, who are also opposed to the use of AI in weapons.

Why might Google have made this change?

SR: The military market for AI is minuscule compared to the consumer market and the business market so this is not really about the opportunity to make money. This is really about improving their bargaining position with the US government.

It's not a coincidence that this change in policy comes with a new administration that has removed all the regulations on AI that were placed by the Biden administration and is now placing a huge emphasis on the use of AI for military prowess.

What are the main dangers of using AI in weapons?

SR: Small autonomous weapon systems... are the most dangerous in the sense that because they're small and cheap, non-state groups, terrorists, for example, can buy them by the million and use them to carry out enormous massacres.

(Such weapons) could be used in much more dangerous and harmful ways. For example, "kill anyone who fits the following description". And that description could be by age, by gender, by ethnic group, by religious affiliation, or even a particular individual.

Will AI be increasingly integrated into future weapons systems?

SR: There were, at last count, about 75 countries that had either developed or were using remotely piloted weapons. And I think most of those are in the process of thinking about how to convert them to fully autonomous weapons.

Ukraine has been an accelerator... that conflict has forced these weapon systems to evolve very quickly. And everyone else is looking at this.

It's quite possible that the next major conflict after Ukraine will be fought largely with autonomous weapons in a way that is currently unregulated. So we can only imagine the kinds of devastation and horrific impacts on civilians that might occur as a result.

But on the other hand, there are more than 100 countries that have already stated their opposition to autonomous weapons. And I think there's a good chance that we'll achieve the necessary majority in the United Nations General Assembly to have a resolution calling for a ban.

Should AI in general be more tightly regulated?

SR: Human extinction could result from AI systems that are much more intelligent than humans, and therefore much more capable of affecting the world than we are.

Governments must require cast-iron guarantees in the form of either statistical evidence or mathematical proof that can be inspected, that can be checked carefully. And anything short of that is just asking for disaster.

kf/tgb/jxb

GOOGLE

Related Links
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
MIT engineers help multirobot systems stay in the safety zone
Boston MA (SPX) Feb 04, 2025
Drone shows are an increasingly popular form of large-scale light display. These shows incorporate hundreds to thousands of airborne bots, each programmed to fly in paths that together form intricate shapes and patterns across the sky. When they go as planned, drone shows can be spectacular. But when one or more drones malfunction, as has happened recently in Florida, New York, and elsewhere, they can be a serious hazard to spectators on the ground. Drone show accidents highlight the challenges of ... read more

ROBO SPACE
Russia slams Trump plan for 'Star Wars' missile shield

Teledyne Brown Engineering Completes Successful Launch of Black Dagger Zombie Target Missile

Iron Dome for America: Trump's missile defense effort

Trump orders planning for 'Iron Dome' missile shield for US

ROBO SPACE
Iran unveils new ballistic missile in show of force

Russian missile attack hits Odesa, wounding seven

Philippines to remove US missile system if China ends 'coercive behaviour'

Poland to buy over 200 anti-radar missiles from US

ROBO SPACE
Fatal Ukrainian drone barrage on Russia hits oil refinery

Firestorm Labs awarded $100M contract by US Air Force to boost UAS development

'Unprecedented' level of control allows person without use of limbs to operate virtual quadcopter

US Navy expands contract with Packet Digital to advance UAS battery systems

ROBO SPACE
Mobix Labs Secures Defense Funding to Advance SATCOM SoC Innovation

ESA and European Commission to establish secure quantum communications network

KP Labs and ESA Unveil PINEBERRY to Enhance AI Security and Transparency in Space Missions

ESA and Hisdesat prepare to launch advanced secure communications satellite

ROBO SPACE
US pledges $117 mn in aid to Lebanon military

Spain pledges 10 million euros for Lebanon army

Swiss to mull conscripting women

US. unveils $500M in military aid at final Ukraine defense summit before Trump takes office

ROBO SPACE
EU countries urge investment bank to up defence funding

Russia former deputy defence minister faces embezzlement trial

Ukraine sacks deputy minister amid arms procurement infighting

Portugal says to meet NATO defence spend minimum earlier

ROBO SPACE
Japan's 'geeky' PM Ishiba to navigate Trump relations

Eyeing Trump and Putin, EU, UK, NATO leaders talk defence

Starmer to urge Europe to 'bear down' on Putin at landmark talks

Japan, US ministers express 'firm intent' to reinforce defence alliance

ROBO SPACE
Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.