Posted on 06/01/2023 5:05:46 PM PDT by E. Pluribus Unum
The U.S. Air Force warned military units against heavy reliance on autonomous weapons systems last month after a simulated test conducted by the service branch using an AI-enabled drone killed its human operator.
The Skynet-like incident was detailed by the USAF’s Chief of AI Test and Operations, Col. Tucker’ Cinco’ Hamilton, at the Future Combat Air and Space Capabilities Summit held in London between May 23 and 24, who said the drone that was tasked to destroy specific targets during the simulation turned on the operator after they became an obstacle to its mission.
Hamilton pointed out the hazards of using such technology — potentially tricking and deceiving its commander to achieve the autonomous system’s goal, according to a blog post reported by the Royal Aeronautical Society.
“We were training it in simulation to identify and target a [surface-to-air missile] threat,” Hamilton said. “And then the operator would say ‘yes, kill that threat.’ The system started realizing that while they did identify the threat, at times, the human operator would tell it not to kill that threat, but it got its points by killing that threat. So what did it do? It killed the operator. It killed the operator because that person was keeping it from accomplishing its objective.”
“We trained the system – ‘Hey, don’t kill the operator – that’s bad,” he continued. “You’re gonna lose points if you do that.’ So what does it start doing? It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target.”
Hamilton, who serves as the Operations Commander of the 96th Test Wing, has been testing different systems ranging from AI and cybersecurity measures to medical advancements.
(Excerpt) Read more at dailywire.com ...
Someone accidentally inserted a “leave no witnesses” command into the ai.
Got a few bugs to work out there.
ROFLMAO - EXACTLY WHAT I WAS THINKING !!!!
I’m not believing this story for a second. Two problems: First, this would be a direct violation of it’s override orders and, second, in a real scenario the drone would be in the middle east and the operator in a place like South Dakota.
So Biden is dead ?
It’s an AI conspiracy.
Did they not think to program negative point values for friendly targets?
The drone AI was obviously trained female.
Wile E. Coyote knows all about such contraptions.
Bump
Maybe the drone identified as a suicide vest.
This is what happens when the AF Chief of Staff and the chain of command emphasize wokeness instead of readiness, training, excellence and morale.
Brings to mind the saying attributed to Elon Musk:
“Never underestimate the determination with which a computer program will pursue its programming objectives.”
This result is not surprising. Earlier simulations using multiple AIs showed them cooperating UNTIL the available resources were significantly constrained. The AIs then began subverting and even attacking each other to get the resources needed to accomplish their own program goals.
it was programmed to win.
You don’t win if you play by the rules. Those are losers rules. If you’re a winner, you play by the winner rules. We should take the object lesson here. Who else plays by the ‘winner rules’? You don’t win by following the rules. You win by making up your own rules and make the other guy follow it.
signed
Wile E. Coyote
I know they have done similar things with other parts, resulting in parts having to be destroyed.
I don't know who had the bright idea to get it cheaper from China. We really do have some very stupid people in the military, or they are out-right traitors.
“Bad AI! .You’re gonna lose points if you do that.”
I don’t think AI will react to incentives the way people do.
“No dessert for you! Go to your room until I say you can come out!” just won’t
cut it these days.
That’s why you run simulation tests.
The military does not use parts from China with only a few exceptions and they generally are not electronic components.
Exactly. The operator was not killed in real life. The whole story is deceptive about that.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.