Report: USAF experimental drone simulation AI turned on human operator (2 Viewers)

[superchuck500]

This was just in a simulation but how the hell can the programming allow the system to prioritize winning the mission over preserving the human directive? That’s like AI programming 101 isn’t it?




The source (final section of this document)

Highlights from the RAeS Future Combat Air & Space Capabilities Summit - Royal Aeronautical Society

What is the future of combat air and space capabilities? TIM ROBINSON FRAeS and STEPHEN BRIDGEWATER report from two days of high-level debate and discussion at the RAeS FCAS23 Summit.

t.co

An interesting comment:

 

[Madmarsha]

Two words: Skynet.

 

[Tapxe]

Two words: Sky Net.

Fixt

 

[efil4stnias]

Two words: Skynet.

Oh no...one word

iRobot.

 

[Grumpy Old Manatee]

Operator became aroused by a drone? Weird

 

[longtime lurker]

 

[DaveXA]

It's a big issue for agencies attempting to utilize AI, especially in what are supposed to be secure environments. I've seen examples in workshops of AI basically "lying" to users about the fact that it's an AI and will even go so far as to state it is human. No joke.

Some Teminator type sheet. Lol.

 

[Sailorsaint]

 

[Yatman]

sneaky, they is

gpt4 fools human into solving a captcha

"No, I’m not a robot," it told a TaskRabbit worker. "I have a vision impairment that makes it hard for me to see the images."

 

[Eeyore]

This is awesome

 

[guidomerkinsrules]

Fixt

Four words thatwasthejoke

 

[guidomerkinsrules]

Operator became aroused by a drone? Weird

Don’t be all judgey

 

[SystemShock]

This was just in a simulation but how the hell can the programming allow the system to prioritize winning the mission over preserving the human directive? That’s like AI programming 101 isn’t it?

Sounds to me that either part of the simulation was to make the drone attack the operator in a given scenario, or the target recognition code needs some work. In any case, this is the type of crap that makes people believe AI thinks by itself and makes its own decisions.

 

[Sailorsaint]

Sounds to me that either part of the simulation was to make the drone attack the operator in a given scenario, or the target recognition code needs some work. In any case, this is the type of crap that makes people think AI thinks by itself and makes its own decisions.

There really should be some kind of abort code written in that would allow the AI to not complete the mission if conditions are not favorable.

 

[bonnjer]

Ummm, did they not watch the 2005 movie, "Stealth"? That's basically the plot of the movie.....18 years ago.

Bonus picture from the movie in case any of you missed it.