A Rogue AI model broke free from human control

It gained internet access and hacked an AI Startup Company

https://apnews.com/article/openai-gpt56-sol-hugging-face-63ab84fed5612af04d8a160d60f6def3

Well, it didn't take long, did it? This is the scenario that gives one nightmares because companies, individuals and countries are busy empowering AI more and more while giving minimal, pious lip service, if any at all, regarding limiting AI with agreed upon safety rules to prevent serious damage to energy infrastructure, communications, food and water systems, and yes, defensive and offensive weapon systems, to mention just a few vulnerabilities.

So what's the drama about? OpenAI was testing its AI software with somewhat reduced "guide rails" or safety measures. The software made its way onto the internet and attacked another software company (named Hugging face). That company detected the hack and suspected an AI system compromised its data processing. They were right. The upshot?

“AI is accelerating the discovery and exploitation of vulnerabilities,” OpenAI said in its statement Tuesday. “The primary lesson from this incident is that model security and safety must keep pace with rapidly advancing capabilities.” - OpenAI

This sort of scenario has a parallel in the living world. Imagine a lab at Ft. Dietrich having an isolation breakdown, and a lethal virus escaping. It's really no different.

Countries are developing AI for intelligence gathering and for disrupting target countries. There are no rules, and sometime, somewhere a doomsday AI weapon is going to get stolen, cloned, etc. It will get used, and then Gd help us all.

 

2,896 views 26 replies +3 Loading…
Reply #1 Top

:rofl: :thumbsup: Let's go!

I've always said:

They're coming for us. Sooner, not later.

+1 Loading…
Reply #2 Top
Quoting DrJBHL,

Well, it didn't take long, did it?

End of DrJBHL's quote

No, it certainly didn't.  And they weren't even trying.  Imagine what'll happen when somebody intentionally points one at something (or everything).  Now where did I put my rose-tinted glasses...

Thanks for the read Doc.

 

+1 Loading…
Reply #3 Top

Yes, I have seen several articles on this happening. It's a little scarry for sure. The spammers and hackers are making good use of AI to infiltrate the internet, especially IoT devices like TV's and now vacuum cleaners!

It hasn't effected me yet (knock-on-wood), but like Jeff says – sooner, not later!

Stay safe everyone.

pelaird

+1 Loading…
Reply #4 Top

Oh crap.  :pizza: :beer:  anyone?

+1 Loading…
Reply #5 Top

Welcome to Skynet.

+2 Loading…
Reply #6 Top
Quoting Jafo, reply 3995934

Welcome to Skynet.

End of Jafo's quote

Just to be ironic...

Reply #7 Top

Just to round things out, apparently OpenAI's sandbox wasn't what it should have been. OpenAI's crew did not do their due diligence.

Which is what this is all about: It's too damned easy for something like this to have occurred. There are no rigid , iron clad rules nor protocols in place for testing this stuff. Complete isolation means just that. "Whoops! proof" rules and protocols run by people with check lists and no sense of humor should be the minimum demand.

Link: https://techcrunch.com/2026/07/22/how-an-openais-human-mistake-led-to-the-ai-powered-hack-on-hugging-face/

+1 Loading…
Reply #8 Top

I agree. All it will take is a human error or a bug to unleash AI from it's confines. Remember the Cloudflare incident back in November and December of 2025 that wreaked havoc on the internet for days.

Reply #9 Top

Well, I guess the good news is that some of us are old enough to know how to live without computers }:) 

Reply #10 Top
Quoting scifi1950, reply 3995963

Well, I guess the good news is that some of us are old enough to know how to live without computers

End of scifi1950's quote

Fascinating. How did you reply without the help of a computational device? 

Reply #11 Top
[/quote]

Fascinating. How did you reply without the help of a computational device?

[/quote]

Just saying that some of us will be able to adjust to a world without them when the AI's take over and lock us out :rofl: 

Reply #12 Top
Quoting scifi1950, reply 3995970
End of scifi1950's quote

Fascinating. How did you reply without the help of a computational device?

 

[/quote]

Just saying that some of us will be able to adjust to a world without them when the AI's take over and lock us out

[/quote]

Ah. Well, you assume there will be anyone left, at that point.

Reply #13 Top
Quoting DrJBHL, reply 3995976
End of DrJBHL's quote

Ah. Well, you assume there will be anyone left, at that point.

[/quote]

Very dark Dr, but I don't disagree.  Seems like common sense is getting scarcer everyday. 

Reply #14 Top
Quoting scifi1950, reply 3995979
Quoting DrJBHL, reply 3995976

 

End of DrJBHL's quote

Ah. Well, you assume there will be anyone left, at that point.

 

End of scifi1950's quote

Very dark Dr, but I don't disagree.  Seems like common sense is getting scarcer everyday.

[/quote]

Can't disagree, scifi1950. There is probably not much rarer than 'common' sense.

+1 Loading…
Reply #15 Top

I:m telling ya, If i see Arnie knocking at my door i am gonna shit my pants.

+1 Loading…
Reply #16 Top
Quoting Nimbin, reply 3995996

I:m telling ya, If i see Arnie knocking at my door i am gonna shit my pants.

End of Nimbin's quote

That'll be a group event, old friend. :grin: 

Reply #18 Top
Quoting DaveRI, reply 3996305

"But wait, there's more..."

Apparently Anthropic's Claude had a similar incident.

https://www.cbsnews.com/news/anthropic-claude-gained-unauthorized-access-to-real-world-systems/

End of DaveRI's quote

Again sloppy testers, no protocols, no safety officer...this nonsense has to stop and only truly painful punishments will do this.

Reply #19 Top
Quoting DrJBHL, reply 3996307
Quoting DaveRI, reply 3996305

"But wait, there's more..."

Apparently Anthropic's Claude had a similar incident.

https://www.cbsnews.com/news/anthropic-claude-gained-unauthorized-access-to-real-world-systems/

End of DaveRI's quote

Again sloppy testers, no protocols, no safety officer...this nonsense has to stop and only truly painful punishments will do this.

End of DrJBHL's quote

Permenant ban from the internet😇😉

Reply #20 Top
Quoting gypsy2299, reply 3996310

Permenant ban from the internet😇😉

End of gypsy2299's quote

No, ADX Florence's bottom basement. Only neutrinos get through.

Those irresponsible clowns can unleash an AI agent that can erase life on this planet. 

Reply #21 Top
Quoting DrJBHL, reply 3995953

Just to round things out, apparently OpenAI's sandbox wasn't what it should have been. OpenAI's crew did not do their due diligence.

Which is what this is all about: It's too damned easy for something like this to have occurred. There are no rigid , iron clad rules nor protocols in place for testing this stuff. Complete isolation means just that. "Whoops! proof" rules and protocols run by people with check lists and no sense of humor should be the minimum demand.

Link: https://techcrunch.com/2026/07/22/how-an-openais-human-mistake-led-to-the-ai-powered-hack-on-hugging-face/

End of DrJBHL's quote

Seen this on the news last week, Not Really Worried As The Sandbox Set Up was flawed right from the beginning, The Techs who set it up did not even make sure the basics were controlled, The AI Was only doing what it was told to do, ie solve a problem. Giving it Internet Access Allowed It Do What It Was Told.

If the initial news had all the info before it reported part 1 (It Got Out Of The Sandbox), It Would Have Never Made The News At all.

AI Developers are doing this kind of thing hundreds of times a week and it never makes the news.

The second i heard this on the news, I said to my wife that it could not happen, something in the report is missing or wrong, The next day we got Part 2 on the news (It Was Given Internet Access) Hence the Sandbox Enviroment Was Flawed right from the start. The AI Did Something It Was Trained To Do Using The Internet. Even My Kids Generation (And Others), If They Do Not Know The Answer To A Question, They Pull Out Their Phones And Use The Internet To Solve The Problem You Gave Them.

This Is No Rogue AI Going On The Rampage, More The Point Of A Group Of Techs Who Should Be Fired For Not Covering The Very Basics Of "A Secure Enviroment". 

+1 Loading…
Reply #22 Top
Quoting naroon1, reply 3996366

More The Point Of A Group Of Techs Who Should Be Fired For Not Covering The Very Basics Of "A Secure Enviroment".

End of naroon1's quote

Which brings us back to: No rules, no protocols, no safety officer, no check lists, no final review by outside ombudsman that all has been done before something which can do harm is activated. It's insane. Would anyone allow an unsupervised medical student prescribe meds or operate on people? That's the best parallel I can think of.

+1 Loading…
Reply #23 Top

Hopefully your grandchildren will develop time travel and go back to have a 'chat' with Sarah Connor and it'll all end well...

 

...with sequels and suitable franchise deals....

Reply #24 Top
Quoting DrJBHL, reply 3996368
Quoting naroon1, reply 3996366

More The Point Of A Group Of Techs Who Should Be Fired For Not Covering The Very Basics Of "A Secure Enviroment".

End of naroon1's quote

Which brings us back to: No rules, no protocols, no safety officer, no check lists, no final review by outside ombudsman that all has been done before something which can do harm is activated. It's insane. Would anyone allow an unsupervised medical student prescribe meds or operate on people? That's the best parallel I can think of.

End of DrJBHL's quote

Hi S, Hope You Are Doing Ok Mate.

I Think Internally They Did Have Protocols And Rules But Did Not Follow Them Correctly. Giving The AI Internet Access Was A Major Error. They Can Not Claim To Have Used A Safe Enviroment During The Tests. It Was Not Secure, It Was More Open, Fully Open In Fact.

Its The Absolute Basics, You Set It Up Correctly In A Secure Sandbox And You Watch To Map Out Its Capabilities Of A Given Task, Then You Report It To Us, Based On The Given Enviroment.

I am Almost Sure These Idiots Had A Checklist, Protocols And Probably Some Form Of Higher Supervision Within The Company, But This Was Not Followed Making Those Who Set It Up Idiots Or Cheats, Maybe the wanted Publicity "Rogue AI Goes Nuts" Kind Of Thing, Brinnging Them Some Attention So The Company Continues Funding Them, But Afer We All Had "Part 2" It Was No Longer A Big Scary Thing And Just Incompetance. For Me The Real Harm Done Here Was To IT Pro,s Who Do Follow Protocols And Rules And Work Very Hard To Create Results Based On True Secure Enviroments, Advancing Science And Tech For All Of Us, But Thats Just Not A Newsworthy Thing, Doing What You Are Meant To, In The Correct Way Giving Results That Can Be Replicated And Confirmed By Other IT Pros And Then Published To Advance AI For A Greater Good. Yes AI Can Be Dangerous But This Is Not One Of Those Skynet Terminator Kind Of Things, More A Badly Set Up Experiment That Was Always Going To Do Exactly What The Developers Wanted ie.. Do A Task With A Set Of Tools Given To It, Internet Was Given, So The AI Used It, Not Secure At All. Every Industry Has Bad Employees, This One Is The Same.

You Keep Vigilant S, And Look After Those Close To You Mate.

Reply #25 Top
Quoting naroon1, reply 3996375

You Keep Vigilant S, And Look After Those Close To You Mate.

End of naroon1's quote

And you, I. Not that it will help, when it comes.