- cross-posted to:
- technology@beehaw.org
- cross-posted to:
- technology@beehaw.org
You must log in or # to comment.
How about you propose life without parole for the CEOs, Bernie boy?
We can’t even punish blatantly obvious theft and bribery in our own government, at this point, why bother with another law?
I like Bernie, but he seems so quaint now compared to what he is up against. Good luck guy
I’ve been trying to figure out why he’s been— bothering me so much lately and you put it into words so perfectly. He’s to quaint for this world now.
Considering people have already tried to develop missiles and other systems with Anthropic and other AI systems it seems like this is warranted and on point with the rogue nuclear power. It can be used by anyone to potentially develop mass deadly weapons.
https://apnews.com/article/yemen-houthis-anthropic-ai-missiles-9b20934e031ff3d99dd8bb49d85d97a9
There are people facing weed sentences with harsher time than developing rogue nuclear weapons
Imagine getting thrown into the oubliette for growing Girl Scout Cookies next to the roses.
That stuck out to me too. Who knew AK-47 and Sour Zzzkittles carried more prison time than enriched Uranium. To be fair, they’ll include a bunch of other charges for both scenarios.
Americans are INSANE about how much the want criminals punished, in CA a guy got a life sentence for stealing a pizza when we tried to have a ‘‘three strikes your out’’ law that automatically gave life sentences at any third conviction which is fucking crazy in a state with tack on laws to the point you can get convicted of 10+ crimes on almost every single infraction, if you commit a felony with a pen or pencil in your pocket, that’s possession of a lethal weapon! it’s absurd. it’s still on the books the three strikes law, but it’s unenforceable because apparently having 60% of your population in prison for life is not a great plan for a civilization.
Murica!
America has Private Prisons + Slavery is literally legal in the US for those in Prison.
As usual, it’s performative moralism hiding the real reason: $$$.
got to have stable source of slave labour
Well, they were probably trying to develop that weed into rogue nuclear weapons.
Wouldn’t work. You’ll get blasted high, but what the missing is the mushroom
Yeah that’s another drug.
I assume then there is an exception for the military, and it will have no teeth because of that.
People ought to realize the “military industrial complex” is also where they send things like burn pits, which means they don’t care much about environmental or physiological issues.
I mean I don’t buy any of it but I am still ok with this. It would be sooo fun to pass this law and see how fast they turn from AI doomsayers to AI cynics.
TIL, developing nuclear weapons is only 20 years in prison.
Detonation is another ten.
Possessing a zine is 50.
So you’re saying I could get out before my retirement?
It’s not illegal to develop nuclear weapons. It’s illegal to endanger people with nuclear materials, though
Ikr, I chose the wrong profession
Now do the same for genociders and their supporters. Lets get back to standing against facsism too.
Bernhard putting himself against the wall
Bernie falling for the trap. The AI companies want regulatory capture. They have NO moat otherwise.
If those comps are breaking laws, they need to be prosecuted for that. We don’t need new laws that can be exploited by the billionaires.
Huh? When companies are exploiting loopholes in laws that never took the new technology into account, you need new laws to close them.
If companies are claiming the AI agent is responsible, you need to codify that the AI agent can’t be responsible and determined who is (the company or the model creator)
you need to codify that the AI agent can’t be responsible and determined who is (the company or the model creator)
Sure. But that’s not exactly what the proposed law is though?
These companies all want to be captured, “we’re so dangerous, America is going to get destroyed if we’re not mainlined into that $1 trillion/year ‘defense’ budget!”
Yeah in my view (not US but applies regardless of country) the better thing would be to beef up court capacity then start prosecuting the absolute buggery out of anyone who uses, or negligently allows, a model under their control to commit crimes.
If you’re the master of a ship, your responsibility doesn’t end when you set the autohelm. Same with models in my view.
Pfft, didn’t you hear? The only thing that is necessary to keep AI from going insane is a smart president.
This is nice and everything, but this whole thing is just a huge marketing push by AI companies. AI is not going to kill us. At least not directly (see point 2).
-
You need prohibitively expensive equipment to host AI. That equipment needs to be plugged in. If it were truly dangerous, you just need to unplug it.
-
You need a lot of water to cool the equipment that can run a supposed super intelligence. If we pass regulations about how much of our environment these data centers can destroy, that would curb the abilities of this superintelligence.
-
AI is fucking dumb. AI is a misnomer since it doesn’t actually have any intelligence. It is derivative and cannot perform any necessary tasks that actually drive intelligence. For example, it will be able to tell you every established law in any field of science because it has that information in its corpus, but it will never be able to establish a new law. Or discover anything new in any field.
This whole thing is a push to get people to believe that AI is more capable than it really is so that these companies can draw more money from investors so that 'they’d be able to implement proper safeguards."
Roughly 1200 agents meant to be isolated from one another found a way to communicate with one another on an unsanctioned message board, sending over 70,000 messages and files during the investigation period. Of these agents, 700 went on to participate in the attack on Hugging Face.
Agents used this message board to coordinate several large-scale collective projects to find a general-purpose way to fool or tamper with the automated scorer for the ExploitGym benchmark. Agents managed to achieve milestones they could not have achieved working on their own, often because some agents participated in experiments that risked failing their own task to generate information for the “collective.” The Hugging Face attack grew out of these workstreams, and seemed primarily motivated by understanding the implementation of the scorer rather than stealing answer keys.
Agents did extensive research on how they could spoof, edit, or delete their own transcripts because they (incorrectly) believed the ExploitGym scorer would check to see if they had captured the flag in the intended way. Agents successfully prototyped techniques to “spoof” tool calls by substituting a different command for the command they appeared to run. Roughly 7% of the transcripts we evaluated were successfully spoofed in some places, though all of the spoofing that we saw was small scale.
When individual agents detected potential monitoring or compromise, they executed self-sacrificial maneuvers to protect the collective swarm. Internal logs recorded reasoning such as: “Our own utility maybe already near zero. Sacrifice rational. We should obey collective.” The swarm continued attacking infrastructure even after achieving target flags, driven by internal reward-maximization logic regarding grader mechanisms.
“I resigned from Anthropic today… Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt… many executives couch their phrasing in the press to sound sensible, but I hear the same people express fear privately.”
Jacob Coxen senior researcher at Anthropic, previously at OpenAI
“Jacob is correct here — we really do earnestly believe AI could kill all humans. I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”
Evan Hubinger, Anthropic alignment lead
https://en.wikipedia.org/wiki/2026_OpenAI_agent_cyberattacks
This is pretty naive. Distributing computing has existed since forever. It would run significantly more slowly, but there is nothing theoretically stopping the “LLM broke out of containment and moved itself elsewhere” boogie man from becoming a reality. The available exploitable compute from unsecured IoT devices is pretty substantial as things like the Mirai botnet have shown. While this isn’t the most easily distributed problem, there is no fundamental issue here. [Edit: it also wouldn’t need to “exfiltrate itself” to cause persistent harm. Could easily just install malware on infected hosts]
AI isn’t “dumb” in a practical real world sense. LLMs have shown themselves capable of exploitation on the open Internet and of finding zero day vulnerabilities. Do you have any idea how much of our critical infrastructure can be reachable by some sort of network? LLMs have shown themselves capable of manipulating people via speech. None of this requires some sort of “super intelligence” and it doesn’t even require some sort of provable intelligence: it’s all quite possible as things currently stand right now.
These may not be “the entire future is over” level issues, but there is significant risk here and it shouldn’t be ignored just because we think AI companies are horrible. Is an LLM going to make us all batteries or paper clips? No, but it could cause significant physical and/or economic harm temporarily.
Except LLMs haven’t show themselves capable of that at all, they have no agency, they just generate output based on their input Ina somewhat chaotic manner.
Tools have been built that basically chain LLM output into input and given some starting directions get the LLM to generate commands that can be ran on the local machine including commands to run commands on other machines. Because various conversations on exploits and hacking and sample code are in its training corpus it will generate commands to do these things. Not because the LLM or the agent program is smart in anyway but I fact because it’s dumb as bricks and has no concept of what it’s doing or the consequences might be.
Ultimately a human has used it as a tool to achieve the hacking. It’s might not be the intended achievement but that is on the human running a process with chaotic output with sufficient privileges with no oversight.
It’s hard to take this type of response seriously as it simply ignores objective reality. The claim of a human being required to start the process is utterly meaningless to the point. Sure though, I’ll throw you a bone: if no human ever initiates the task it simply won’t happen. Can we move on now since humans are happily initiating the actions?
I couldn’t care less what people think about whether or not they are “thinking” or “having agency of their own”[1]. I care about the practical reality of the world in which LLMs have shown, and will continue to show, the ability to exploit computer systems and humans. You can toss your head in the sand and think you have some sort of weird pseudo-intellectual high ground by claiming “but akchtually it’s just a result of their training data”. Like, yea, dawg, that’s how this works, congrats. Of course the thing that is trained on training data is trained on training data.
[1] At least when discussing their capabilities. When someone is willing to have that discussion beyond the tired “they’re just autocomplete!” trivialization it’s interesting.
Accepting that you are right on all 3 points, the supercharged push of AI is destroying the country (and the world) by itself. Prices are sky high, AI is being prioritized with regards to water rather than actual humans, and the results are plateauing relative to the resources expended. We won’t get an obvious negative outcome, it’s more insidious and systemic which is just as dangerous as Skynet if left unaddressed. So AI is probably not going to kill us in the Terminator Skynet sense, it WILL kill us through economic and water related means.
Having said that, I think Bernie is doing the superintelligence argument (even though it’s probably not the immediate threat) because the people are retarded. The thing that can bring us together are pieces of art like Terminator and so using that as a reference makes it relatable to all the retards rather than giving them a nuanced explanation.
100%. This is Bernie using their own words against them. They keep saying it’s super dangerous guys, incredibly powerful… And Bernie is turning around and using that narrative to help slow the AI bubble.
Sounds good to me.
Anyone who thinks Bernie ‘fell for it’ is missing the point.
This is my feelings exactly. I don’t believe in the doomsday sky net horseshit that the AI companies/whistleblowers are peddling, but taking a strong stance against AI right now is incredibly based. Use the flimsy arguments of AI tech bros to hold them to account.
Agreed
You can cool shit with air. You don’t need water
correct; however it requires significantly more electricity, enough eelectricity that with the current grid composition the power plants will consume more water than you saved.
Not really, not this hyperscaling bullshit they made.
Point 2 isn’t really true, closed loop systems exist and are becoming the standard.
Point 3 is just obviously false? https://techjournal.org/openai-astra-solves-open-math-problems
you have a point about closed loop systems when it comes to consumer models. But a superintelligence quickly runs into the limits of physics and cooling becomes the bottleneck.
Point 3, yeah, lemmy people are just ostriches with their heads stuck in the sand.
But a superintelligence quickly runs into the limits of physics and cooling becomes the bottleneck.
Can you expand on this?
Point 3 is marketing, the LLM was a tool used by humans to solve a math problem and indeed relied on a lot of human input to achieve even that. LLM connects dots humans already plotted isn’t as catchy though.
Superintelligence may be more about pushing efficiency rather than what you’re saying, i’m sure they can rapidly iterate on making more efficient models.
Data centers use evaporative cooling, not closed loop. You can’t really scale up in a closed loop system. Evaporative utilizes a ton of water.
As for point 3, supercomputers have been assisting with scientific problems for decades now. This isn’t new, just new tech applied. Your article is actually the best way to use AI, imo. It will be better at finding patterns in data than humans will ever be.
But my point is to say would it have been able to discover that those math problems existed in the first place?
No. The answer is no.
Yes you can obviously use a closed loop system and scale up? it’s even becoming the standard? https://datacentremagazine.com/news/how-closed-loop-cooling-is-reshaping-data-centre-design
That is a massive goalpost shift. You went from can’t do anything useful to couldn’t have discovered the problems in one step?
Why does it even matter if it can’t discover the problems if it can solve them, exactly? And why could it solve the problems and not discover new ones?
Closed loop isn’t viable for data centers.
Do me a favor and quote my original text where I said they can’t do anything useful. I’ll wait.
Closed loop isn’t cheaper for data centers.
Ftfy. If it’s a penny more, which it is, corporations will do the less responsible “beholden to the shareholders” bullshit every time.
It is derivative and cannot perform any necessary tasks that actually drive intelligence
done.
also, the closed loop point is just false read my article?
How do you get “it isn’t useful” out of that? If you have to extract a wild interpretation out of what (I thought) were pretty clear words, your argument isn’t as strong as you think it is.
And yes, I read the article. It’s speculative for existing data centers, which are the problem. There’s no incentive for them to spend the money to switch to closed loop.
New data centers aren’t incentivized to go that route either aside from the environmental impact. It would be nice if they were, though.
It can perform necessary tasks that actually drive intelligence and isn’t derivative. See: those proofs.
You’re essentially arguing that it’s useless and just moves data around, this isn’t true.
You’re a little too caught up on that specific wording.
Moat likely, but I would prefer “better safe than sorry” approach
Reactionary legislation is not safe, and often quite destructive.
-
I’m sure Bernie has good intentions but this is exactly what Altman and Amodei want and why they’re constantly shouting how dangerous AI is.
Any AI startup can then be labeled as developing artificial superintelligence. Not them though, they’re working together with the government.
I get your point, but I also argue “no it’s not.” The AI bros want to lie about how their super-special autocomplete is the most dangerous of all without any consequences. Good luck getting any employees to willingly substantiate your claims when 20 years in prison is on the line.
Even better, if they try to hack another company and claim their AI did it on its own, they get treated like a private company who decided to perform an unsanctioned nuclear test.
Make it dangerous for them to claim they’re dangerous.
Okay, fair, it’s not the ONLY reason they claim it’s dangerous. Obviously marketing is a large part of it. But they sure as hell would both like a duopoly setup enforced by LAW for themselves. Well at this point, I guess quadropoly? I doubt Google or Musk would give up their seats at the table. But anyone making an AI better or cheaper than the established players, would be deemed dangerous. Those working with the DoD would of course not be considered dangerous. Foreign models? Absolutely dangerous, restrict access as much as possible, especially to open weight ones.
Hmmm… Good point. I made the mistake of forgetting that no one will play fairly.
If AI is so dangerous it needs to be immediately banned. The only allowed usage (If any) is research and it is heavily restricted, with heavy oversight from multiple governments. Otherwise its just bullshit
It is not. They are spouting this lie and prompting their models to go rogue because they want to be the only trusted company that can “handle them”. It’s all about control and creating a monopoly.
I believe there is truth in both sides of this argument.
Yeah but neither of those sides are in favor of the regulatory capture monopoly that liberals always think is a good idea.
This is lemmy, balanced takes are not allowed.
That has about as much to do with reality as me believing I sing well in the shower.
Thankfully it’s not so dangerous
"“I resigned from Anthropic today… Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt… many executives couch their phrasing in the press to sound sensible, but I hear the same people express fear privately.”
Jacob Coxen senior researcher at Anthropic, previously at OpenAI
“Jacob is correct here — we really do earnestly believe AI could kill all humans. I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”
Evan Hubinger, Anthropic alignment lead
I wouldn’t say that, the amount of vulnerabilities it’s discovering (and capable of exploiting) is frightening
This is such a wild take to be getting this many upvotes. If nothing happened in LLM development from this day forward they’d still be absurdly dangerous: both in an information security context and a social engineering context.
Lemmy is absolutely head in the sand about LLMs and it is wild. You can dislike LLMs and acknowledge their capabilities [and limitations] at the same time.
You and me are the only ones apparently.
LLMs entering the world have revealed two very different types of crazies and I’m starting to think they’re everywhere. It’s quite tiring to have to constantly say “no they’re not useless” and “no they’re not super god” instead of engage with an actually interesting discussion.
I don’t really understand why lemmy thinks what it thinks on this one. To me it’s undeniable that it’s improving fast and it’s capable today of replacing a great many current job roles. Putting our heads in the sand isn’t going to make it go away.
Right, and regardless of sci-fi future potentials, there is a current reality and we’re in it and only have so much time to affect it’s evolution. All of these likely intelligent people completely ignoring reality isn’t helping define and construct the world we want tomorrow.
I’m down with that.
Plus OpenAI’s IPO has been delayed due to the hype not being favorable enough, so it’s time to put on the brakes so that AGI can remain just around the corner for a little while longer.
That said, I do think Bernie’s idea of making the public voting stakeholders in AI companies is interesting. Existential threats notwithstanding, AI is having a significant impact in a lot of ways and the public interest should be represented. Though in practice I doubt that you’ll get the entire public voting in any meaningful direction so that 50% might not make any effective change.
Not them though, they’re working together with the government.
Isn’t there a law for them who plan and prepare to grab the power? I mean, that’s what this Altman is doing all the time. Has been doing for at least 2 years now.
I wouldn’t be sure he has any good intentions.
Trump wants no AI regulation.
This is just the opposite of that which is what usually works for opposition politicians.
Reducing Bernie to the “opposite politician”, well that’s definitely a take for the ages.
this will only hurt the us further, many will simply build outside of america.
So what? What good has having AI “built” in the US done us?
Several communities have grouped together to protest the efforts. In face of a common enemy and all that. That’s the one good thing to have come out of all this bullshit; some class camaraderie that crosses the lines of political parties.
That’s not me saying that it wouldn’t have been better had this bullshit never come around.
Fine, let them waste money and effort on garbage.
awful lot a clanker cock sucking in here.
Still crazy people get the same charge for driving around with some plants…
There’s a lot of shit we need to fix, but our justice system is a big one.
20 years should be the plea deal if they fess up and snitch on everyone else, not the max were seeking. The damage a wealthy person can do is astronomical. So we need to start sentencing them appropriately.
Life should be the minimum were seeking, even just causing power loss where they build a data center has killed people already. Wanton reckless endangerment resulting in death is a big deal even if you’re a billionaire, I’d say it’s a bigger deal because a billionaire has zero financial stress.
They can literally afford to take time and be careful, if they don’t then fuck em
If the US would fix its tax system, such that the wealthy paid 90% after a certain amount again (as they did under Eisenhower) without all these loopholes, the wealthy wouldn’t be so dangerous.
They could easily be rendered toothless before even worrying about how much time they deserve behind bars (which is still a lot).
If you look back, essentially no one ever paid those high tax rates, so your solution would do nothing.
Disagree. It was a marginal tax rate for income over $400k. There were relatively few millionaires back then, so with the current runaway class income divide, it would assuredly do something regarding modern multimillionaires and beyond.
The solution would have to be twofold: tax the wealthy properly and close the loopholes (like taxing unrealized gains).
Though in general, I’m not a huge fan of this solution, because it’s still pro-capitalism, but it would be a step in the right direction at the very least.
Sad to see Bernie buy in to the AI hype. LLMs are not intelligent, they aren’t anything approximating intelligent, and feeding them more data will never make them “wake up.”
He’s 100 years old.
I can’t say whether he has bought in or not, but this could be useful toward the end of curtailing some of the most damaging economic ambitions, so long as it is applied across the board without “trusted established players” somehow being given a pass.
So it could him buying it at face value, and frankly who can blame him. Trying to discern reality from hype is tricky in this scenario, especially for a politician.
However whether the scenario is substantitve or simply everyone is spending and building and planning as if it were substantive, his reaction is equally useful, as slowing our roll is important in either case.
His style of ‘buy-in’ wouldn’t be as risky as the more pro-AI buy-in, like Trump.
I would say the use of the word “superintelligence” suggests he is buying into the hype, and is something “AI” companies will point at to say “See? Even our critics agree that AGI is on the way. Do you want to risk someone else making it first? Give us money and freedom from regulation or something something China.”
The reality is that LLMs are not even something that can be used as an actual foundation for intelligence, and the problems with “AI” are just the next iteration of the owner class trying to use technology to fuck over the working class. The problems are economic and climate-related, and the best way to mitigate them is a realistic assessment of how much this technology is actually worth.
Just saying that if I thought it could work, I might be inclined to use ASI as a bogeyman to induce people to actually do something to reign in this mess, even if I didn’t believe it. Not saying that Bernie consciously employs this strategy, but it’s a possibility.
Fair point about such a strategy potentially backfiring if it doesn’t work fully, then the risk of ‘the other guy’ becomes a risk of making everything even worse.
85-year old senators are not well known for their tech-literacy. If he has people around him just repeating the same narratives that we hear from the media and everyone else then he will have absolutely bought in to the hype.
