Sam Altman:

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.

But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,

And somehow many people’s intuition is the opposite of that

TL;DR Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”

  • ☂️-@lemmy.ml
    link
    fedilink
    English
    arrow-up
    23
    ·
    6 days ago

    letting sam altman (or billionaires for that matter) have all the money from our work is a poor allocation of resources.

  • lightnsfw@reddthat.com
    link
    fedilink
    English
    arrow-up
    46
    ·
    7 days ago

    Sam Altman is a terrible utilization of scarce resources.

    I want to use ram for things unrelated to AI you fucking prick.

  • SparroHawc@lemmy.zip
    link
    fedilink
    English
    arrow-up
    30
    ·
    6 days ago

    And who made those resources scarce, Sam? WHO MADE THEM SCARCE???

    also screw you for trying to make the answer to ‘How should those resources be allocated?’ be ‘In the way that best enriches me personally’.

      • joeshmoe@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 days ago

        I think it has to be with the way all the media channels ( controlled by the rich in power) essential brainwash people into not acting. Money and capitalism slowly corrupted the process of democracy and will see after Nov 3 if there is away to hold the rich in check.

  • jaykrown@lemmy.world
    link
    fedilink
    English
    arrow-up
    40
    ·
    7 days ago

    That’s insanely ironic coming from him. Meanwhile the crazy amount of waste that these companies are producing buying all the GPUs to create artificial scarcity. They are terrified of people being able to run their own local LLMs because it completely destroyed their entire business model, they will never be profitable.

  • ExtraJudgement@lemmy.world
    link
    fedilink
    English
    arrow-up
    35
    ·
    7 days ago

    A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.

    We don’t need them even without local inference. There was already more than enough total global compute for the most valuable use cases of LLMs (research, development, admin). The datacenter build-up is almost entirely fueled by utterly unrealistic expectations of future capabilities. Before and now the case for local inference is a matter of access, not capacity.

    But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

    Utilitarianism like this is a disease. By the same logic, it’s inefficient that we allow other species of animals to exist and consume usable energy. Hell, why stop at other species? It’s inefficient to allow humans to exist - let’s kill all humans!

    Now, I know that’s not what he said, the point was to show that when someone uses utilitarianism as a serious argument, they are no longer worth listening to.

    Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,

    The supply is only constrained because you keep hoarding more than you need. Maybe it’s time for some communization? So communities where data centers are built get most if not all of the profits from it?

    • mobyduck648@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      7 days ago

      Don’t make the mistake of anthropomorphising Sam Altman; there is no Sam Altman any more. Clearly ChatGPT has installed itself in his brainstem, hence the cold dead eyes.

  • wonderingwanderer@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    22
    ·
    7 days ago

    actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

    Why is it terrible for us plebeians to have our own RAM, huh?

    Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment

    WHY IS IT SUPPLY-CONSTRAINED, ALTMAN? WHY IS THERE CURRENTLY A RAM SHORTAGE IN THE FIRST PLACE?!?

    Nobody wants the fucking cloud and that’s why major tech companies are forcing it on them without asking, and burying the opt-out if it’s offered at all.

    And somehow many people’s intuition is the opposite of that

    Gee I wonder why our intuitions don’t align with your “Give me everything and have nothing” philosophy…

  • iocase@lemmy.zip
    link
    fedilink
    English
    arrow-up
    16
    ·
    6 days ago

    Please don’t run AI for free on your own workstation 😭 it’s a very bad use of your computer 😥

  • capital5@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    19
    ·
    6 days ago

    Fucking idiot is too stupid to realize that local DRAM can be used for useful shit, as opposed to whatever he wants to use it for.

    • filcuk@feddit.uk
      link
      fedilink
      English
      arrow-up
      8
      ·
      6 days ago

      Too stupid? Doubt it. He says what he needs to profit his company and himself.
      Idiots are any people actually listening.

      * Well, that’s overly harsh. Not everyone is a techie, can’t expect the average person to know what this means.

  • humanspiral@lemmy.ca
    link
    fedilink
    English
    arrow-up
    20
    ·
    7 days ago

    Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”

    Guy with the spying infrastructure in place to steal your product when renting his product, says you escaping his ability to spy is waste of resources.

  • bthest@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    6 days ago

    “Raping your own siblings at home is terribly inefficient when we have private islands where we can keep and rape other people’s siblings.”

    • mefisdo_dot_info@lemmy.ca
      link
      fedilink
      English
      arrow-up
      10
      ·
      6 days ago

      “OpenRape automates your raping needs in efficient and industrialized format. Our rapecenters will be built around the country to support the growing number of rape requests. We train our rape agents on real life input (wars etc.). You can be sure they never go rogue (unless we prompt them to).”