• simple@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    This is cool and all but all these AI hype demos always show something extremely simple and overdone in the training data. Reminds me of those ChatGPT videos where someone writes “make me Pong in javascript” and gets surprised that it does despite the fact that it probably trained on 100,000+ Pong in Javascript scripts.

    Yes, it made Breakout, very cool. Now ask it to do something new or make a game that’s more complicated than a game that’s been remade a million times. LLMs are very far away from making real games.

    • mindbleach@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      This is a testable hypothesis.

      Make up some new game - doesn’t have to be good or terribly unique, just novel enough to have negligible prior art - and see if the robot does the thing.

        • mindbleach@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I’m not the one playing ‘AI is whatever hasn’t been done.’

          I’m thoroughly familiar with how these technologies work and their present shortcomings. This guy is joking when he says programming is over. But it doesn’t take a diehard fanboy to acknowledge that this was impossible a year ago, and is getting more democratized as it gets more capable, and it is getting more and more capable.

          • nanoUFO@sh.itjust.worksM
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            democratized as it gets

            Eh openAI and co would really rather this be regulated very very hard and for all training data to not be accessibly anymore like it was in the past.

            • mindbleach@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              They can try.

              Not like a corpus of published text is big data or privately held.

              Not like anyone training porn robots on booru tags gives a shit about copyright.

              Not like any model that’s been released can be put back in the bottle.

              OpenAI is struggling right now because they’ve realized they can’t afford to be centralized and they can’t compete at being decentralized. If big-iron approaches are truly more capable - they lose to Google. If advancements keep coming from rando engineers dropping whitepapers with stupid acronyms - they lose to everybody.

              Personally, I’m betting on a grab-bag of Asian surnames and LLaLLeLLuLLemon.