inari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 24 days agoPirate Face - a Pirate Bay for LLMspirateface.coexternal-linkmessage-square60linkfedilinkarrow-up1220arrow-down122 cross-posted to: localllama@sh.itjust.worksaidiscussion@lemmy.dbzer0.comhackernews@lemmy.bestiver.se
arrow-up1198arrow-down1external-linkPirate Face - a Pirate Bay for LLMspirateface.coinari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 24 days agomessage-square60linkfedilink cross-posted to: localllama@sh.itjust.worksaidiscussion@lemmy.dbzer0.comhackernews@lemmy.bestiver.se
minus-squareCethin@lemmy.ziplinkfedilinkEnglisharrow-up5arrow-down1·22 days agoMost consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand. I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
minus-squarenilloc@discuss.tchncs.delinkfedilinkEnglisharrow-up2arrow-down1·22 days agoI could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.
Most consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand.
I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
I could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.