☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 1 month agoThe circle of lifelemmy.mlimagemessage-square14linkfedilinkarrow-up1244arrow-down18cross-posted to: programmer_humor@programming.dev
arrow-up1236arrow-down1imageThe circle of lifelemmy.ml☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 1 month agomessage-square14linkfedilinkcross-posted to: programmer_humor@programming.dev
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up4·1 month agoATLAS has some benchmarks in the repo, and it’s comparable to opus 4.6, you don’t actually even need 128gb model for that. An 8 bit quantized model will run with around 32gb and still perform quite well.
ATLAS has some benchmarks in the repo, and it’s comparable to opus 4.6, you don’t actually even need 128gb model for that. An 8 bit quantized model will run with around 32gb and still perform quite well.