ray@lemmy.ml to Technology@lemmy.mlEnglish · 5 months agoMozilla roll out first AI features in Firefox Nightlyblog.mozilla.orgexternal-linkmessage-square33fedilinkarrow-up149arrow-down15cross-posted to: firefox@lemmy.mltechnology@lemmy.world
arrow-up144arrow-down1external-linkMozilla roll out first AI features in Firefox Nightlyblog.mozilla.orgray@lemmy.ml to Technology@lemmy.mlEnglish · 5 months agomessage-square33fedilinkcross-posted to: firefox@lemmy.mltechnology@lemmy.world
minus-squareCaptain Janeway@lemmy.worldlinkfedilinkarrow-up8·5 months agoWell I’m guessing they actually did testing on local AI using a 4GB and 8GB RAM laptop and realized it would be an awful user experience. It’s just too slow. I wish they rolled it in as an option though.
minus-squareGolfNovemberUniform@lemmy.mllinkfedilinkarrow-up5·5 months agoThey wanted to use fast small language models, not LLMs like Llama
minus-squaresuoko@feddit.itlinkfedilinkarrow-up1·5 months agoLlamafile with tinyllama model is 640mb. It could be a flag to enable or an extension
Well I’m guessing they actually did testing on local AI using a 4GB and 8GB RAM laptop and realized it would be an awful user experience. It’s just too slow.
I wish they rolled it in as an option though.
They wanted to use fast small language models, not LLMs like Llama
Llamafile with tinyllama model is 640mb. It could be a flag to enable or an extension