Dehydrated@lemmy.worldcake to Programmer Humor@programming.dev · 10 months agoNormal day in the life of a developerlemmy.worldimagemessage-square41fedilinkarrow-up1822arrow-down125
arrow-up1797arrow-down1imageNormal day in the life of a developerlemmy.worldDehydrated@lemmy.worldcake to Programmer Humor@programming.dev · 10 months agomessage-square41fedilink
minus-squarelunachocken@lemm.eelinkfedilinkarrow-up2arrow-down1·10 months agoHave a look at llama file models they’re pretty cool, just rename to xxx.exe and run on windows and chmod on Linux. Though the currently supported ones are limited, you could try llama code.
minus-squaremoonpiedumplings@programming.devlinkfedilinkarrow-up2·10 months agohttps://llamafile.ai (though it’s down for the moment) https://github.com/Mozilla-Ocho/llamafile Lot’s of technical details, but essentially the llamafile is a engine + model + web ui, in a single executable file. You just download it and run it and stuff happens.
Have a look at llama file models they’re pretty cool, just rename to xxx.exe and run on windows and chmod on Linux.
Though the currently supported ones are limited, you could try llama code.
Where do you get it? Hugging face?
https://llamafile.ai (though it’s down for the moment)
https://github.com/Mozilla-Ocho/llamafile
Lot’s of technical details, but essentially the llamafile is a engine + model + web ui, in a single executable file. You just download it and run it and stuff happens.
Thanks!