Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!
Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!
Would you please talk more about it. I forgot about Open-webui, but intending to start playing with. Honestly, what do you actually do with it?
I have Linkwarden pointed at my ollama deployment, so it auto tags links that I archive which is nice.
I’ve seen other people send images captured on their security cameras on frigate to ollama to get it to describe the image
There’s a bunch of other use cases I’ve thought of for coding projects, but haven’t started on any of them yet
I have the same setup, but its not very usable as my graphics card has 6gb ram. I want one with 20 or 24, as the 6b models are pain and the tiny ones don’t give me much.
Ollama was pretty easy to set up on windows, and its eqsy to download and test the models ollama has available