Building out local AI

Written by

in

ollama, nemotron 3 nano and webUI with python-env.

Current job downloading installing configuring and local hosting.

Will update with progression report as and when.

(note this is a bit of a throw away project as its a bit of a voyage of discovery I got a funny feeling this might not work out too good as ive only got 8gb NVIDIA GPU and the model is a 24gb model.)

Time taken – around 3 – 4 hours.