It's possible to run models locally, fidget with temp etc
Being able to change other things on the fly like identify weights most used for a prompt and just changing those to see what happens is much harder.
I've tried both LLMS and image generators on my machine locally and while it's gotten in easier it's a long task just setting up. Especially if you run into driver issues.
It's possible to run models locally, fidget with temp etc
Being able to change other things on the fly like identify weights most used for a prompt and just changing those to see what happens is much harder.
I've tried both LLMS and image generators on my machine locally and while it's gotten in easier it's a long task just setting up. Especially if you run into driver issues.