I’ve been playing with the LM Studio REST API v1 using Ruby and Faraday to communicate with the local server – it’s a great system and I’ve had fun creating feedback loops where the LLM reacts to its own creations.
I’ve found IBM Granite Tiny to be a great LLM to play with on a laptop – very fast and decent responses.
I still need to try all the various JSON properties you can embed in the request and examine all the details of the response object.