Run LLMs Locally with Docker: A Quickstart Guide to Model Runner docker.com 3 points by homarp 7 days ago
kristianp 7 days ago This is part of docker desktop on MacOS.> Now available in Beta with Docker Desktop 4.40 for macOS on Apple siliconAlso provides an api endpoint.
discussion here https://news.ycombinator.com/item?id=43643944
This is part of docker desktop on MacOS.
> Now available in Beta with Docker Desktop 4.40 for macOS on Apple silicon
Also provides an api endpoint.
it uses llama.cpp