Today I learned about https://github.com/Arthur-Ficial/apfel , a command-line tool to talk to the Apple FoundationModels that run locally on Macs. 4k tokens on MacOS 26, 8k on MacOS 27. Also https://github.com/scouzi1966/maclocal-api for an OpenAI API, can run other models (like Qwen).