Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
withcatai/node-llama-cpp has 2,068 GitHub stars.
It currently ranks #29397 daily, #29843 weekly, #31594 monthly by momentum on Trending Repos; its best-ever rank is #4815.