| CARVIEW |
Select Language
HTTP/2 200
date: Fri, 25 Jul 2025 07:16:03 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"9d1aa66ee168141fcce6ce03621fad18"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=KOb59E8CgfXkK4wtJ4Gog2B29eXoZU%2FGZJYRMc%2F35mfeYQ0LVcLUL45%2FrHsLlHc7jxQQs7fyKM%2FMe%2Fv2ATy4N09e6qDpyCMoSDFI7Ml95MCpZwcQHJM285NJpGZUmhdtmcmZsk7azCH%2Bt%2FqgGJhk%2FoLAV%2BRLhZ1DlGAqVMnAlRnKezq%2FvwxDHGyEyziLkCSBdeLp%2Fbc%2B6ir87aSzp6oew4yJQWHx4HL5cbqaM1EZfI%2BWKFMOl9QRsGqqtV0OzzoZTrvR%2Bk4XaLATuKJnIGeogQ%3D%3D--Xpm9P9SieS26ohoW--NppPNTSSclbhgvcJpUU6Cg%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.619974487.1753427762; Path=/; Domain=github.com; Expires=Sat, 25 Jul 2026 07:16:02 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Sat, 25 Jul 2026 07:16:02 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: B0EA:0A73:1EEE37:228809:68832F32
Tags · withcatai/node-llama-cpp · GitHub
Toggle v3.9.0's commit message
Toggle v3.8.0's commit message
Toggle v3.7.0's commit message
Skip to content
Navigation Menu
{{ message }}
-
-
Notifications
You must be signed in to change notification settings - Fork 136
Tags: withcatai/node-llama-cpp
Tags
v3.9.0
feat: reasoning budget (#468) * feat: reasoning budget * feat: SWA (Sliding Window Attention) support - greatly reduced context memory consumption on supported models * fix: prompt completion edge cases * fix: adapt to `llama.cpp` changes * fix: bugs * docs: generate an `llms.txt` file
v3.8.0
feat: save and restore a context sequence state (#460) * feat: save and restore a context sequence state * feat: stream function call parameters * feat: configure Hugging Face remote endpoint for resolving URIs * feat: Qwen 3 support * feat(`QwenChatWrapper`): support discouraging the generation of thoughts * feat(`getLlama`): `dryRun` option * feat: `getLlamaGpuTypes` function * fix: adapt to breaking `llama.cpp` changes * fix: capture multi-token segment separators * fix: race condition when reading extremely long gguf metadata * fix: adapt memory estimation to new added model architectures * fix: skip binary testing on certain problematic conditions * fix: improve GPU backend loading error description * fix: update gguf types * fix: performance improvements * docs: update the awesome list * docs: solutions to more CUDA issues
v3.7.0
feat: extract function calling syntax from a Jinja template (#444) * feat: extract function calling syntax from a Jinja template * feat: Full support for Qwen and QwQ via `QwenChatWrapper` * feat: export a `llama` instance getter on a model instance * fix: better handling for function calling with empty parameters * fix: reranking edge case crash * fix: limit the context size by default in the node-typescript template * fix: adapt to breaking `llama.cpp` changes * fix: bump min nodejs version to 20 * fix: better husky setup * fix: `defineChatSessionFunction` type * docs: troubleshooting function calling when using `JinjaTemplateChatWrapper` * docs: fix the command to scaffold a new Electron project * docs: debugging a native crash on Linux * test: make `LlamaText` snapshots more readable * chore: update modules
PreviousNext
You can’t perform that action at this time.