CARVIEW |
Select Language
HTTP/2 200
date: Wed, 23 Jul 2025 09:59:02 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"c5a3a1238a35bede721ec563859eeb5a"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=8Abtk%2FA3k%2BRvvvFH7VQrMp407h2E8cwnwCuuoSHlZYiIwGE0CRD5etHbMXKbzAdVmfinXYFrjpty%2F93BHTXVdMWu68%2F5LNEYAcw%2BJP3H1eekGHaAwN4RiGRS6BS946s%2F3haNLNmNoaRolr%2BidAel1X3uBqjLX6Gc74pQcBCBgyAiBZ%2FHYpfRPya7bWub4azmMfcHyZ%2BP5ceAkPgeiaPl7QG1awpAz73I293XYpE20xFihdmbC0V1kSskSR5ngmlimGeCJvHddnyN%2FtKgCnCn%2Bg%3D%3D--0eO%2FlglXeyVqDQrh--jTz90VuXW1BlWo4xYJygxQ%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1412955873.1753264741; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 09:59:01 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 09:59:01 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: 923E:1C6D98:8B93FD:A9F164:6880B265
Release GPTQModel v0.9.9 · ModelCloud/GPTQModel · GitHub
Loading
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 99
GPTQModel v0.9.9
Compare
·
1114 commits
to main
since this release
519fbe3
This commit was created on GitHub.com and signed with GitHub’s verified signature.
What's Changed
Added Llama-3.1 support, Gemma2 27B quant inference support via vLLM, auto pad_token normalization, fixed auto-round quant compat for vLLM/SGLang.
- [CI] by @CSY-ModelCloud in #238, #236, #237, #241, #242, #243, #246, #247, #250
- [FIX] explicitly call torch.no_grad() by @LRL-ModelCloud in #239
- Bitblas update by @Qubitium in #249
- [FIX] calib avg for calib dataset arg passed as tensors by @Qubitium, @LRL-ModelCloud in #254, #258
- [MODEL] gemma2 27b can load with vLLM now by @LRL-ModelCloud in #257
- [OPTIMIZE] to optimize vllm inference, set an environment variable 'VLLM_ATTENTI… by @LRL-ModelCloud in #260
- [FIX] hard set batch_size to 1 for 4.43.0 transformer due to compat/regression by @LRL-ModelCloud in #279
- FIX vllm llama 3.1 support by @Qubitium in #280
- Use better defaults values for quantization config by @Qubitium in #281
- [REFRACTOR] Cleanup backend and model_type usage by @LRL-ModelCloud in #276
- [FIX] allow auto_round lm_head quantization by @LRL-ModelCloud in #282
- [FIX] [MODEL] Llama-3.1-8B-Instruct's eos_token_id is a list by @CSY-ModelCloud in #284
- [FIX] add release_vllm_model, and import destroy_model_parallel in release_vllm_model by @LRL-ModelCloud in #288
- [FIX] autoround quants compat with vllm/sglang by @Qubitium in #287
Full Changelog: v0.9.8...v0.9.9
Assets 2
1 person reacted
You can’t perform that action at this time.