CARVIEW |
Select Language
HTTP/2 200
date: Tue, 22 Jul 2025 23:40:06 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"1b4729098971779f1fc0273f02bbd9ab"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=KYh9AzE%2FBPYRGspdr18ewp%2BdPjyyqDBhimHM%2BRelPqFQxmPrtKirEz62nNaMtBa1h0eGG3ex%2FyQHdHXEvcDPapr%2FuJmdAbxpiuJRBBBLmR9%2F7n%2BlFiP2iT%2F%2BmDR6AKK8yxcL9zZFmApFjgnWcMZTJeR4cvOdUzHTJOmEIVvvaKgJvhKobNkJAT%2BsHUFk%2FtCipaiIhSv1PJ50KkA%2FOvdMjioFC%2FO6V9UrmcWF%2FixV8pT6jrp3FErGwSjRSk9xBiLu8yGTWZasex%2BW5Jjv%2ByDt8w%3D%3D--dqRHEex94xx7XdOP--9khY%2F15%2Bma8o1%2F7ITU70SQ%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1252041740.1753227606; Path=/; Domain=github.com; Expires=Wed, 22 Jul 2026 23:40:06 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Wed, 22 Jul 2026 23:40:06 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: 8A14:3B93B0:1CE901:27C4C1:68802156
Release GPTQModel v1.8.1 · ModelCloud/GPTQModel · GitHub
Loading
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 99
GPTQModel v1.8.1
Compare
·
283 commits
to main
since this release
63499e1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
What's Changed
⚡ DeekSeek v3/R1
model support.
⚡ New flexible weight packing
: allow quantized weights to be packed to [int32, int16, int8]
dtypes. Triton and Torch kernels supports full range of new QuantizeConfig.pack_dtype.
⚡ Over 50% speedup for vl
model quantization (Qwen 2.5-VL + Ovis)
⚡ New auto_gc: bool
control in quantize()
which can reduce quantization time for small model with no chance of oom.
⚡ New GPTQModel.push_to_hub()
api for easy quant model upload to HF repo.
⚡ New buffered_fwd: bool
control in model.quantize().
🐛 Fixed bits=3
packing and group_size=-1
regression in v1.7.4.
🐛 Fixed Google Colab install requiring two install passes
🐛 Fixed Python 3.10 compatibility
- Flexible Pack DType by @Qubitium in #1158
- cuda needs to declare pack dtypes by @Qubitium in #1169
- fix pass pack dtype by @Qubitium in #1172
- Pass dtype by @Qubitium in #1173
- move in/out features and grop_size init to base by @Qubitium in #1174
- move self.maxq to base class by @Qubitium in #1175
- consolidate pack() into packer cls by @Qubitium in #1176
- Add
pack_dtype
to dynamic config and fix validate by @Qubitium in #1178 - Refract 4 by @Qubitium in #1180
- Refractor and simplify multi-kernel selection/init by @Qubitium in #1183
- Update/Refractor Bitblas/Marlin/Cuda by @Qubitium in #1184
- push bitblas logic down by @Qubitium in #1185
- Revert Bitblas to 0.0.1-dev13 by @Qubitium in #1186
- Do not export config.key if value is None by @Qubitium in #1187
- Fix examples/perplexity by @Qubitium in #1191
- [MODEL] add deepseek v3 support by @LRL-ModelCloud in #1127
- Push register buffer down to base class and rename all in/out features by @Qubitium in #1193
- Fix #1196 hf_transfer not accepting
max_memory
arg by @Qubitium in #1197 - reduce peak memory and reduce quant time by @Qubitium in #1198
- skip zero math by @Qubitium in #1199
- fix test_packing_speed by @Qubitium in #1202
- Update test_quant_time.py by @Qubitium in #1203
- experimental
buffered_fwd
quantize control by @Qubitium in #1205 - Fix dynamic regression on quant save by @Qubitium in #1208
- Python 3.10 type-hint compt bug by @Qubitium in #1213
- Fix colab install by @Qubitium in #1215
- add
GPTQModel.push_to_hub()
support by @Qubitium in #1216 - default to 8GB shard-size for model save by @Qubitium in #1217
- Auto gc toggle by @Qubitium in #1219
- fix 3bit packing and inference by @Qubitium in #1218
- fix merge error by @CSY-ModelCloud in #1234
- fix var name by @CSY-ModelCloud in #1235
- fix visual llm slow forward by @LRL-ModelCloud in #1232
Full Changelog: v1.7.4...v1.8.1
Assets 52
You can’t perform that action at this time.