CARVIEW |
Select Language
HTTP/2 200
date: Wed, 23 Jul 2025 00:08:30 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"48809a418991828d73086730669e2b6f"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: no-referrer-when-downgrade
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=ijP9LASIqkLGE6Tbm%2FsMs0dn8FCQA%2FQR2Yj%2FbXY52OVfzP2H%2BKXVzy5JadJreu0CKFmyK6zwU43phKCZ4NjRI2ADy3hSeMdFlguGuBcnN0FanipNKGJKEVnHiQwu5xb7ELhCMAB%2FwYTItL%2BlocihOS91C7VKI%2Bbup9%2FkVV7PyXr5pUMRrVNm0%2Bgw2Crz6ev%2FVncRaVSpG6smlF3dXbTBkykiDdNzN679uN%2BI2sfPt7TQ2BcPzyRnMA6%2BvA3aSTpG1Uc%2FGgNQtgrkuQRMy3NGHA%3D%3D--rXVXZvvHlO6nbqyy--iRWGg0p1CSp7o22GrnUJeA%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.1338853171.1753229310; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 00:08:30 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 00:08:30 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: DAE8:2DEF93:1EB077:2A753A:688027FE
Tags · EvolvingLMMs-Lab/lmms-eval · GitHub
Toggle v0.3.3's commit message
Toggle v0.3.2's commit message
Toggle v0.2.4's commit message
Skip to content
Navigation Menu
{{ message }}
-
Notifications
You must be signed in to change notification settings - Fork 343
Tags: EvolvingLMMs-Lab/lmms-eval
Tags
v0.3.3
[Fix] add more model examples (#644) * Update OpenAI compatibility script for Azure integration - Set environment variables for Azure OpenAI API configuration. - Modify model arguments to use the new GPT-4o model version and enable Azure OpenAI support. - Clean up commented installation instructions for clarity. * Refactor imports and clean up code in various utility files - Consolidated import statements in `plm.py` and `utils.py` for better organization. - Removed redundant blank lines in `eval_utils.py`, `fgqa_utils.py`, `rcap_utils.py`, `rdcap_utils.py`, `rtloc_utils.py`, and `sgqa_utils.py` to enhance readability. - Ensured consistent import structure across utility files for improved maintainability. * Update README and add example scripts for model evaluations - Revised installation instructions to facilitate direct package installation from Git. - Added detailed usage examples for various models including Aria, LLaVA, and Qwen2-VL. - Introduced new example scripts for model evaluations, enhancing user guidance for running specific tasks. - Improved clarity in environmental variable setup and common issues troubleshooting sections. * Update README to reflect new example script locations and remove outdated evaluation instructions - Changed paths for model evaluation scripts to point to the new `examples/models` directory. - Added a note directing users to find more examples in the updated location. - Removed outdated evaluation instructions for LLaVA on multiple datasets to streamline the documentation. * Update README to reflect new script locations and enhance evaluation instructions - Replaced outdated evaluation commands with new script paths in the `examples/models` directory. - Updated sections for evaluating larger models, including the introduction of new scripts for tensor parallel and SGLang evaluations. - Streamlined instructions for model evaluation to improve clarity and usability.
v0.3.2
[Fix] Regular Linting - Added missing comma in AVAILABLE_MODELS for consistency. - Reordered import statements in vora.py for better readability. - Simplified input_data generation by condensing method calls into a single line. - Ensured default generation parameters are set correctly in the VoRA class.
v0.2.4
[Feat] Add support for evaluation of InternVideo2-Chat && Fix evaluat… …ion for mvbench (#280) * [add] add internvideo2 support && change mvbench to video branch * [add] answer_prompt of internvideo2 * [add] change video type of internvideo2 * [fix] update template of mvbench * [reformat] * [fix] generate_until_multi_round * [Feat] videochat2 support --------- Co-authored-by: heyinan <heyinan@pjlab.org.cn>
PreviousNext
You can’t perform that action at this time.