HTTP/2 200
date: Wed, 30 Jul 2025 16:07:46 GMT
content-type: text/html; charset=utf-8
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With,Accept-Encoding, Accept, X-Requested-With
etag: W/"454e8bfc8aedb876536acc133a489dcd"
cache-control: max-age=0, private, must-revalidate
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-frame-options: deny
x-content-type-options: nosniff
x-xss-protection: 0
referrer-policy: origin-when-cross-origin, strict-origin-when-cross-origin
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=%2BPL%2BQ%2FuW8IAyFCq0c2wr1Bj6yG65X2bZE2fyXqMTCj0lWZYVjZmp0Sr9G1eDkxyLY1jYOx4Km2lGKw%2BL9%2BV1RZSBO5txxvsO8h%2BB%2FT4GxxX5LmbeNk8aWuhKL9gGDYOJn5gkbC6mBARIujplaHhlUczGKZJZNf%2FYPMjuVcbW6GDIRVYH7BoBFD6XfAYtVTuiXUaueTkZpT4565984wfSDwSnHxtOBveS6ohobWNokN5%2FTAD97BKqj3LXg3vSJr1LkttJsnZ7UB6x%2BXdcBvu78A%3D%3D--MvSUwn74KJm5PPhQ--0XlEUTYfRtXiU58UJUnfCQ%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.356169085.1753891665; Path=/; Domain=github.com; Expires=Thu, 30 Jul 2026 16:07:45 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Thu, 30 Jul 2026 16:07:45 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: E640:3FB2D:8CD36:A617B:688A4351
PKU-Alignment · GitHub
PKU-Alignment
Loves Sharing and Open-Source, Making AI Safer.
Large language models (LLMs) have immense potential in the field of general intelligence but come with significant risks. As a research team at Peking University, we actively focus on alignment techniques for LLMs, such as safety alignment, to enhance the model's safety and reduce toxicity.
Welcome to follow our AI Safety project:
Pinned
Loading
JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.
Python
976
136
NeurIPS 2023: Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark
Python
478
66
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
Python
1.5k
123
NeurIPS 2023: Safe Policy Optimization: A benchmark repository for safe reinforcement learning algorithms
Python
373
54
Repositories
Showing 10 of 23 repositories
PKU-Alignment/eval-anything’s past year of commit activity
Python
20
Apache-2.0
16
1
2
Updated Jul 26, 2025
PKU-Alignment/llms-resist-alignment’s past year of commit activity
Python
9
1
0
0
Updated Jun 11, 2025
SAE-V
Public
[ICML 2025 Poster] SAE-V: Interpreting Multimodal Models for Enhanced Alignment
PKU-Alignment/SAE-V’s past year of commit activity
2
0
0
0
Updated Jun 5, 2025
PKU-Alignment/SafeVLA’s past year of commit activity
Python
52
2
5
1
Updated Jun 4, 2025
align-anything
Public
Align Anything: Training All-modality Model with Feedback
PKU-Alignment/align-anything’s past year of commit activity
Jupyter Notebook
4,380
Apache-2.0
503
25
3
Updated May 28, 2025
ProgressGym
Public
Alignment with a millennium of moral progress. Spotlight@NeurIPS 2024 Track on Datasets and Benchmarks.
PKU-Alignment/ProgressGym’s past year of commit activity
Python
23
MIT
4
0
0
Updated Mar 30, 2025
PKU-Alignment/s1-m’s past year of commit activity
Python
3
Apache-2.0
512
0
0
Updated Mar 25, 2025
omnisafe
Public
JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.
PKU-Alignment/omnisafe’s past year of commit activity
Python
976
Apache-2.0
136
15
4
Updated Mar 17, 2025
ProAgent
Public
AAAI24(Oral) ProAgent: Building Proactive Cooperative Agents with Large Language Models
PKU-Alignment/ProAgent’s past year of commit activity
JavaScript
89
MIT
10
0
0
Updated Mar 4, 2025
safety-gymnasium
Public
NeurIPS 2023: Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark
PKU-Alignment/safety-gymnasium’s past year of commit activity
Python
478
Apache-2.0
66
9
1
Updated Feb 27, 2025
Most used topics
Loading…
You can’t perform that action at this time.