| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Mon, 17 Jun 2024 07:33:36 GMT
access-control-allow-origin: *
etag: W/"666fe6d0-3dd2"
expires: Sun, 28 Dec 2025 12:06:00 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: BCB4:292AC1:790333:87AB39:69511ACF
accept-ranges: bytes
age: 0
date: Sun, 28 Dec 2025 11:56:00 GMT
via: 1.1 varnish
x-served-by: cache-bom-vanm7210098-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1766922960.329289,VS0,VE214
vary: Accept-Encoding
x-fastly-request-id: a3d272ba412b7f05808835dda4c5be8bc42a007f
content-length: 4953
Xuesong Niu's Homepage
Xuesong Niu
Researcher @ Kuaishou Technology
Email: nxs583966 [at] 163.com
Biograph
I am now a staff researcher at Kuaishou Technology, focusing on the tasks of AIGC.
2023.04 - 2024.06, I was a research engineer at Beijing Institute for General Artificial Intelligence (BIGAI)
2021.07 - 2023.04, I was a research engineer at Kuaishou Technology.
2016.09 - 2021.07, I was a Ph.D student at Institute of Computing Technology, CAS, under the supervision of Prof. Shiguang Shan.
2019.10 - 2020.03, I was a visiting researcher at Oulu University under the supervision of Prof. Guoying Zhao.
2012.09 - 2016.07, I was a college student in Nankai University, Tianjin.
Research Interest
My research interests mainly focus on the deep perception and understanding of the real world, especially understanding human face, body and the environment from 2D images and 3D representations. I am also very interested in the human-machine interaction as well as the basic theories of deep learning.
News
- One paper on generalized remote physiological measurement accepted by CVPR 2023.
- One paper on model compression accepted by ACMMM 2022.
- I have successfully defended my doctoral thesis！
- One paper on apathy diagnosis accepted by T-CSVT
- I obtained the Special Scholarship of ICT (Highest award in ICT).
- I obtained the China National Scholarship for Ph.D.
- One survey on rPPG-based physiological measurement accepted by Journal of Image and Graphics.
- One paper on remote HR estimation accepted by ECCV2020 as oral presentation (top 2%).
- One paper on facial anti-spoofing accepted by ECCV2020.
- Our remote heart rate estiamtion system has been successfully applied by HUAWEI ("华为智能健康app").
- One paper on remote HR estimation accepted by SPL.
- We have successfully organized the first Challenge on Remote Physiological Signal Sensing.
- One paper on remote HR estimation accepted by TIP as regular paper
- One paper on semi-supervised AU detection accepted by NeurIPS2019
- We won the best poster presentation for our FG2019 paper
- One paper on remote HR estimation accepted by FG2019 Special Session
- One paper on AU detection accepted by CVPR2019
- Our VIPL-HR database for remote HR estimation has been released
Publications
-
Neuron Structure Modeling for Generalized Remote Physiological Measurement.
Hao Lu, Zitong Yu, Xuesong Niu, Ying-Cong Chen
CVPR, 2023.
[paper] -
Learning an Inference-accelerated Network from a Pre-trained Model with Frequency-enhanced Feature Distillation.
Xuesong Niu, Jili Gu, Guoxin Zhang, Pengfei Wan, Zhongyuan Wang
ACM Multimedia, 2022.
[paper] -
A Spatio-temporal Approach for Apathy Classification.
Abhijit Das, Xuesong Niu, Antitza Dantcheva, S L Happy, Hu Han, Radia Zeghari, Philippe Robert, Shiguang Shan, Francois Bremond, Xilin Chen
IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), 2021.
[paper]
-
RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation
Xuesong Niu, Shiguang Shan, Hu Han, Xilin Chen
IEEE Transactions on Image Processing (TIP), 2020.
[paper] -
Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling.
(Oral presentation, top 2%)
Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao
European Conference on Computer Vision (ECCV), 2020.
[paper] [code] -
Face Anti-Spoofing with Human Material Perception.
Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
European Conference on Computer Vision (ECCV), 2020.
[paper] -
AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching.
Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao
IEEE Signal Processing Letters(SPL), 2020.
[pdf] -
Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
Advances in Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2019.
[paper] [poster] [code] -
Local Relationship Learning with Person-specific Shape Regularization for Facial Action Unit Detection.
Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2019.
[paper] [poster] -
Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention. (Best poster presentation Award)
Xuesong Niu*, Xingyuan Zhao*, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen
IEEE International Conference on Automatic Face and Gesture Recognition (FG), Lille, France, 2019.
[paper] [poster] -
VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
Asian Conference on Computer Vision (ACCV), Perth Western Australia, 2018.
[pdf] [database] [poster] -
Automatic Engagement Prediction with GAP Feature.
Xuesong Niu, Hu Han, Jiabei Zeng, Xuran Sun, Shiguang Shan, Yan Huang, Songfan Yang, Xilin Chen
ACM International Conference on Multimodal Interaction (ICMI), Boulder, CO, USA, 2018.
[paper] [poster] -
SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
International Conference on Pattern Recognition (ICPR), Beijing, China, 2018.
[paper] [poster] -
Continuous Heart Rate Measurement from Face:A Robust rPPG Approach with Distribution Learning.
Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen
International Joint Conference on Biometrics(IJCB), 2017.
[paper] [poster]
Projects
- Remote heart rate estiamtion system applied by SeetaTech and HUAWEI ("华为智能健康app").
- Basic movements of NAO Robot controlled by EEG signals (reported by People's Daily, China) .
Tutorial
- A summary of papers on gaze estimation papers.
- A survey on Mirco expression analysis.
- A Chinese survey on rPPG-based physiological measurement.
- A summary of papers on 3D human mesh recovery.
Honors & Awards
- Outstanding Graduate of Beijing, 2021
- Special Scholarship of ICT (Highest award in ICT), ICT, CAS, 2020
- China National Scholarship for Ph.D., ICT, CAS, 2020
- FG2019 Best Poster Presentation Award, 2019
- 2nd Runner-up in EmotiW Student Engagement Prediction Challenge, 2018
- Travel Grant in IEEE FG Doctoral Consortium, 2018
- Excellence Scholarship of ICT, ICT, CAS, 2018
- Zhou Enlai Scholarship (Highest award in Nankai University), Nankai University, 2016
- Baogang Scholarship, 2016
- China National Scholarship, Nankai University, 2014
Academic Services
- Invited journal reviewer for IEEE TIP / IEEE JBHI / IEEE TAC / IEEE IoT / PR / TVCJ / Neurcomputing
- Invited conference reviewer for ICCV2021 / NeurIPS2021 / AAAI2022 / CVPR2022 / ICML2022 / NeurIPS2022 / CVPR2023 / ACMMM2023 / NeurIPS2023 / CVPR2024 / ECCV2024
- Co-organizer of the first Challenge on Remote Physiological Signal Sensing (RePSS) with CVPR 2020
Talks
2020.9, Huawei Noah's Ark Lab, "Remote Physiological Measurement from Face Videos" 2021.3, Zhidongxi (Online), "Remote Physiological Measurement from Face Videos"