You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[CVPR 2022] Official Pytorch Implementation for "Spatio-temporal Relation Modeling for Few-shot Action Recognition". SOTA Results for Few-shot Action Recognition
The codebase is built on PyTorch 1.9.0 and tested on Ubuntu 18.04 environment (Python3.8.8, CUDA11.0) and trained on 4 GPUs. Build a conda environment using the requirements given in environment.yaml.
Attention Visualization
Results
Method
Kinetics
SSv2
HMDB
UCF
CMN-J
78.9
-
-
-
TARN
78.5
-
-
-
ARN
82.4
-
60.6
83.1
OTAM
85.8
52.3
-
-
HF-AR
-
55.1
62.2
86.4
TRX
85.9
64.6
75.6
96.1
STRM [Ours]
86.7
68.1
77.3
96.8
Training and Evaluation
Step 1 : Data preparation
Prepare the datasets according to the splits provided.
If you find this repository useful, please consider giving a star ⭐ and citation 🎊:
@inproceedings{thatipelli2021spatio,
title={Spatio-temporal Relation Modeling for Few-shot Action Recognition},
author={Thatipelli, Anirudh and Narayan, Sanath and Khan, Salman and Anwer, Rao Muhammad and Khan, Fahad Shahbaz and Ghanem, Bernard},
booktitle={CVPR},
year={2022}
}
Acknowledgements
The codebase was built on top of trx. Many thanks to Toby Perrett for previous work.
[CVPR 2022] Official Pytorch Implementation for "Spatio-temporal Relation Modeling for Few-shot Action Recognition". SOTA Results for Few-shot Action Recognition