Action Segmentation Using 2D Skeleton Heatmaps and Multi-Modality Fusion

Syed Waleed Hyder,Muhammad Usama,Anas Zafar,Muhammad Naufil,Fawad Javed Fateh,Andrey Konin,M. Zeeshan Zia,Quoc-Huy Tran,Syed Waleed Hyder,Muhammad Usama,Anas Zafar,Muhammad Naufil,Fawad Javed Fateh,Andrey Konin,M. Zeeshan Zia,Quoc-Huy Tran

This paper presents a 2D skeleton-based action segmentation method with applications in fine-grained human activity recognition. In contrast with state-of-the-art methods which directly take sequences of 3D skeleton coordinates as inputs and apply Graph Convolutional Networks (GCNs) for spatiotemporal feature learning, our main idea is to use sequences of 2D skeleton heatmaps as inputs and employ ...