Make Skeleton-based Action Recognition Model Smaller, Faster and Better

Classés selon la proximité de leur titre et de leur résumé avec ceux de cet article. Sélectionnez-en pour les lire ensemble.

Les articles les plus proches

1. Très proche Pas pertinent

   Deep Learning-based Feature Fusion for Action Recognition Using Skeleton Information

   Fahad Ul Hassan Asif Mattoo, U. S. Khan, Tahir Nawaz et al. · 2023 · International Conference on Robotics and Artificial Intelligence · cité 4 fois · Pas encore résumé

   Résumé scientifique

   Various action recognition systems have been proposed, but most of them are not feasible to be used in real-time applications. Skeleton-based action recognition has a low computational cost and is not affected by background changes. As the pose estimation models are becoming faster (almost real-time), a model was created with only 1.8M parameters named DD-net, which uses the skeleton information to predict the action. Recently an improved version of the model came out and was named TD-net. The model is very rich with geometric-based features but lacks motion-based features. To overcome this we added two motion features in the model named acceleration and velocity. These features were created…

2. Très proche Pas pertinent

   AdaSGN: Adapting Joint Number and Model Size for Efficient Skeleton-Based Action Recognition

   Lei Shi, Yifan Zhang, Jian Cheng et al. · 2021 · IEEE International Conference on Computer Vision · cité 64 fois · Pas encore résumé

   Résumé scientifique

   Existing methods for skeleton-based action recognition mainly focus on improving the recognition accuracy, whereas the efficiency of the model is rarely considered. Recently, there are some works trying to speed up the skeleton modeling by designing light-weight modules. However, in addition to the model size, the amount of the data involved in the calculation is also an important factor for the running speed, especially for the skeleton data where most of the joints are redundant or non-informative to identify a specific skeleton. Besides, previous works usually employ one fix-sized model for all the samples regardless of the difficulty of recognition, which wastes computations for easy sam…

3. Très proche Pas pertinent

   Skeleton-Based Multifeatures and Multistream Network for Real-Time Action Recognition

   Zhiwen Deng, Qing Gao, Zhao-Jie Ju et al. · 2023 · IEEE Sensors Journal · cité 25 fois · Pas encore résumé

   Résumé scientifique

   Action recognition is a hot topic in the field of computer vision. It has been widely used in human–computer/robot interaction, abnormal behavior monitoring, and medical assistive. Because of the excellent robustness of skeleton data, it has attracted many scholars to research skeleton-based action recognition. Most of the current skeleton-based action recognition methods suffer from the incomplete and poor generalization of the input features, inadequate feature extraction by the network model, and an imbalance between recognition accuracy and model size. We analyze the critical skeleton features for action recognition to solve these problems and propose a multifeatures and multistream netw…

4. Très proche Pas pertinent

   Constructing Stronger and Faster Baselines for Skeleton-Based Action Recognition

   Yisheng Song, Zhang Zhang, C. Shan et al. · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence · cité 467 fois · Pas encore résumé

   Résumé scientifique

   One essential problem in skeleton-based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the recent State-Of-The-Art (SOTA) models for this task tends to be exceedingly sophisticated and over-parameterized. The low efficiency in model training and inference has increased the validation costs of model architectures in large-scale datasets. To address the above issue, recent advanced separable convolutional layers are embedded into an early fused Multiple Input Branches (MIB) network, constructing an efficient Graph Convolutional Network (GCN) baseline for skeleton-based action recognition. In addition, based on such the baseline…

5. Très proche Pas pertinent

   Stronger, Faster and More Explainable: A Graph Convolutional Baseline for Skeleton-based Action Recognition

   Yisheng Song, Zhang Zhang, C. Shan et al. · 2020 · ACM Multimedia · cité 363 fois · Pas encore résumé

   Résumé scientifique

   One essential problem in skeleton-based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the State-Of-The-Art (SOTA) models of this task tends to be exceedingly sophisticated and over-parameterized, where the low efficiency in model training and inference has obstructed the development in the field, especially for large-scale action datasets. In this work, we propose an efficient but strong baseline based on Graph Convolutional Network (GCN), where three main improvements are aggregated, i.e., early fused Multiple Input Branches (MIB), Residual GCN (ResGCN) with bottleneck structure and Part-wise Attention (PartAtt) block. Firs…

6. Très proche Pas pertinent

   Robust Multi-Feature Learning for Skeleton-Based Action Recognition

   Yingfu Wang, Z. Xu, Li Li et al. · 2019 · IEEE Access · cité 10 fois · Pas encore résumé

   Résumé scientifique

   Skeleton-based action recognition has advanced significantly in the past decade. Among deep learning-based action recognition methods, one of the most commonly used structures is a two-stream network. This type of network extracts high-level spatial and temporal features from skeleton coordinates and optical flows, respectively. However, other features, such as the structure of the skeleton or the relations of specific joint pairs, are sometimes ignored, even though using these features can also improve action recognition performance. To robustly learn more low-level skeleton features, this paper introduces an efficient fully convolutional network to process multiple input features. The netw…

7. Très proche Pas pertinent

   Multi-Stream GCN and CNN for Skeleton-Based Action Recognition

   Kenzhebek Taniyev, T. Zhaksylyk, Tu Anh Nguyen · 2024 · IEEE International Conference on Systems, Man and Cybernetics · Pas encore résumé

   Résumé scientifique

   This paper presents two novel approaches for improving skeleton-based action recognition using Graph Convolutional Networks (GCN) and Convolutional Neural Networks (CNN). In the first approach, we combine GCN and CNN streams that process position and velocity features to improve classification accuracy. In the second approach, we use GCN as an embedding layer for support network CNN to extract features from skeleton data, which significantly improves recognition accuracy. Our experiments on the JHMDB dataset demonstrate that our approaches outperform state-of-the-art methods while using significantly fewer parameters. Additionally, we extended our evaluation to the Kinetics-400 dataset, wher…

8. Très proche Pas pertinent

   Ghost Graph Convolutional Network for Skeleton-based Action Recognition

   Sung-Jun Jang, Hean-Sung Lee, Suhwan Cho et al. · 2021 · 2021 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · cité 4 fois · Pas encore résumé

   Résumé scientifique

   Skeleton-based action recognition has attracted great attention in human action recognition. Existing methods for skeleton-based action recognition improve performance by designing deeper networks without considering the efficiency of the model. In this paper, we propose a simple and effective light weight graph convolutional network for skeleton-based action recognition. Our model is composed of a lightweight temporal convolutional network and spatial graph convolutional network using depthwise convolution. In addition, we propose a novel graph convolution that can take the multi-scale relationship of joints with low computational complexities. On the NTU RGB+D dataset, our proposed model a…

Les travaux antérieurs sur lesquels il s’appuie

1. Proche Utilisé en profondeur par cet article Une méthode qu’il utilise Pas pertinent

   Fusing Geometric Features for Skeleton-Based Action Recognition Using Multilayer LSTM Networks

   Songyang Zhang, Yang Yang, Jun Xiao et al. · 2018 · IEEE transactions on multimedia · cité 165 fois · Pas encore résumé

   Résumé scientifique

   Recent skeleton-based action recognition approaches achieve great improvement by using recurrent neural network (RNN) models. Currently, these approaches build an end-to-end network from coordinates of joints to class categories and improve accuracy by extending RNN to spatial domains. First, while such well-designed models and optimization strategies explore relations between different parts directly from joint coordinates, we provide a simple universal spatial modeling method perpendicular to the RNN model enhancement. Specifically, according to the evolution of previous work, we select a set of simple geometric features, and then seperately feed each type of features to a three-layer LSTM…

2. Proche* Utilisé en profondeur par cet article Une méthode qu’il utilise Pas pertinent

   Ensemble Deep Learning for Skeleton-Based Action Recognition Using Temporal Sliding LSTM Networks

   Inwoong Lee, Doyoung Kim, Seoungyoon Kang et al. · 2017 · IEEE International Conference on Computer Vision · cité 378 fois · Pas encore résumé
3. Proche Une méthode qu’il utilise Pas pertinent

   Modeling Temporal Dynamics and Spatial Configurations of Actions Using Two-Stream Recurrent Neural Networks

   Hongsong Wang, Liang Wang · 2017 · Computer Vision and Pattern Recognition · cité 436 fois · Pas encore résumé

   Résumé scientifique

   Recently, skeleton based action recognition gains more popularity due to cost-effective depth sensors coupled with real-time skeleton estimation algorithms. Traditional approaches based on handcrafted features are limited to represent the complexity of motion patterns. Recent methods that use Recurrent Neural Networks (RNN) to handle raw skeletons only focus on the contextual dependency in the temporal domain and neglect the spatial configurations of articulated skeletons. In this paper, we propose a novel two-stream RNN architecture to model both temporal dynamics and spatial configurations for skeleton based action recognition. We explore two different structures for the temporal stream: s…

4. Proche Une méthode qu’il utilise Pas pertinent

   Skeleton-based action recognition using LSTM and CNN

   Chuankun Li, Pi-Chao Wang, Shuang Wang et al. · 2017 · 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) · cité 195 fois · Pas encore résumé

   Résumé scientifique

   Recent methods based on 3D skeleton data have achieved outstanding performance due to its conciseness, robustness, and view-independent representation. With the development of deep learning, Convolutional Neural Networks (CNN) and Long Short Term Memory (LSTM)-based learning methods have achieved promising performance for action recognition. However, for CNN-based methods, it is inevitable to loss temporal information when a sequence is encoded into images. In order to capture as much spatial-temporal information as possible, LSTM and CNN are adopted to conduct effective recognition with later score fusion. In addition, experimental results show that the score fusion between CNN and LSTM per…

5. Proche Une méthode qu’il utilise Pas pertinent

   Deep Progressive Reinforcement Learning for Skeleton-Based Action Recognition

   Yan-Song Tang, Yi Tian, Ji-Wen Lu et al. · 2018 · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · cité 383 fois · Pas encore résumé

   Résumé scientifique

   In this paper, we propose a deep progressive reinforcement learning (DPRL) method for action recognition in skeleton-based videos, which aims to distil the most informative frames and discard ambiguous frames in sequences for recognizing actions. Since the choices of selecting representative frames are multitudinous for each video, we model the frame selection as a progressive process through deep reinforcement learning, during which we progressively adjust the chosen frames by taking two important factors into account: (1) the quality of the selected frames and (2) the relationship between the selected frames to the whole video. Moreover, considering the topology of human body inherently li…