02138nas a2200325   4500000000100000008004100001260000800042653002900050653002300079653002500102653002200127653004000149653001500189653003400204653001800238653002000256653002400276653002200300653002400322653004000346653002400386100001100410700000900421700001300430700001100443700000900454245012700463520120800590022001401798       2023                            d  caug10a3D human pose estimation10aEstimation methods10aFeature interactions10aGeneration method10aGeneration of extended labanotation10aHuman pose10aIntangible cultural heritages10aLabanotations10aLevel-of-detail10aspatial transformer10aTemplate matching10afeature interaction10aGeneration of extended labanotation10aspatial transformer1 aXQ Cai1 aR Lu1 aPY Cheng1 aJL Yao1 aY Hu00aAn Extended Labanotation Generation Method Based on 3D Human Pose Estimation for Intangible Cultural Heritage Dance Videos3 aTo address the issues of low accuracy in existing 3D human pose estimation (HPE) methods and the limited level of details in Labanotation, we propose an extended Labanotation generation method for intangible cultural heritage dance videos based on 3D HPE. First, a 2D human pose sequence of the performer is inputted along with spatial location embeddings, where multiple spatial transformer modules are employed to extract spatial features of human joints and generate cross-joint multiple hypotheses. Afterward, temporal features are extracted by a self-attentive module and the correlation between different hypotheses is learned using bilinear pooling. Finally, the 3D joint coordinates of the performer are predicted, which are matched with the corresponding extended Labanotation symbols using the Laban template matching method to generate extended Labanotation. Experimental results show that, compared with VideoPose and CrossFormer algorithms, the Mean Per Joint Position Error (MPJPE) of the proposed method is reduced by 3.7mm and 0.6mm, respectively on Human3.6M dataset, and the generated extended Labanotation can better describe the movement details compared with the basic Labanotation.  a0218-0014