02146nas a2200325   4500000000100000008004100001260001600042653003400058653001800092653002900110653002300139653002400162653002500186653002200211653004000233653004000273653001500313653002000328653002400348653002400372653002200396100001100418700000900429700001300438700001100451700000900462245012700471520120800598020001401806       2023                            d  c2023/08/29/10aIntangible cultural heritages10aLabanotations10a3D human pose estimation10aEstimation methods10afeature interaction10aFeature interactions10aGeneration method10ageneration of extended labanotation10aGeneration of extended labanotation10aHuman pose10aLevel-of-detail10aspatial transformer10aSpatial transformer10aTemplate matching1 aXQ Cai1 aR Lu1 aPY Cheng1 aJL Yao1 aY Hu00aAn Extended Labanotation Generation Method Based on 3D Human Pose Estimation for Intangible Cultural Heritage Dance Videos3 aTo address the issues of low accuracy in existing 3D human pose estimation (HPE) methods and the limited level of details in Labanotation, we propose an extended Labanotation generation method for intangible cultural heritage dance videos based on 3D HPE. First, a 2D human pose sequence of the performer is inputted along with spatial location embeddings, where multiple spatial transformer modules are employed to extract spatial features of human joints and generate cross-joint multiple hypotheses. Afterward, temporal features are extracted by a self-attentive module and the correlation between different hypotheses is learned using bilinear pooling. Finally, the 3D joint coordinates of the performer are predicted, which are matched with the corresponding extended Labanotation symbols using the Laban template matching method to generate extended Labanotation. Experimental results show that, compared with VideoPose and CrossFormer algorithms, the Mean Per Joint Position Error (MPJPE) of the proposed method is reduced by 3.7mm and 0.6mm, respectively on Human3.6M dataset, and the generated extended Labanotation can better describe the movement details compared with the basic Labanotation.  a0218-0014