04082nas a2200589   4500000000100000000000100001008004100002260005900043653002800102653002600130653002300156653002600179653002300205653002500228653002600253653003900279653003400318653002700352653002100379653002500400653002400425653002500449653002300474653002900497653004000526653002300566653002000589653002000609653002000629100002100649700002100670700002400691700002700715700002000742700002400762700002300786700002300809700002300832700002100855700002200876700001700898700001800915700002000933700002000953700002300973700002500996245007301021856015301094300001001247520221001257020002503467       2021                            d  bInstitute of Electrical and Electronics Engineers Inc.10aArtificial intelligence10acharacter recognition10aCultural heritages10aCultural institutions10aData visualization10aImmersive experience10aInformation retrieval10aIntangible cultural heritage (ICH)10aIntangible cultural heritages10aInteractive technology10amachine learning10aMulti-media analysis10aMultimedia services10aPlatform development10asentiment analysis10aState-of-the-art methods10aThree dimensional computer graphics10aTraditional crafts10aUser experience10aVirtual reality10aVirtual reality1 aTheodora Pistola1 aSotiris Diplaris1 aChristos Stentoumis1 aEvangelos Stathopoulos1 aGeorgios Loupas1 aTheodore Mandilaras1 aGrigoris Kalantzis1 aIlias Kalisperakis1 aAnastasios Tellios1 aDespoina Zavraka1 aPanagiota Koulali1 aVera Section1 aValia Section1 aFoteini Venieri1 aStratos Bacalis1 aStefanos Vrochidis1 aIoannis Kompatsiaris00aCreating immersive experiences based on intangible cultural heritage  uhttps://www.scopus.com/inward/record.uri?eid=2-s2.0-85114702850&doi=10.1109%2fICIR51845.2021.00012&partnerID=40&md5=cf5b776bd18996707953a9d26755f8e1  a17-243 aCultural heritage is a lot more than monuments and collections of objects. In addition, it includes traditions and living expressions inherited from our ancestors and passed on to our descendants, such as songs, performing arts, social practices, rituals, festive events, knowledge and practices concerning nature, or the knowledge and skills to produce traditional crafts. These elements constitute the Intangible Cultural Heritage (ICH). Safeguarding of ICH is an important factor in maintaining social coherence along with cultural diversity, but it also is a challenge in modern societies. The digitization of ICH, with the transcription of its artifacts, is already becoming a springboard for its preservation and re-use, but intangible heritage has more to offer than a library of content. Lately, the advancements in extended reality interactive technologies and in artificial intelligence break new ground in understanding and sensing intangible heritage. In this paper, we present the CHROMATA platform which aims at facilitating the creation of novel immersive experiences to sustain ICH. To achieve this, we are developing a web platform that provides the content retrieval from online sources and cultural institutions; the AI services for multimedia analysis, e.g., 3D pose estimation, folklore dance recognition, and textual analysis; the authoring interface where the non-developers designers can create their virtual experience. The various data (images, video, text, audio, and 3D models) are analysed using state-of-the-art methods for dance recognition and visualization, Laban Movement Analysis and Labanotation generation, textual sentiment analysis and text generation. Moreover, 3D reconstruction techniques are employed to accurately capture places of interest, as well as human activities to create the related virtual spaces. The CHROMATA platform aims to boost the revival of intangible cultural heritage via easing the creation of more complete and enlightening immersive experiences. The platform development is driven and validated by real use case scenarios in which designers, creators and historians are building virtual experiences of customs and dances of Greek culture.  a9781665403474 (ISBN)