DIGITAL HERITAGE EXPO 2015, Parque de las Ciencias (Granada)

28 September – 2 October 2015

“AiRome” – Extended gesture-based interaction application with remote control awarded by 2015 Digital Heritage International Congress as best exposition (Quality of Content)

Authors: Bruno Fanini, Enzo d’Annibale, VHLab ITABC CNR
3D Contents: VHLab ITABC CNR

“The installation proposal for DH15 Expo is composed by two different gesture-based applications that aim to create a shared experience and a collaborative gameplay among visitors. The first application (“Admotum”) consists in a serious game that allows the visitor to virtually explore 3D reconstructed environments using body gestures and motions, through the use of a microsoft Kinect sensor. The main goal of the exploration is finding a few objects displayed in the Imperial Fora Museum (Rome, Italy) in their original context, following the Treasure Hunt game mechanics. It is very different from traditional approaches since it allows the visitor to navigate in and interact with a virtual environment in three dimensions, including manipulation techniques to interact with multi-scale objects. The user performs actions in the virtual environment by means of gestures and other body movements. The second application (“Holobox”) is an inspection unit, consisting of an holographic display and a Leap Motion controller to allow the user to interact with virtual objects. The proposed solution is a reinterpretation of the immersive Pepper’s Ghost theatrical technique. The application provides a flexible and accessible system for “holographic” display and enables the possibility to integrate real-time manipulation by natural interaction paradigms. Concerning the latter, the ability to explore the 3D model is supported by the Leap motion controller. The optical illusion allow the users to visualize a virtual object fluctuating in the air, providing the illusion of 3D volumes and transparencies. The inspection unit behaves conceptually as a “magnifier”, to further investigate a virtual item or to provide additional information. A local net layer (wireless) allows the two applications to communicate to create an advanced and engaging gesture-based context, where users can pass items from one application to the other, reinforced by visual, dynamic floor animations. This layer allows also external visitors to participate to the collaborative experience by connecting to the local net and using their mobile devices to interact with active users by influencing gameplay visual appearance, hints and other factors, enabling a shared and engaging experience.” d’Annibale E. Fanini B.


DH15 workshop presentation:
Reference paper: