Dancing on Tangram
- Course project in Mixed Reality and Tangible Interaction at Université Paris-Saclay
- Team: Beiqian LIU, Anqi YANG, Tiannan YANG
- Date: Jan 2021 - Feb 2021
- My Contribution: Implemented the dancing component, including Sound Visualization, Virtual Button, and Animation
- Technology: Unity + C#
Invented in China approximately 200 years ago, a tangram is a two-dimensional re-arrangement puzzle created by cutting a square into seven pieces, where each piece is usually referred to as a "tan." When arranged correctly, a tangram can be used to create many complex and interesting shapes, such as animals, buildings, persons, etc.
AR + Tangible + Sound Interaction
Dancing on Tangram represents a revolution in the traditional tangram game experience. Follow the virtual guidance to create your own dancers using tangrams. Watch them dance to the music on the virtual dance floor, and play with them through AR and tangible interactions!
AR Guidance
- When one Tan is placed in the correct place, a blue AR shape indicator for the next Tan appears.
- When the next Tan is recognized, a blue AR dot indicator appears on the Tan, and an audio cue for recognition plays.
- When the next Tan is placed in the correct location, a yellow AR indicator appears, and an audio cue for matching plays.
- 3 seconds later, the yellow indicator disappears, and the app jumps to the next circle; a blue AR indicator for the 3rd Tan appears, and so on.
Dancing on Tangram
When all the tans are put in the correct place, an AR character appears and dances on the freshly assembled tangram shape. Simultaneously, background music begins to play, and the beat of the music is visualized, surrounding the dancing character. Players can touch on a Tan physically to switch the AR character’s dancing postures.
Animation
We downloaded character models and motions from Mixamo and created an animator controller in Unity.
Switch Posture - Virtual Button
The Virtual Button is an interactive physical button. We set one piece of Tan as a virtual button. When users tap this Tan in the real world, the character can switch among different dancing postures in the app.
Sound Visualization
Each dancing posture is accompanied by suitable background music. Users can see visualized sound waves while the character is dancing. We used Rhythm Visualizator Pro to visualize sound in real-time.