Volumetric AR dance performance
Live Site Case StudyFor the release of Sam Smith's album Diamonds, Spotify came to us to develop a unique interactive experience which drew users to listen to the album on their app. We had previously worked with them on a release promotion for Post Malone which encouraged two people to listen to the album side by side together with the app and wanted to expand on that idea.
We proposed a multi-user AR experience which would superimpose volumetric holograms of Sam as they perform improvisational dance. One person's device plays the album through the Spotify app, while others use our web AR experience to view Sam's performance as a mini holographic music video.
We worked with a 3D video capture studio to record Sam’s dancing, which we were then able to play back in realtime using the MRCS video format. The 3D scene is visually attached to the album artwork on the Spotify app using 8th Wall's spacial image tracking. We added interactive refractive diamonds to the scene for an increased sense of depth and dynamics.
I contributed to the creative and conceptual development of the experience, as well as early technical prototyping and research. I also executed the front-end build including custom refraction shaders for the fragmented diamond effects. The experience was a first of its kind and drew attention from fans across the world.