Home » Jazz Articles » Journey into Jazz » Stretch: Interactive Holograms
Stretch: Interactive Holograms
I realized fairly early on with The Stretch Movement that no one would care unless we offered something truly revolutionary and unique. Simply rebranding or renaming what we already had essentially changes nothing. We needed to move away from the what jazz is in the traditional sense and avoid the baggage of that word as well, if we had any shot at actually reaching larger crowds of people. I also realized that we needed something that was uniquely our own; something that I could own and protect. In my last articles I briefly alluded to the tech world being a key to our future success. While writing the last article I had been asking myself the question: "If I was to be transported 100 years into the future, what would music performance look like" To me the answer was obvious: Interactive holograms:
So I disappeared to start Stretch Tech LLC and pursue patents on the invention. Unfortunately, pursuing those types of patents requires secrecy hence my absence. It took me and my friend and co-founder Jamaal Sawyer two years to get those patents on our invention as well as build and develop the software needed to be able to make the system work. Finally we are nearing completion of both the software and the hardware development and will be able to launch in the first half of 2014.
The first step we took was to see what other inventions were currently on the market that would allow on-stage performers to interact with holograms. While true volumetric holograms are still some years away, the best looking current ones available are the 'Pepper's ghost' holograms. These use a projector and a series of screens that allow the hologram to appear on stage. This technology first made headlines in 2012 when Tupac was 'resurrected' to perform at The Coachella Festival. The flaw in the 'Pepper's ghost' hologram is that performers on stage can't see it from on-stage, which makes it fairly difficult if not impossible for them to interact with it. My initial idea was to play my saxophone on stage and to have butterflies appear and fly from the bell. So the thought was; if we can't see the holograms, maybe we need the holograms to somehow see us.
My co-creator Jamaal Sawyer developed a microphone array and software that could efficiently locate any sound onstage using a single laptop, this includes voice, horns, amplifiers etc. This process is called sound localization. We married the sound localization microphone array with the "Pepper's ghost" systems so now users(performers) can interact with the holograms. The software works as a timeline. Users can upload audio tracks and coordinate times for when holograms appear. The holograms are CGI models in the FBX format. Once created, within the program the models can be told to move, resize, rotate, change color, or move individual body parts. The only real limit is the imagination of the person using the software. It is our goal to have hardware on hand at a multitude of spaces across the world. Musicians and performers would be able to install our software on their laptops and just plug into the existing "Pepper's ghost system" and the venue's sound system in conjunction with the use of the microphone array. As both a musician and now the CEO of Stretch Tech, I've designed the technology with the performer in mind. It is my hope that using this new software will provide a unique live music experience, and thus rebuild the audience. The added bonus is that since the system requires actual sound waves to function, it excludes all lip-syncing performers.
I have learned a lot over the past two years, and they were not easy, but it was my intention to find a new way. You can find more information about StretchTech.com. Please stop in and join the mailing list to receive updates regarding the upcoming launch of the our software and hardware. I'm excited to use this technology and to see what other people create with it. I would have never gotten this far without my friends, family, my church, and co-founder Jamaal. I need to thank Jon Crowley for helping with all of the Stretch pieces for this series. A special thank you to Michael Ricci (All About Jazz founder) as wellhe has provided me a platform and featured all of my previous articles when most people with his influence had already written me off. Thank you Michael.
< Previous
The Magnificent Thad Jones
Next >
2011: The Year In Jazz
Comments
About John Beaty
Instrument: Saxophone, alto
Related Articles | Concerts | Albums | Photos | Similar To