CrowdMatrix synchronizes the display of mobile devices to create a song-specific, professionally programmed light show that can fill an entire concert venue.
Debuting with 40,000 users at a music festival in Belgium, we specialized in live event effects utilizing mobile devices as pixels. I co-founded the company, built the backend server infrastructure, iOS app, various multi-platform utility apps, and ultimately filed a patent for the core sync technology.
Problem
Synchronize thousands of mobile devices within a reasonable degree of error (100ms or less) without relying on a strong network connection.
Solution
The initial proof of concept was developed in 48 hours but relied heavily on individual LAN TCP connections to each device. Scaling would be impossible, but the basic concept was there. With each following iteration, we decreased the reliance on a strong network connection.
The next challenge came with building the supporting infrastructure. How would the musicians on stage sync to the phones? How would the light show be programmed? How would each device manage its individual light show file?
Over time, we developed a synchronization engine that reliably synced participating devices within 100ms of each other— all without a solid Internet connection. We also developed a proprietary interface, file type, and backend management system for lighting designers to program the phones.
Initial Flow Diagrams
These flow diagrams depict the process of parsing our proprietary instruction files, and how the backend playback system initiated a show.
Graspop Metal Meeting (Belgium)
This was the first large scale test. We were contacted by Twisted Sister to premiere our technology at their headlining concert.
Frame of onboarding video shown at event (one of the first versions of the UI pre-flat iOS 7)
Control software
Company one sheet
Working at the Graspop Metal Meeting in Belgium, operating custom control software
Video
Check out an early demo at Azusa Pacific University: