Case Study
MTS Music - Interactive expo with realtime audio streaming
Case Study
MTS Music - Interactive expo with realtime audio streaming
We developed a stunning real-time 3D equalizer that updates music played simultaneously from two Android devices. Faced with the challenge of transmitting data wirelessly without cables or third-party apps, our innovative solution involved creating an Android app that captures audio in real-time and runs invisibly in the background. This allowed users to stream high-resolution music from various platforms, including MTS Music, YouTube, and Spotify. Each device sends its audio stream to a server, which processes and visualizes both streams, delivering an impressive display enhanced by ray tracing, realistic shadows, and reflections.
Project details:
Technologies: Unity, Kotlin, Websockets, NodeJS
Client request: the client came to us with an interesting idea: to create a stand with a beautiful real-time 3D equalizer that updates while playing music simultaneously from two Android devices.
Our Solution: At first, it seemed impossible because we needed to send data from PC to 2 Android devices on the fly, simultaneously without using any cables or third-party apps. Bluetooth and Wi-Fi as audio were not viable options. However, after a month of technical development, we found a solution 👇
Solution:
Our best full-stack developer suggested an idea: create an Android app that captures audio from the entire device and sends it to a server in real-time. This app would run in the background and be invisible to the user. In the end, it even allowed us to download high-resolution music from any app, including MTS Music, Youtube, Spotify!
Each Android device would then send its audio stream to the server, where the visualization would process both streams and display a beautiful representation. Voilà!
We used Unity for visualisation and implemented latest technologies for the realtime rendering: raytracing, realistic shadows and reflections.
Project details:
Technologies: Unity, Kotlin, Websockets, NodeJS
Client request: the client came to us with an interesting idea: to create a stand with a beautiful real-time 3D equalizer that updates while playing music simultaneously from two Android devices.
Our Solution: At first, it seemed impossible because we needed to send data from PC to 2 Android devices on the fly, simultaneously without using any cables or third-party apps. Bluetooth and Wi-Fi as audio were not viable options. However, after a month of technical development, we found a solution 👇
Solution:
Our best full-stack developer suggested an idea: create an Android app that captures audio from the entire device and sends it to a server in real-time. This app would run in the background and be invisible to the user. In the end, it even allowed us to download high-resolution music from any app, including MTS Music, Youtube, Spotify!
Each Android device would then send its audio stream to the server, where the visualization would process both streams and display a beautiful representation. Voilà!
We used Unity for visualisation and implemented latest technologies for the realtime rendering: raytracing, realistic shadows and reflections.
We developed a stunning real-time 3D equalizer that updates music played simultaneously from two Android devices. Faced with the challenge of transmitting data wirelessly without cables or third-party apps, our innovative solution involved creating an Android app that captures audio in real-time and runs invisibly in the background. This allowed users to stream high-resolution music from various platforms, including MTS Music, YouTube, and Spotify. Each device sends its audio stream to a server, which processes and visualizes both streams, delivering an impressive display enhanced by ray tracing, realistic shadows, and reflections.
Project details:
Technologies: Unity, Kotlin, Websockets, NodeJS
Client request: the client came to us with an interesting idea: to create a stand with a beautiful real-time 3D equalizer that updates while playing music simultaneously from two Android devices.
Our Solution: At first, it seemed impossible because we needed to send data from PC to 2 Android devices on the fly, simultaneously without using any cables or third-party apps. Bluetooth and Wi-Fi as audio were not viable options. However, after a month of technical development, we found a solution 👇
Solution:
Our best full-stack developer suggested an idea: create an Android app that captures audio from the entire device and sends it to a server in real-time. This app would run in the background and be invisible to the user. In the end, it even allowed us to download high-resolution music from any app, including MTS Music, Youtube, Spotify!
Each Android device would then send its audio stream to the server, where the visualization would process both streams and display a beautiful representation. Voilà!
We used Unity for visualisation and implemented latest technologies for the realtime rendering: raytracing, realistic shadows and reflections.
Other Projects
Other Case Studies
Check our other project case studies with detailed explanations
Other Projects
Other Case Studies
Check our other project case studies with detailed explanations
Other Projects
Other Case Studies
Check our other project case studies with detailed explanations