Real-Time Audio Responsive Visuals
General idea
The project originated as a simple visualizer designed to gather and utilize audio data. However, it quickly evolved into an experimental endeavor to explore the potential uses of this data. Upon suggestion from colleagues within a shared study association, the visualizer was reimagined in the style of the association and received positive feedback from its members. This led to its incorporation into subsequent association events, where it was met with positive reception from the audience. As a result, the project was further developed as a hobby and association collaboration.
Eventually the product seems to well received, that it resulted in a graduation project.
Graduation
The product created as hobby is a great base to start with, however some clearer goal, is necessary. While the reception is great, the underlaying reasons are unknown.
Thus it created a perfect graduation project, with as my research question being:
How can design features and functionalities be incorporated in a visual synchronization tool to enhance ease of use for venues and facilitate real-time customization of visuals by VJs for seamless synchronization with music during DJ performances?
Current Features
-
Fast Fourier Transform, gives data of the average intensity of each frequency band.
-
Kick detection
-
BPM calculation
-
Visual tooling, to create visuals
-
Queue tooling, a tool to queue visuals, this enables loops of visuals.
-
Algorithm tooling, tools to develop new features more efficiently.
-
MIDI controller support
-
Integrations to Ableton link and Resolume
-
Multiple camera support
Future Iterations
-
An advanced audio detection algorithm that not only improves the accuracy of beat detection but also incorporates the detection of other key elements such as snare and hi-hats.
-
A more designer-friendly and intuitive interface that enables switching visuals and queueing visuals in a nice overview.
-
Development of sophisticated algorithms to detect and respond to advanced audio features such as build-ups, drops and overall intensity of the music.
-
A standalone program, so it is not depended on Unity anymore, resulting in more control, optimizations and integrations.
Media
