ANIMATION / AUDIO VISUALS
These animations are visualizations of an audio signal. I worked with different
techniques, always using information from the audio signal. Often animations are influenced
by the current audio amplitude or frequencies. Some animations are using scripts I wrote
for automated beat detection. In some others I used MIDI data as a trigger.
Some of these animations could be considered as generative art, because the result varies depending on the audio source, causing a surprise sometimes.
Some of these animations could be considered as generative art, because the result varies depending on the audio source, causing a surprise sometimes.
CUBE LOOP SUITE
MADE FOR FULLDOME
These animations are made for a fulldome (such as a planetarium). The greatest thing in a fulldome is moving through a 3 dimensional structure.
RANDOM STRUCTURE
The geometry of this 3 dimensional structure is generated under the influence of random values. Cosinus and sinus are your friends when generating a cool looking structure!
RANDOM TEXTURES
If you already have a random generated structure, why not also generate random textures? The combinations sometimes gives you an incredible result.
MAKE IT AUDIO ACTIVE
the texture can be influenced by an audio signal, giving it an amazing look. But not only the texture, also the structure can be moved by audio information.COLOR WAVE
BEAT PUPPET RIGGING
AUDIO CONTROLS MOVEMENT
A little script takes the audio amplitude of different frequency bands and controls the movement of the figures. Different frequency bands for different movements makes This DOG dance to the music!PARTICLES
FULLDOME PIANO
BLENDER PLUS UNITY
This Piano, FLOATING IN SPACE, is really playing a song! The piano key models were made with Blender and then composed and rendered in Unity.REAL MIDI DATA
The keys are controlled with data from a MIDI file. A little script I wrote with Processing helped me to extract the notes and frame timing from a MIDI file. Then in Unity, another script makes the keys move to the song. Now any MIDI file can be loaded, or even a live rendering with live MIDI data is possible.PROCESSING 3D MODELS
THE KRAKEN
SOME SQUIDS swimming around, grooving to the beat. I tried to to make the audio amplitude waving through the arms, and the result looks really cool! This can be live rendered to the current music.
BEAT SEEKING FACE
THIS FACE dances to the beat.It tries to detect the beat of the currently played audio. Some attributes of the audio do affect the movement of the head. Different frequency bands are causing different movements. This one is live rendering too.
STAR CRINKLE - FULLDOME ASMR
FULLDOME ASMR
This is a visualization of an ASMR crinkle sound which reveals the starry sky over time, showing the star constellations and their boundaries. At every little cracking sound, one star or boundary corner appears.The first step was to convert an audio file of a crinkle sound to a table with time information about every cracking sound, plus some other useful audio information of every crack. Then a database of stars was needed, with the coordinates and constellation information of every star.
360° SOUND MAPPING
When rendering the animation, the spherical coordinates of the explosions are saved too. Since the cracking sounds are separated on multiple channels, there comes a nice feature for planetariums: It's possible to let the sound of every crack come from the exact position where the explosion appears!
THE SWARM
THE MANDALA
AE SCRIPT
One of my first animations I ever made, but still does it's job. This is made with a script I wrote for Adobe After Effects. It takes different frequency bands and uses the amplitude values for shuffling many small objects and changing the color. WATCH HERE.
ALWAYS A SURPRISE
It's fun to use this script on different sound files, or different kinds of music, because it looks quite different every time. The most interesting kind of music for visualizing is still DUBSTEP, because of it's wide spectrum of synthesizers.
DIGISTAR PLUS UNITY - FULLDOME
FULLDOME AUDIO VISUALS
This animation was made for a show called "Best Of Deep Space Night" at the Planetarium Hamburg. The lines around the venus are reacting to the audio track.MERGING TWO SYSTEMS
The animation of the venus and the stars in the background was rendered with the planetarium software Digistar. The animation of the lines was rendered with Unity. The challenge was to export the movement and rotation angle of the camera from one software and then importing it to the other. Some little tricks were needed to make it merge perfectly, but the result in the end was surprisingly good.
MIDI DATA IN AFTER EFFECTS
SIMPLE MANDALA
MIDI data can also be used in After Effects, if you write a script for it. The possibilities to visualize MIDI data are just infinite. THIS is a very simple example.
PROCESSING 3D LIVE RENDERING
BUTTERFLY
This live rendered BUTTERFLY moves with the music. The audio amplitude does control the movement of the wings. Additional the audio is changing the color hue of the wings, causing a cool wave.OLD SCHOOL MODELING
This Butterfly is not modeled with an 3D Software, instead I have drawn a butterfly on a paper (old school!) and then wrote down all the coordinates or "vertices" in a CSV table. These values then were manipulated by the audio signal.Because of the low amount of vertices, it can be easily rendered live with Processing.
DIAMOND
The audio is analyzed live and filtered into three bands: low, mid and high frequencies. The low frequencies are triggering a red wave coming from one edge of the triangle, the mid- and high frequencies are causing green and blue waves from the other two sides.The color values and amplitudes are mixed when hitting each other, causing a very COOL RESULT!
Depending on the amount of points, this diamond can be rendered in real time with Processing. But this one got a little glow with After Effects afterwards.
IN SINUS WE TRUST
PLAY WITH ROTATIONS
Playing with the rotation of objects always causes a cool result. THIS ONE is a simple example which never gets boring.
SIMPLE
A cool audio visualization doesn't has to be a hollywood-like animation. THIS is quite simple, but the movement looks very cool in my opinion.
Generative Design, Creative Coding, Shader Art, Generic Art, Art by Algorithm, Music Visualzations, Data Visualization, - using p5.js, Processing, Unity, Blender, After Effects
Jan Goinka - Hamburg, Germany - Generative Art & Audio Visuals - mail@jangoinka.com
Jan Goinka - Hamburg, Germany - Generative Art & Audio Visuals - mail@jangoinka.com