ANIMATION / AUDIO VISUALS

These animations are visualizations of an audio signal. I worked with different techniques, always using information from the audio signal. Often animations are influenced by the current audio amplitude or frequencies. Some animations are using scripts I wrote for automated beat detection. In some others I used MIDI data as a trigger.
Some of these animations could be considered as generative art, because the result varies depending on the audio source, causing a surprise sometimes.

CUBE LOOP SUITE


MADE FOR FULLDOME

These animations are made for a fulldome (such as a planetarium). The greatest thing in a fulldome is moving through a 3 dimensional structure.
Music and Audio Visuals and Generative Art, Creative Coding, Visualzation, Algorithm

RANDOM STRUCTURE

The geometry of this 3 dimensional structure is generated under the influence of random values. Cosinus and sinus are your friends when generating a cool looking structure!
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm


RANDOM TEXTURES

If you already have a random generated structure, why not also generate random textures? The combinations sometimes gives you an incredible result.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm


MAKE IT AUDIO ACTIVE

the texture can be influenced by an audio signal, giving it an amazing look. But not only the texture, also the structure can be moved by audio information.

COLOR WAVE

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

A SIMPLE WAVE

A very simple, but beautiful animation, triggered by the audio amplitude. Watch on YouTube HERE and HERE.

BEAT PUPPET RIGGING

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

MADE WITH AFTER EFFECTS

This animation was made with After Effects. This GORILLA is moving and grooving with the beat.

FAKE 3D

Several 2D layers are moving in perspektive to create a decent 3D look.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

AUDIO CONTROLS MOVEMENT

A little script takes the audio amplitude of different frequency bands and controls the movement of the figures. Different frequency bands for different movements makes This DOG dance to the music!

PARTICLES

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

PARTICLES

Particles are the evergreen in audio visualization. Say no more! Watch on YouTube HERE and HERE.

FULLDOME PIANO

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

BLENDER PLUS UNITY

This Piano, FLOATING IN SPACE, is really playing a song! The piano key models were made with Blender and then composed and rendered in Unity.

REAL MIDI DATA

The keys are controlled with data from a MIDI file. A little script I wrote with Processing helped me to extract the notes and frame timing from a MIDI file. Then in Unity, another script makes the keys move to the song. Now any MIDI file can be loaded, or even a live rendering with live MIDI data is possible.

PROCESSING 3D MODELS

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

THE KRAKEN

SOME SQUIDS swimming around, grooving to the beat. I tried to to make the audio amplitude waving through the arms, and the result looks really cool! This can be live rendered to the current music.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

BEAT SEEKING FACE

THIS FACE dances to the beat.
It tries to detect the beat of the currently played audio. Some attributes of the audio do affect the movement of the head. Different frequency bands are causing different movements. This one is live rendering too.

STAR CRINKLE - FULLDOME ASMR

FULLDOME ASMR

This is a visualization of an ASMR crinkle sound which reveals the starry sky over time, showing the star constellations and their boundaries. At every little cracking sound, one star or boundary corner appears.
The first step was to convert an audio file of a crinkle sound to a table with time information about every cracking sound, plus some other useful audio information of every crack. Then a database of stars was needed, with the coordinates and constellation information of every star.

360° SOUND MAPPING

When rendering the animation, the spherical coordinates of the explosions are saved too. Since the cracking sounds are separated on multiple channels, there comes a nice feature for planetariums: It's possible to let the sound of every crack come from the exact position where the explosion appears!
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

THE SWARM

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

LET'S DANCE

For these animations I used a script which detects the beat, or more precisely some peaks in the audio amplitude. Then a swarm of little objects jumps from one point to another at every peak, which makes the swarm dance to the music. Watch HERE and HERE.

THE MANDALA

AE SCRIPT

One of my first animations I ever made, but still does it's job. This is made with a script I wrote for Adobe After Effects. It takes different frequency bands and uses the amplitude values for shuffling many small objects and changing the color. WATCH HERE.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

ALWAYS A SURPRISE

It's fun to use this script on different sound files, or different kinds of music, because it looks quite different every time. The most interesting kind of music for visualizing is still DUBSTEP, because of it's wide spectrum of synthesizers.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

DIGISTAR PLUS UNITY - FULLDOME


FULLDOME AUDIO VISUALS

This animation was made for a show called "Best Of Deep Space Night" at the Planetarium Hamburg. The lines around the venus are reacting to the audio track.

MERGING TWO SYSTEMS

The animation of the venus and the stars in the background was rendered with the planetarium software Digistar. The animation of the lines was rendered with Unity. The challenge was to export the movement and rotation angle of the camera from one software and then importing it to the other. Some little tricks were needed to make it merge perfectly, but the result in the end was surprisingly good.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

MIDI DATA IN AFTER EFFECTS

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

SIMPLE MANDALA

MIDI data can also be used in After Effects, if you write a script for it. The possibilities to visualize MIDI data are just infinite. THIS is a very simple example.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

PROCESSING 3D LIVE RENDERING

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

BUTTERFLY

This live rendered BUTTERFLY moves with the music. The audio amplitude does control the movement of the wings. Additional the audio is changing the color hue of the wings, causing a cool wave.

OLD SCHOOL MODELING

This Butterfly is not modeled with an 3D Software, instead I have drawn a butterfly on a paper (old school!) and then wrote down all the coordinates or "vertices" in a CSV table. These values then were manipulated by the audio signal.

Because of the low amount of vertices, it can be easily rendered live with Processing.

DIAMOND

The audio is analyzed live and filtered into three bands: low, mid and high frequencies. The low frequencies are triggering a red wave coming from one edge of the triangle, the mid- and high frequencies are causing green and blue waves from the other two sides.

The color values and amplitudes are mixed when hitting each other, causing a very COOL RESULT!

Depending on the amount of points, this diamond can be rendered in real time with Processing. But this one got a little glow with After Effects afterwards.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

IN SINUS WE TRUST

Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

PLAY WITH ROTATIONS

Playing with the rotation of objects always causes a cool result. THIS ONE is a simple example which never gets boring.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm

SIMPLE

A cool audio visualization doesn't has to be a hollywood-like animation. THIS is quite simple, but the movement looks very cool in my opinion.
Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm Music and Audio Visuals and Generative Art, Creative Coding, Generic Art, Algorithm
Generative Design, Creative Coding, Shader Art, Generic Art, Art by Algorithm, Music Visualzations, Data Visualization, - using p5.js, Processing, Unity, Blender, After Effects
Jan Goinka - Hamburg, Germany - Generative Art & Audio Visuals - mail@jangoinka.com