Master’s Thesis: ‘Sound and Interactive Storytelling’

In 2013 I wrote my Master’s Thesis ‘Sound and Interactive Storytelling’ at Hochschule Darmstadt under the Supervision of Prof. Dr. Torsten Fröhlich and Prof. Claudia Söller-Eckert.

Abstract:

The central topic of this thesis is to find approaches to create an integral sound design for interactive media. Integral sound design describes a sound design as an integral part of the medium by the means of interactivity and its functions in relation to the context. The goal is to reduce the redundancy of generic sound designs and to involve the user on the acoustic layer. A research and definition of the topics Interactive Storytelling, Virtual Reality and Sound Design followed by a theoretical involvement with integral sound design leading to different approaches and examples of integral sound design was done. Resulting approaches show, that implementing integral sound in an interactive storytelling medium as an interactive layer and in context to the story is possible with each layer of sound such as sound effects, music, ambient etc. Different effects can be achieved regarding the interface, storytelling or the perception of the story. The described approaches are demonstrated in an interactive story presented in Virtual Reality.

Used Technologies:
Unity Technologies Unity3D, Trimble SketchUp Make, Magix Samplitude, Oculus VR Oculus Rift

Links:
Project Empathia Blog

mediale* 2012: ‘Grid Surfer’

The approach we took with grid surfer is an old school arcade game inspired by cyber punk look of tron but including todays technology, such as the Wii Balance Board as input device and top notch stereoscopic images.

The whole project was built with the Unity 3D engine and custom graphics out of cinema 4D. The soundtrack is originally composed for a spacial sound experience.

About the team:

The team consists out of Dominik Braun, Daniel Dünchem, Sebastian Haase, and Jannicke Ostoike. 4 Master students (Media Direction) at the University of Applied Sciences, Darmstadt.

Function: Game Design, Scripting, Game Programming, Audio Programming

Used technologies: Unity3D, Wii Balance Board, Cinema4D

Links:

darmstadtnews.de

stadtleben.de

echo-online.de

da-imnetz.dee

Bachelor’s Thesis: ‘Videogame Sounddesign’

In 2011 I wrote my Bachelor’s Thesis ‘Videogame Sounddesign’ at Hochschule Darmstadt under the Supervision of Prof. Dr. Kyrill Fischer and Prof. Willhelm Weber. The thesis approaches the history and development of sound design in videogames and the theory of interactive audio production (planning and conception, production, implementation). Accompanying to the theoretical thesis I worked at DECK13 Interactive GmbH in the Sound Department creating the Sound Design for Moorhuhn: Tiger & Chicken.

Function: Planning and conception of SFX, ambient and music; SFX and ambient Sound Design; Implementation of SFX, ambient and music

Used technologies: FledgeEd, FMOD Designer, Magix Samplitude

More about Moorhuhn: Tiger & Chicken can be found here:
‘Moorhuhn: Tiger & Chicken’

The Space Invader

Together with Clemens Anzmann we created a 3-OSC-Digital Synthesizer, paired with a completely self-consctructed Arduino Driven Hardware Spaceship Interface and an interactive 3D-Projection simulating a flight through space.

Function: Synthesizer programming, Sound Synthesis, Construction of the Hardware Interface and it’s electronics.

Used technologies: Arduino, OpenFrameworks, XVR

Ars Electronica 2010: ‘Das Virtuelle Planetarium’

Ars Electronica 2010 – Festival Für Kunst, Technologie und Gesellschaft, Linz
‘Das Virtuelle Planetarium’ under the responsibility of Prof. Dr. Torsten Fröhlich.

‘Das Virtuelle Planetarium’ is an interactive, stereoscopic projection of our solar system. The project was initiated by Prof. Dr. Torsten Fröhlich in his Virtual- and Augmented Reality course at Hochschule Darmstadt. The project was running over multiple semesters and students contributed new content and functions such as iPad/iPhone controll, music, real time simulations etc.