Mapping and Visualization with SuperCollider. Create interactive and responsive audio-visual applications with SuperCollider

Mapping and Visualization with SuperCollider. Create interactive and responsive audio-visual applications with SuperCollider - Opis

SuperCollider is an environment and programming language used by musicians, scientists, and artists who work with audio-files SuperCollider has built-in graphical features which are used in conjunction with the sound synthesis server to create audio-visual mapping and sound visualization. If you wish to create data visualizations by acquiring data from audio and visual sources, then this book is for you.Digital sound artists need to analyze, manipulate, map, and visualize data when working on a scientific or an artistic project. As an artist, this book, by means of its numerous code examples will provide you with the necessary knowledge of SuperCollider's practical applications, so that you can extract meaningful information from audio-files and master its visualization techniques. This book will help you to prototype and implement sophisticated visualizers, sonifiers, and complex mappings of your data.This book takes a closer look at SuperCollider features such as plotting and metering functionality to dispel the mysterious aura surrounding the more advanced mappings and animation strategies. This book also takes you through a number of examples that help you to create intelligent mapping and visualization systems. Throughout the course of the book, you will synthesize and optimize waveforms and spectra for scoping as well as extract information from an audio signal. The later sections of the book focus on advanced topics such as emulating physical forces, designing kinematic structures, and using neural networks to enable you to develop a visualization that has a (...) więcej natural motion with structures that respect anatomy and which come with an intelligent encoding mechanism. This book will teach you everything you need to work with intelligent audio-visual systems to extract and visualize audio-visual data. Spis treści:
Mapping and Visualization with SuperCollider
Table of Contents
Mapping and Visualization with SuperCollider
Credits
About the Author
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Scoping, Plotting, and Metering
Plotting audio, numerical datasets, and functions
Using plot and plot graph
Using plotter
Using SoundFileView
Scoping signals
Scoping waveforms
Scoping spectra
Metering levels
Monitoring signals
Monitoring numerical data
Nonstandard and complex visualizers
Nonstandard visualizers
A complex scope
Summary
2. Waveform Synthesis
Waveform synthesis fundamentals
Time domain representation
Waveform species
DC, amplitude, frequency, and phase
Custom waveform generators
Wavetable lookup synthesis
Using envelopes as wavetables
Custom aperiodic waveform generators
Waveform transformations
Waveshaping
Unary operations
Binary operations
Bitwise operations
Summary
3. Synthesizing Spectra
Introducing the frequency domain
Spectra
Fast Fourier Transform in SuperCollider
Creating and manipulating spectra
Aggregating and enriching spectra
Sculpting and freezing spectra
Shifting, stretching, and scrambling spectra
Using the pvcalc method
Visualizing spectra
Limitations of spectral scoping
Optimizing spectra for scoping
Summary
4. Vector Graphics
Learning the vector graphics fundamentals
Drawing primitive shapes and loading images
Complex shapes and graphics state
Introducing colors, transparency, and gradients
Abstractions and models
Objects and prototypes
Factories
Geometrical transformations, matrices, and trailing effects
Complex structures
Particle systems
Fractals
Summary
5. Animation
Fundamentals of motion
Motion species
Using UserView
Animating complex shapes and sprites
Fundamental animation techniques
Trailing effects
Interaction and event-driven programming
Particle systems
Advanced concepts
Animating fractals
Adding dynamics to simulate physical forces
Kinematics
Summary
6. Data Acquisition and Mapping
Data acquisition
Dealing with local files
Accessing data remotely
Using OSC
Using MIDI
Using Serial Port
Machine listening
Tracking amplitude and loudness
Tracking frequency
Timbre analysis and feature detection
Onset detection and rhythmical analysis
Basic mappings
Preparing and preprocessing data on the client side
Preparing and preprocessing data on theserver side
Basic encodings and interpolation schemes
Sharing and distributing data
Summary
7. Advanced Visualizers
Audio visualizers
Trailing waveforms
Spectrogram
Music visualizers
Rotating windmills
Kinematic patterns
Visualizing and sonifying data
Particles and grains
Fractalizer
Summary
8. Intelligent Encodings and Automata
Analyzing data
Statistical analyses and metadata
Probabilities and histograms
Dealing with textual datasets
Advanced mappings
Complex and intelligent encodings
Neural networks
Automata
Cellular automata
Game of Life
Summary
9. Design Patterns and Methodologies
Blackboard
Methodology
Model-View-Controller
Handling multiple files and environments
Threads, semaphores, and guards
The View
Clients and interfaces
Implementation
Strategies and policies
The Model
Aggregates and wrappers
Software agents
Introducing software actors and finalizing the model
The Controller
Game of Life
Finalizing the Controller
Summary
Index O autorze: Marinos Koutsomichalis (Athens, 1981) is an artist and scholar working with sound and a wide range of other media. His artistic work interrogates the specifics of site, perception, technology, and material. His academic interests include computer programming, generative art, new aesthetics, and environmental sound and noise. He has widely performed, exhibited, and lectured internationally and has held residencies in miscellaneous research centers and institutions. He has an MA by research in composition with digital media by the University of York and, as of writing, he is a candidate PhD in Music, Sound, and Media Art at the De Montfort University. He is in the board of the Contemporary Music Research Center (KSYME-CMRC) and also the director of its class of Electronic Music and Sound Synthesis. As of writing, he is a research fellow in the University of Turin. mniej