Creating and Manipulating Sound to Enhance Computer Graphics I: Algorithms and Techniques

Title	Creating and Manipulating Sound to Enhance Computer Graphics I: Algorithms and Techniques
Publication Type	Conference Paper
Year of Publication	1996
Authors	Freed, Adrian [1], Bargar Perry Cook [2], Robin [3], and Serra Xavier [4]
Conference Name	Siggraph 1996
Abstract	17. Creating and Manipulating Sound to Enhance Computer Graphics I: Algorithms and Techniques Half Day / Intermediate An introduction to concepts of digital sound synthesis and manipulation: theory, algorithms, and issues in the computation of sound alone and sound combined with graphics. Specific topics include psycho-acoustics, algorithms for audio synthesis and processing, and networked audio. Source and binary code are available via ftp. Who Should Attend Engineers and people interested in sound for long-range development involving virtual environments, VRML, and multimedia. Organizer Perry Cook Princeton University Lecturers Robin Bargar University of Illinois at Urbana-Champaign Xavier Serra Pompeu Fabra University Adrian Freed University of California, Berkeley Schedule 8:30 am: Welcome, overview of course, introduction of speakers - Cook 8:35 am: Sound in Digital Media, Some Opening Thoughts - Bargar/Freed What you Might Be Thinking About Sound - Isn't Sampling the End? What We Hope You Will Think About Sound - If Sampling Isn't The End, What Else is There? Parallels Between Sound Synthesis and Animation/Rendering Goals, and How We Propose to Achieve Them Integrating Sound and Graphics: systems issues 9:15 am: Views of Sound - Serra Time Domain and Frequency Domain Production and Perception 9:35 am: Survey of Synthesis and Processing Algorithms - Cook/Serra Additive Analysis/Synthesis Subtractive Analysis/Synthesis Non-Linear Synthesis (FM, WaveShaping) 10:00 am: Break 10:15 am: Survey of Synthesis and Processing Algorithms (continued) - Cook/Serra Spectral Modeling Modal Synthesis Physical Modeling 10:40 am: Controlling and Scripting Sound Synthesis and Processing - Bargar/Freed Note and Event Lists, MIDI Relations to HTML, VRML, etc. Firewire, LAN's Coherent, multiplatform control from Tcl/TK, Matlab, MAX, Visual Basic, Java, C, C++ 11:20 am: Synthesis Platforms, Software Environments, and Computing Issues - Freed MIDI modules vs. Sound Cards vs. Software Synthesis Reliable, low latency control and Real-Time Issues Networked Audio Synchronization with Gesture and Graphics Creating and Manipulating Sound to Enhance Computer Graphics II: Applications and Demonstrations Half Day / Intermediate Specific applications and demonstrations illustrating the use of sound synthesis to enhance graphics applications. This course presents alternatives to sampling synthesis for those who want to apply more expression in the control of audio. Specific topics include sound in GUI- controlled applications, animations, virtual reality, HTML, and VRML. Source and binary code are available via ftp. Who Should Attend Engineers and people interested in sound for long-range development involving virtual environments, VRML, and multimedia. Organizer Perry Cook Princeton University Lecturers Robin Bargar University of Illinois at Urbana-Champaign Xavier Serra Pompeu Fabra University Adrian Freed University of California, Berkeley Schedule 1:30 pm: Welcome, overview, introductions - Cook 1:35 pm: An Introduction to using the Software - Cook/Serra/Freed FM, Modal, and Subtractive Synthesis using "Synthesis ToolKit" Controlling spectral transformations using the SMS software Physical Models Using the "Synthesis ToolKit" Real-time Additive Synthesis and Control Using "CAST" - (CNMAT Additive Synthesis Tools) 2:30 pm: GUI Controlled Sound, WEB Applications, and Animation - Cook/Bargar Controlling Sound with Basic GUI Controls and MIDI Sound Connected to Animation software 3:00 pm: Break 3:15 pm: GUI Controlled Sound, WEB Applications, and Animation (continued) - Freed/Serra Sound Connected to WEB applications WEB applications for sound transformations and morphing 3:45 pm: Animation Applications and Demos - All Animations 1 Animations 2 Animations 3 4:15 pm: Web Demos and Guided Tour of Interesting Sites 4:35 pm: Wrap up - Cook