Page  198 ï~~Modeling a Hypermedia Composition/Performance System Larry Austin Center for Experimental Music and Intermedia University of North Texas Denton, Texas, USA 76203 EMail: austin@cube.cemi.unt.edu ABSTRACT A functional model for a hypermedia composition/performance system is explicated with examples specific to the presenter's composition, AccidentsTwo: Sound Projections for Pianist with Computer Music (1992), commissioned by the Montague/Mead Piano Plus Electronics Duo and funded by a Faculty Research Grant from the University of North Texas. This paper reports on continuing research and compositional realizations by the author to synchronize and integrate electronic and computer music performance with soloists, ensembles, and other media [Austin 1967, 1968, 1970, 1975, 1982, 1985, 1987, 1991; Clark, 1984, 1989]. 1 Introduction The author's musical work, AccidentsTwo: Sound Projections for Pianist with Computer Music (1992), scored for electronically amplified/processed piano with preprocessed computer music and performed by a pianist and a sound projectionist, is described as a model for a hypermedia composition/performance system. "Hypermedia", in this prototypical application, is defined as a system in which various forms of information-data, text, graphic notation, and audio-are dynamically linked and interpreted by the performers. AccidentsTwo can be performed in open, set, or open/set form, the continuity and combination of individual musical events defined and realized in both graphic and sonic terms. The sound coloration and diffusion of AccidentsTwo are dynamic--combining, alternating, contrasting, projecting, and integrating the constantly moving, amplified/processed sound colors of the piano with constantly moving, prerecorded, pre-processed computer-generated sonic events. The graphic notation, read and interpreted from projected score-slides by both the pianist and * the sound projectionist, has its analog in traditional musical notation and in graphic plots representing functions over time and space, involving a special performance protocol, integrating and coordinating the performers' roles in the piece. 2 Performance 2.1 The Medium AccidentsTwo is scored for electronically amplified/ Â~ processed piano with pre-processed computer music, performed by a pianist and a sound projectionist with assistants or, in current development, with computeraided automation. 2.2 Form and Continuity AccidentsTwo can be performed in open, set, or open/set form. In open form, the piece begins, con tinues, and ends at any point in time, its continuity of musical events and their ordering randomly programmed by the performers. In set form, the piece begins and ends at specific points in time, its continuity of events and their ordering empirically programmed by the performers. In open/set form, the perforners create a continuity of random and empirically ordered events. 2.3 Pre-processed sonic events In AccidentsTwo, the continuity and combination of individual pre-processed sonic events are defined and perfor ed in both graphic and sonic terms. An open, set, or open/set selection from the total collection of 51 graphic events in tablature notation is read by both performers, the 1-to-4 score-slide(s) for each graphic event successively advanced by the pianist. Each of the total collection of 73 pre-processed sonic events is accessed for playback by the sound projectionist by incrementing or decrementing program number indices for each sonic event on a digital audio tape (DAT) or optionally with a computer, accessing numbered soundfiles stored on disk. Notated graphic events have an open, variable duration ranging from as brief as 20 to as long as 120 seconds and averaging about 40 seconds. Each pre-processed sonic event, of course, has a specific duration, ranging from as short as 10 to as long as 150 seconds and averaging about 30 seconds. 2.4 Accidental sonic events Piano sounds are produced through accidental rather than deliberate action. The pianist depresses the keys silently so that sound occurs only when a hammer accidentally strikes a string. The sustaining pedal is fixed with a weight, so that it is constantly engaged, lifting the dampers and allowing the strings to vibrate freely. Â~"Accidents"--accidental sounds--occur, depending on the key action, the pressure applied to the keys (i.e., velocity), and the sensitivity and proximity of three microphones placed strategically above the 3B.3 198 ICMC Proceedings 1993

Page  199 ï~~strings in close proximity to the dampers/hammers. The dynamic range of the piano sounds can neither be controlled nor predicted. In general, however, this will depend on the strength of the sound of the accidents, the sensitivity of the microphones and electronic sound processors, and, finally, the discretion of the player. Depending on the proximity of the microphones to the piano strings, feedback is r lQ and should, with reasonable discretion, be exploited by using such electronic artifacts in the processing and movement of the sound. It is, in fact, desirable'that the sounds of the "silent" action of depressing the keys be heard as an audible artifact of the piano amplification and sound processing. It will be found that signals, once initiated, can be prolonged and affected by the next accident-and the next, etc. The- scored events of the piece should always be played as fast as possible and at the most hazardous pace, making accidents-sounds-highly probable. With successive performances it is possible that the pianist may develop techniques to avoid accidents; this happening, the pianist should counter (sic) such gradually acquired technique by playing faster and with more abandon. 2.5 Sound Coloration and Diffusion The sound coloration and diffusion of AccidentsTwo are dynamic--combining, alternating, contrasting, projecting, and integrating the constantly moving, amplified/processed sound colors of the piano with constantly moving, pre-processed computer-generated sound colors. Processing the piano sounds involves two electronic devices: a multi-effect signal processor (e.g., the Yamaha SPX000) and a digital delay processor (e.g., the Bel DB-80). The resulting processed sound is mixed and moved dynamically in the performance space with the pre-processed, constantly moving computer music stored and played back from DAT or computer. A network of loudspeakers should be placed about the performance space, so that the audience can experience the dynamic movement of the piano sounds and computer music. 3 Notation 3.1 Interpreting the notation Illustrated in Figure-i with boxed explanations on the first of two score-slides of event number 36, the notation is read and interpreted by both the pianist and the sound projectionist. The notation has its analog in traditional musical notation and in graphic plots representing functions over time and space. Traditional music notation, for example, involves the tablature notation technique, an analog to the registers and keys of the piano, the stems of notes, and the relative melodic contour of a sequence of designated pitches and their durations. Graphic plots, for ICMC Proceedings 1993 199 3B.3

Page  200 ï~~example, involve mapping n excursions of function y (e.g., 5 volts, amplitude) through vectors in a field over n units of time x (e.g., 20 seconds). 3.2 Notation for the pianist 3.2.1 Score-slides-Each event consists of from Ito 4 score-slides, the number and order found in bold, 18 -point type at the lower right-hand corner of each score-slide; for example, "36-1/2" represents the first of two score-slides of the 36th event. 3.2.2 lime and pitch-The pianist reads each projected score-slide from left to right. The passage of musical time is measured in seconds, relative to spatial extensity from left to right. The nominal duration of each score-slide ranges from 20 to 30 seconds. Pitch selection is relative to the outline of a piano keyboard, upended rectangles found at the beginning of distinctive transients in the amplitude plot of the recording of an accident through the course of the score-slide(s) of any particular event. The highest register of the piano is at the top of the slide, the lowest register at the bottom. 3.2.3 Interpretation-The waveform plot seen on each score-slide is to be freely interpreted by the pianist as a graphic tracing of melodic/rhythmic contours. Pitches are improvised according to the contrapuntal lines and sonorities that the amplitude excursions of the waveform plot traces and suggests in relation to the keyboard tablature. The pianist's right hand is used to play the melodic/rhythmic contours of the upper half of the waveform plot, the left hand to play the lower half. The pianist is encouraged to be inventive in interpreting this analog of traditional notation. For instance, the waveform plot can suggest a kind of random "wiggling" of the fingers over a random selection of black and white keys or, in contrast, relatively precise interpretation of interval displacement and pitch choice. Precise interpretation suggests intervalically disjunct melodic lines; freer "wiggling" suggests intervalically conjunct lines. Integrating precise playing with less precise "wiggling" yields a higher degree of variety in the improvisation. 3.2.4 Chord-clusters--The solid black rectangles appearing aperiodically and in diverse registers of the waveform plot are played as free chord-clusters, their range relative to their height. The pianist is encouraged to interpret and improvise.freely the density of chord-clusters, alternating aperiodically between playing:them as I) a cluster of all black and/or white keys depressed with the flat of the hand or-with the tallest ones-with the forearm; and others as 2) a cluster of a random collection of black ad/or white keys depressed by from two to five fingers. 3.3 Notation for the sound projectionist 3.3.1 Score-slides-See item 3.2.1. 3.3.2 Stored sonic events-The positive and negative integers seen in bold, 64-point type at the top-right of each keyboard tablature represent the DAT program numbers to be incremented or decremented, when an accident occurs during a particular score-slide (see item 4.3). 3.3.3 Delayed sounds-The positive and negative, real numbers seen in italicized, 14-point type next to the movement arrows on each score-slide represent digital delay values which the sound projectionist sets during the course of a particular score-slide (see item 4.4). 3.3.4 Sound diffusion-The bold, arrow-tipped lines found on each score-slide are movement arrows, tracing the direction of movement of the amplified/ processed piano sounds through a two-dimensional field as viewed from above the performance space. The movement so indicated in an event on each score-slide begins at the black circled-tip of the first movement arrow. When there is more than one score-slide in an event, the movement is continued on the next slide from the last spatial locus on the previous slide. Movement between events from the last locus to the new locus is adjusted freely. The speed of the continuous movement of sound through the space is relative to the length and continuation of the movement arrow(s). Since each score-slide ranges in performance time from 20 to 30 seconds, the speed of movement is measured by how long it takes to trace the course of the indicated movement arrows. When there is only one movement arrow partially crossing the space, the movement of sound is slow; when there are multiple crossings and/or loopings of the space with continued movement arrows, the movement of sound is rapid. 3.3.5 Sound processing-The color bars framing the top and bottom of each score-slide indicate the type of signal processing set and invoked during that particular numbered event. The color bars are assigned to the following categories of signal processing: modulation=red; pitch-change=green; distortion=yellow, compression/expansion=light blue; gating=dark blue; and comb filtering =orange. 4 Continuity protocol 4.1 Score-slide projection The slide projector carousel is loaded with the appropriate score-slides and positioned so that both performers can clearly see the projected slides. Ideally, the piano lid should be removed, the keyboard facing the audience with the pianist seated at the piano downstage, his/her back to the a'udience. The sound projectionist is positioned with the electronic equipment configuration.at the center of the performnce space. A large projecton screen or white flat is positioned upstage from the piano, directly in front of the pianist, the sound projectionist, and the audience. 3B.3 200 ICMC Proceedings 1993

Page  201 ï~~4.2 Score-slide incrementing The score-slides are advanced periodically or aperiodically in the chosen order. The length of time for each score-slide seen, before advancing to the next, is, optionally, a) advanced automatically at a pre-set rate of 20 seconds per slide or b) advanced at varying rates from 10 to 40 seconds by the pianist with his/ her foot, utilizing the remote control device for the projector, or by an assistant on cue from the pianist. 4.3 DAT sonic event stream At the beginning of the performance, the DAT is cued at the first positive Program Number (PNO) appearing on the first score-slide of the first event, set on "pause", ready to play. When the first accident occurs during that or a subsequent score-slide, the sound projectionist presses "play" on the DAT, causing the currently selected PNO sonic event to begin its playback. When subsequent accidents occur, he/she increments or decrements the PNO by freely choosing one of the numbers appearing on the current slide, ideally (if audibly discerned) the PNO determined by when and where an accident occurred in the course of an event. Upon hearing the next accident, he/she plays back the newly selected PNO. Incrementing or decrementing the DAT should take place just after the computer music of the current PNO ends in silence. DAT machines which can be cued quickly to a specific PNO are preferable. 4.4 Delay rate and signal processing Meanwhile, the sound projectionist is setting the digital delay rate, which changes in every event on each score-slide. The digital delay values range from 0 to 4 seconds. When a positive number goes above 4, the difference between 4 and the greater number is added to zero for the new rate. When a negative number goes below zero, the difference between zero and the lesser number is added to zero for the new rate. Also, meanwhile, the sound projectionist is changing and monitoring the signal processing prescribed by the color bars of the current event (see item 33.5), as well as the amplitude level of the overall mix of live and pre-processed sound. 5 Performance manifestations 5.1 Current performances The preview performance in August, 1992 (Dartington, UK), and the premiere performance in June, 1993 (London, UK), of AccidentsTwo have been successfully presented by the Stephen Montague/ Philip Mead Piano Plus Electronics Duo. In both the preview and premiere performances, the pianist cued assistants to advance each score-slide manually. The sound projectionist required an assistant in the preview performance to monitor and manually operate DAT sonic event access and playback; in the premiere performnce the sound projectionist perfore all processing, diffusion, and playback manually. 5.2 Future manifestation The author is currently developing an automated computer-implemented realization of the AccidentsTwo manual model involving a dynamic, realtime, interactive computer music performance system on cd-rom, which will serve both as a real-time graphic score, an event-controller, and an electronic processor of live and pre-processed piano sounds. References [Austin, 1967] Larry Austin. The Maze: A Theater Piece in Open Style for Three Percussionists, Dancer, Tapes, Machines, and Projections, Source: Music of the Avant Garde, Davis, CA, Issue 1, Vol. 1, No. 1, pp. 3-37, 1967. [Austin, 1968] Accidents, for electronically prepared piano, ring modulator, mirrors, actions, black light, and projections,ibid, Issue 4, Vol. 2, No. 2, pp. 20 -23, 1968. [Austin, 1970] Caritas, for computer music on tape, sculptures, and slides, ibid, Issue 8, Vol. 4, No. 2, pp. 42-43 and 53, 1968. [Austin, 1975] w/Larry Bryant. A Computersynchronized, Multi-track Recording System, Proceedings, Second Annual Music Computation Conference (ICMC), Urbana, IL, part 4, pp. 1-12, 1975. [Austin, 1982] Phantasmagoria: A Chronicle of Computer-assisted Composition/Performance, Proceedings, 1982 International Computer Music Conference, Venice, pp. 610-612, 1982. [Austin, 1985] Charles Ives's Life Pulse Pre-lude: A Realization for Modern Performance from Sketches for the Universe Symphony, Percussive Notes: Research Edition, Vol. 23, No. 2, pp. 58-84, 1985. [Austin, 1987] Austin and Eugene DeLisa. Modeling Processes of Musical Invention, Proceedings, 1987 International Computer Music Conference, University of Illinois, Computer Music Association, San Francisco, CA. pp. 200-207, 1987. [Austin, 1991 LAustin, Charles Boone, and Xavier Serra, Transmission Two: The Great Excursion (T:TGE)-The Aesthetic, Art and Science of a Composition for Radio, Leonardo Music Journal, Vol. 1, No. l, pp. 81-89, 1991. (Clark, 1984] Thomas Clark. Duality of Process and Drama in Larry Austin's Sonata Concertante, Perspectives of New Music, VoL. 23, No. 1, pp. 112 -125, 1984. [Clark,1989] Interview with Larry Austin-Coasts: On the Creative Edge with Compo~ser Larry Austin, Computer Music Journal, Vol. 13, No. I, Spring, pp. 21-35, 1989. ICMC Proceedings 1993 201 3B.3