Page  53 ï~~Computer-Graphic Tools for Music Analysis Alexander R. Brinkman Eastman School of Music, University of Rochester 26 Gibbs Street, Rochester, New York 14604 USA Martha R. Mesiti 82-67 Austin Street, Apartment 212 Kew Gardens, New York 11415 USA Abstract A set of computer-graphic tools that help to analyze musical data visually in an intuitive and informative manner is described.We use DARMS-encoded compositions and a computer score representation designed for various analytic applications. The approach is flexible and accurate; many different types of information can be extracted easily and displayed with precision. Introduction The use of graphic techniques to illustrate aspects of musical scores dates back at least to Alfred O. Lorenz (1924), who used graphs to show the modulatory scheme for Wagner's Ring Cycle. More recent examples are found in the seminal work of Cogan and Escot (1976) and various writings by other authors, e.g., Berry (1976), Howat (1983), Bernard (1987), and Roeder and Hamel (1989). In most cases these graphs were produced manually, a process that is time-consuming and prone to inaccuracies. Sound spectrum photographs (Cogan, 1984) and computer-generated sonograms (Waters and Ungvary, 1990) have also been used for visual documentation of musical structure. Although powerful, these techniques are quite specific in their utility and limited in flexibility. Our approach uses DARMS-encoded compositions and a computer score representation (Brinkman, 1986 and 1990) designed for various analytic applications. The approach is powerful, flexible, and highly accurate, since many different types of information can be extracted easily and displayed with precision. The data, derived directly from the score structure, is passed through a program filter that generates a PostScript description of the graph, which can be displayed on a computer screen or printed on a high-resolution laser printer. The technique is extensible, and little new code is required to produce each new graph type. The following pages contain samples of our graphs; space limitations preclude presentation of all graph types. Pitch Space and Time Since music exists in time, it is impossible to perceive its structure all at once. Even the printed score shows only small portions of a large work on each page, and the vertical relationship among various instruments is only implicit to an expert score reader. A good graphic representation enables us to perceive many aspects of the musical "shape" of a composition. One type of graph that can be helpful plots pitch on the vertical axis and time on the horizontal. Figure 1 shows this representation of the first 26 measures of Bela Bart6k's fourth string quartet. The ticks on the vertical axis represent C in each octave from C1 to C7 (the third tick up from the bottom is C4 or "middle C"). Each tick on the horizontal axis represents one whole-note unit of time. This graph is somewhat like a sonogram, except that it is derived from the score rather than from acoustic sounds, and -I -1 -x- 27 12 -y- 84 bartok.quartet4.noteplot Figure 1 ICMC 53

Page  54 ï~~Brinkman and Mesiti, Graphic Tools -1 -x- 27 12 -y- 84 bartok.quartet4.partplot B B B B B B BB BBB BBBB BB B B B B B 8 BS A AA A A A A AAA AAA A AAA AA A A A MAAAA A A AAA A _A A A AAA 9 9 9 9 88 B 88 88 888 88888888 888 888888 8 7 7 7 7 7 _77 7 7 7 77 7 7 7 6 6 6 6 66 6 66 6 66 6 5 5.5.5 5 5 5_5 4 4 444 4444444 44 44444 4 4 4 4 44 4 4444 4 __44444 44444 444 4 3 333 3 3 3 3 3 3 3 33 3 3 33 32 3 222 2 33 3 3 3 3 3 33 22 2 2 2 2 2 2 2 2 2 2 22 2222 22222 22 22 2222 22 222 222222 22222222222222 22 2 2 2 2222 1 _ 1 11 1_ 11 _.. 11.2___1 1 1 111null1 _n 1i 1 11 111 n nllll Ill 1111 1 1 0 0 0 0o0 0 0 0003 00 0000_0_ oo00003o 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0o0 0000 00 0( -1 -x- 27 -1 -y- 12 bartok.quartet4.pcdist only the fundamental frequency of each pitch is shown. The composers utilization of acoustic space is clear but the individual lines are not, since it is impossible to differentiate the various instrumental parts and the rhythmic structure is difficult to follow. Figure 2 is the same excerpt in what we call a PartPlot. Here the lines representing pitches in each instrumental part are connected, except across rests (we also introduce a short space between repeated notes). The musical structure and voice leading become much clearer, and features such as rhythmic interaction between parts, voice crossing, and points of imitation become obvious. Repetitive figures such as ostinatos are immediately apparent. This type of graph is similar to Cogan's "line drawings," but since they are generated by computer, music of great complexity and entire movements can be represented easily and accurately. We have graphed pieces by composers from Bach to Berio, and have found that stylistic differences are remarkably apparent in the visual representation. Figures 5 and 8 show two complete movementsthe fugue from Bart6k's Music for String Instruments, Percussion, and Celesta (hereafter MSPC), and the first movement of Webern's Symphonie Op. 21. The general shape and many features of each movement can be seen much more easily than with a conventional score, since all pitches are in the correct vertical position relative to each other. We have Figure 3 found that even people who do not read music can follow these graphs while listening to the music, and that the visual representation helps to clarify many features, since the entire movement can be seen as a unit and details can be examined in any order desired. The subject entries, strettos, and wedge design of MSPC/I are immediately apparent. One can also differentiate areas of relative motion and stasis, and can clearly perceive Bart6k's technique of opening up gaps in registral space and then filling them in. The inversional symmetry in the coda is also clearly visible. Figure 6 is a pitch-space plot of MSPC/I. As each new pitch enters, a line is drawn to the end of the excerpt at the appropriate height. This graph shows that Bart6k systematically opens up and fills in the chromatic pitch space. 75 -x- 81 60 -y- 78 mspcl.celesta Fig. 4 Our programs allow us to extract any portion of the score to examine more closely. Figure 4 is the celesta part in the coda magnified so that we can see the details, rather than just the general "radiator" shape in Figure 5. The Webern movement (fig. 8) is also well known, particularly through Perle's analysis (Perle, 1962). This movement consists of three double canons, ICMC 54

Page  55 ï~~Brinkman and Mesiti, Graphic Tools which are clearly differentiated in the graph by changes in articulation, register, and axis of symmetry. For example, the first canon uses more short, detached notes, is in a lower register and is symmetrical about the horizontal axis on A3. In the second canon more notes are connected, the register is higher, and the second half is a free retrograde of the first half, i.e., there is symmetry around a vertical axis. Pitch-Class Distribution There are many ways to plot pitch-class content in a piece. In short excerpts, pc integers can be placed above each attack point in a PartPlot. If we are not interested in voice leading, but do want to see register, we can plot pcs in register as in Figure 10, which shows clearly that the pitch classes in first canon of Webern's Op. 21/I are registrally fixed and symmetrically disposed around pc 9. Another perspective is obtained by plotting pcs against time without regard to register. Figure 3 shows that in the beginning of Bart6k's fourth quartet the aggregate is completed quickly, followed by long stretches in which certain pcs are absent. In this graph horizontal lines indicate duration and pc integers indicate attack points. Al ternately, pitch-class content, as a function of time or duration can be plotted using bar graphs. Again, the graph can be limited to specific parts or temporal portions of the score. The bar graph is also useful in visualizing tessitura if pitch frequency is displayed as a percentage of the total number of notes, arranged from high to low. Rhythm, Dynamics, and Other Parameters We have already seen that PartPlots show the rhythmic interaction between parts. We can also show the composite rhythm of all parts or selected parts of any musical segment. Figure 9 shows the composite rhythm of the first movement of Webem Op. 21; the different activity in the three double canons can be discerned. Figure 7 shows that the dynamic shape of MSPC/I reinforces the wedge-shaped compositional design. We have also used graphic techniques to show the row distribution in twelve-tone music. For example it is a simple matter to separate the canons in each double canon in the Webern movement, and then to display each row form separately. David Huron (1989) proposed semblant motion and -2 -x- 90 12 -y- 96 mspcl.partplot Figure 5 -2 -x- 90 12 -y- 96 mspcl.spaceplot Figure 6 -2 -x- 90 -120 -y- 120 mspcl.dynplot Figure 7 ICMC 55

Page  56 ï~~Brinkman and Mesiti, Graphic Tools onset synchrony as quantifiable measures of texture. The first groups contrapuntal motion into two types in which the pitch motions are either positively correlated (parallel and similar motion) or negatively correlated (contrary and oblique motion). The second is a measure of rhythmic diversity measured as the proportion of synchronous onset pairs. While his technique assigns a pair of values for semblant motion and onset synchrony to each member of several bodies of literature, we believe that these measures can be graphed separately as a function of time, and that this pair of graphs would be a useful addition to our arsenal of graphic techniques. We are also investigating approaches to a general measurement of textural density, and exploring various measurements of dissonance. Conclusion Graphic techniques are applicable to a large body of literature. Graphs can help us perceive the general textural, registral, and gestural "shape" of a composition. This overview, taken before (or after) the detail work of segmentation for other purposes, whether set-theoretic, harmonic, or Schenkerian analysis, helps one to get a broad view of the composition and its gestures. References Berry, Wallace. The Structural Functions of Music. New York: Dover, 1987. Bernard, Jonathan W. "Inaudible Structures, Audible Music: Ligeti's Problem, and His Solution." Music Analysis 6, no. 3 (1987): 207-36. Brinkman, Alexander R. Pascal Programming for Music Research. Chicago: The University of Chicago Press, 1990. "Representing Musical Scores for Computer Analysis:" Journal of Music Theory 20, no. 2 (1986): 225-75. Cogan, Robert and Pozzi Escot. Sonic Design: The Nature of Sound and Music. New Jersey: Prentice-Hall, 1976. Cogan, Robert. New Images of Musical Sound Cambridge, Mass.: Harvard University Press, 1984. Howat, Roy. Debussy in Proportion: A Musical Analysis. Cambridge: Cambridge University Press, 1983. Huron, David. "Characterizing Musical Textures." Proceedings of the 1989 ICMC, 131-34. San Francisco: ICMA. Lorenz, Alfred O. Das Geheimnis der Form be Richard Wagner. (1924). 4 vols. Facsimile ed. Tutzing: H. Schneider, 1966. Perle, George. Serial Composition and Atonality. Berkeley: University of California Press: 1962. Roeder, John, and Keith Hamel. "A General-Purpose Object-Oriented System for Musical Graphics." Proceedings of the 1989 ICMC, 260-63. San Francisco: ICMA. Waters, Simon and Tamas Ungvary. "The Sonogram: A Tool for Visual Documentation of Musical Structure:' Proceedings of the 1990 ICMC, 159-63. San Francisco: ICMA. F~~~~~u iIIFFFFFFFFFFFFFFFI 11F -2 -x- 67 12 -y- 96 webern.op21/l.partplot Figure 8 mffu~n~ummEE~tllFLVJ1 -2 -x- 67 2 -y- 5 webern.op21/1.rhythm Figure 9 A1 1111 1 11 1 d%1 1 5 5 7 22 7 48 41 4 4 4 4 4 4 4 B B B B B B B 11B 66 36 6 66 66 6 65 6885 68 8 9 901 9 d A A1A 0 3 53 55 33 5 $3 300 00 0 0 0 0) 0 000393 0 0 7 7 7 7 7 77 7 77 7 9 2 22 2 2 22 22 2 4 1 I _ _ _ 9 9, '5 5 0 02 2 4 4 88% A A 6 9 7 3 3 3 3 7 777 A 0 O7 7 7 0 04 7 0A44 2 4222 44 24 2 2422 66 B6B B B B B B B _ 666a 8 6 3 6 3 6 8 86 868 6 6 2 3 3 9 9 9 9 9 9 5 5 55 55 5 5 5 55 _I. 1 1 I I I I 1 I 1 1 I 1 I I 1 1 1 I I l l l 1 1 1 1 1 1 1 1 l 1 1 1 1 1 l l l l l l l l l l l l l l l l l l l l l l l t l l l t l it 11 -2 -x- 67 12 -y- 96 webern.op2l/l.pcplot ICMC 56 Figure 10