Page  00000001 NOTEABILITY - A COMPREHENSIVE MUSIC NOTATION EDITOR Dr. Keith A. Hamel U.B.C. School of Music 6361 Memorial Rd. Vancouver, B.C. CANADA V6T 1Z2 hamel /hamel.html Abstract NoteAbilityTM is a comprehensive music notation editor which has been under development for about 6 years. NoteAbility was designed to support the graphical flexibility required by composers of contemporary music as well to provide all the standard music editing procedures such as transposition, part extraction and page reformatting. NoteAbility is able to do this because it includes graphical and non-graphical classes of most music images. NoteAbility is ideally suited to the computer music community because it can represent a wide range of score types (including complex graphical scores) and because it can be used in conjunction with many of the music applications commonly used by composers of computer music. 1. Background Donald Byrd [Bryd, 1986] stated that music notation editors could be categorized by the degree to which they were Semantic-oriented versus Graphics-oriented. Those that are concerned primarily with the sematics and the structure of music (i.e. Semantic-oriented programs) often struggle with the difficulty of including non-standard music symbols, of representing graphical scores, and of allowing the user to contradict the conventions of Common Music Notation (CMN). Those that are designed with a strong graphics orientation allow graphical flexibility, but may have difficulty performing certain music editing and page formatting functions such as transposition, part extraction and automatic wrapping of measures. Examples of programs that are Semantic-oriented are FinaleTM and EncoreTM, and those that are graphics-oriented are NoteWriterTM [Hamel, 1989] and ScoreTM [Smith, 1973]. NoteAbilityTM [Hamel, 1997] was designed to support both models; it has a well-defined music structure and a knowledge of the standard conventions of music notation, yet it allows a high degree of graphical flexibility and it is easy to contradict or override the syntax of CMN. NoteAbility was originally developed for NeXTStep computers using Objective C. It was later ported to OpenStep and is currently being ported to Rhapsody. In addition, a scaled-down version of NoteAbility is being written in C++ for Macintosh and Windows platforms. 2. Overview and Design Philosophy of NoteAbility Some of NoteAbility' s design came from the fact that it was initially developed under NeXTStep; it used display PostScript, and therefore could handle complex graphics easily and with a high degree of precision, it supported multiple pasteboard types and inter-application messaging, and was constructed with an advanced Graphical User Interface (GUI) which include dragging and dropping of icons, user-extensibility and on-line help. Although most of these features are now available on other computer systems, they have been part of the NeXTStep operating system for many years. In terms of the overall GUI, I adopted the paradigm of a composer working on manuscript paper, so NoteAbility provides the user with blank pages of score paper and allows the composer the flexibility and freedom that would be available if she were working on paper; she can start anywhere on the page and enter images in any order desired. I chose this layout because I felt that was most natural for a composer and I recognize that when you fundamentally change the mode of interaction or the tools used to perform a task, you risk changing the results of the task. My goal was to provide tools to assist composers doing what they already know how to do, not to alter or restrict what they do. 3. Underlying Music Structure In order to support both the Semantic-oriented and Graphics-oriented models, NoteAbility borrowed the notion that exists in some graphics programs of having multiple layers. The background layer of NoteAbility consists of the Systems, Staves, Measures, Beats and Sub-beats. This layer is always drawn first, and represents the underlying music structure. (Of course, these images may or may not be visible, but they are present none-the-less.) A Page

Page  00000002 consists of one or more Systems, each of which consists of a two dimensional grid where beat positions (within measures) form the x-axis and staves (or to be more precise - location relative to the staves) form the y-axis. All images which appear in foreground layers are linked to the background by two associations: every image has at least one beat position in a measure, and every image is located some distance from at least one staff in the system. These associations are essential for changing page or system layout and for cutting and pasting within documents and between documents. While some images have only one beat position and staff assocation, others (eg. crescendo marks) have two and some (eg. slurs) have three. When the underlying muisc structure is altered (by manual or automatic adjustment of the beat or staff positions), the surface images are re-aligned to their associated staff and redrawn at their corresponding beat positions. The figure below shows a collection of music images along with their main associations. Although the positions of the Measures, Beats and Staves are different in the two music examples, the image data (and their associations) remain the same. 0.0 1.0 2.0 3.0 1.0 2.0 3.0 = 69 Delicately 8 P v I I I |,. senmpre! 0.0 1.0 2.0 3.0 1.0 2.0 3.0 = 69 Delicately -------- ----, "m t I I i i / -------.-.-. --------..---...... --......... --........... --- I - ------ Pp~l~e Image GraceNote (16th) Slur GraceNote (16th) PPP GraceNote (16th) GraceNote (16th) Text (q = 69...) Piano Half note P Half note Measure StaffAssociation: BeatPos 1: 0.219 1: 0.241 1:0.369 1:0.045 1:0.549 1:0.695 1: 0.886 1: 1.034 1: 1.0 2:0.884 2:1.0: StepsFromStaff 1:1 1:0 1:6 1:-5 1:7 1:10 1:18 1:14 1:7 1:-5 1:7 Image TS Graphic Text (sempre) Pedal QuarterRest QuarterRest Line (arrow) QuarterNote PP LVBelow QuarterRest EighthRest Measure: BeatPos 1: -0.36 1: 0.755 1: 0.406 1: 1.0 1: 2.0 1: 0.755 1: 3.0 1: 3.029 1: 3.19 2: 1.0 2: 2.0 StaffAssociation: StepsFromStaff 2:-3 2:-15 2:-12 2:4 2:4 2:-13 2:0 2:-7 2:-3 2:4 2:4 Figure. - Music Images with Beat Positions and StaffAssociations (Hamel - "I remember...") 4. Graphical Flexibility In order to accommodate the diverse notational requirements of composers, NoteAbility has been designed to be as flexible as possible. Any music image can be any size, any colour, and most of its attributes can be easily altered. The size and attributes of an image are independent of any images (i.e. a staff or other notes in a chord) that it is associated with or connected to. (Lent et grave) 30 pp N:--vTV 4 ff p e -. - qj ip --I Figure. 2. Graphical Flexibility of Music Images (Ravel -" Le Jardin feerique")

Page  00000003 To further support graphical flexibilily, Structural and Graphical classes of certain images are available. Structural Notes and Rests are associated with relatively simple beat positions in the measure, and although they can be offset from these beat positions, they cannot be freely moved around the page. Graphical Notes and Rests inherit all the attributes of Structural Notes and Rests, yet they can be placed anywhere on the page regardless of the resulting music syntax. In the figure below, the first two measure contain Structural Notes, Rests and Beams and the second two contain Graphical versions of the same images. Figure 3. Structural and Graphical Classes of Music Images In cases were the complexity of the score makes using Structural images awkward, the composer can simply use Graphical versions of the images (which can freely to beamed or associated to Structural images if needed.) In the figure below, Graphical and Structural images have been mixed to create a spatially-notated score. rancimornorci > random order Clar [ Elec. Figure 4. Freely mixing Structural and Graphical Images (Hamel - "Traces") 5. Import and Export Options NoteAbility is ideally suited to the computer music community because it can represent a wide range of score types and because it can be used in conjunction with many of the music applications commonly used by composers of computer music. Currently, NoteAbility can export scores or score fragments in Standard MIDI format [Hewlett, 1997], in NeXT score format [Jaffe, 1989], as MAX qlists [Puckette, 1986], as MAX explode objects, as Csound scores [Vercoe, 1994], in GUIDO Music Notation format [Hoos, 1997] as well as all standard graphics formats. In many cases, it is possible to copy and paste between NoteAbility and other applications using these formats. A composer using NoteAbility, can select a portion of her score, copy it and paste it directly into a text editor as GUIDO, as a MAX qlist, as a Csound score file, as BPS, or as TIFF. It is also possible to paste GUIDO text strings directly into NoteAbility and have the corresponding music images appear. I chose GUIDO over NIFF [Grande, 1996] as my default interchange format because GUIDO is a text-based (and human-readable) format, because it allows simple music to be represented in a simple and compact way, and because it was easy to implement and to integrate into NoteAbility. In the example below, GUIDO code was copied from a standard text editor and pasted directly into NoteAbility. Vivace % example GUDIG code { [\tempo<"Vivace"> \intens<"p"> p. \sl(\bm(gol*1/8 a b) \bm( b& c2) \bm(c# bi a b& a&))] [ \sl(gl*3/8 d/4 c#*3/8 d/4)] Figure 5. Importing GUIDO code directly into NoteAbility (Bartok - "Mikrokosmos IV:]]5")

Page  00000004 6. Future Extensions and Conclusion Extensions to NoteAbility currently in progress include the conversion of optical scanning files from the OMR system developed by Ichiro Fujinaga [Fujinaga, 1992] and further support for GUIDO Music Notation format. NoteAbility has been designed with the professional composer in mind; it provides a flexible graphical environment along with musical intelligence and sophisticated editing abilities. The program has now been under development for about 6 years, and as it continues to evolve, the feedback and suggestions from composers and other musicians is always welcome. ---7:6 115 A: --I----3r Figure 6. NoteAbility Score example (Steenhuisen - "plea"for Piano) 7. References Byrd, D. (1986) "User Interfaces in Music-Notation Systems," Proceedings of the 1986 ICMC, pp. 145-151. Fujinaga, I., Alphonse, B., Pennycook, B, and Diener, D. (1992) "Interactive Optical Music Recognition", Proceedings of the 1992 ICMC, pp. 117-120. Grande, C. & Belkin, A. (1996) "The Development of the Notation Interchange Format" Computer Music Journal 20(4). pp.33-43. Hamel, K. (1989) "Advanced Music Editing Using the NoteWriter Music Notation Software" Proceedings of C.E.C Electroacoustic Days at Banff, pp. 87-92. Hamel, K. (1997) NoteAbility Reference Manual. Opus 1 Music Inc. Vancouver, Canada. Hewlett, W. & Selfridge-Fields, E. (1997) "MIDI" in Selfridge-Fields, E. (ed.) Beyond MIDI, The Handbook of Musical Codes. pp. 469-490, MIT Press, Cambridge, Massachusetts. Hoos., H. & Hamel, K. (1998) "Towards an Adequate Representation of Score Level Music", Proceedings of the Joumn6e d'Informatique Musical (JIM'98). Jaffe, D. & Boynton, L. (1989), "An Overview of the Sound and Music Kits for the NeXT Computer", Computer Music Journal 13 (2). pp.48-55. Puckette, M. (1986) "Interprocess Communciation and Timing in Real-time Computer Music Performance" in Proceedings of the 1986 ICMC, pp. 43-46. Smith, L. (1997) "SCORE" in Selfridge-Fields, E. (ed.) Beyond MIDI, The Handbook of Musical Codes. pp. 252 -280, MIT Press, Cambridge, Massachusetts. Vercoe, B. (1994) MITe Media Lab Csound Manual. MIT, Cambridge, Massachusetts. For more information on NoteAbility, see 1/welcome.html. J ffe, D.&0ytn.(9 9," nO eve fteS ud n ui isfrteN o p trC m ue