AMBIENT: Bodily Entrainment to Audiovisual Rhythms

• Riaz, Maham; Upham, Finn; Burnim, Kayla; Bishop, Laura & Jensenius, Alexander Refsum (2023). Comparing inertial motion sensors for capturing human micromotion, Proceedings of the Sound and Music Computing Conference 2023. SMC Network . ISSN 978-91-527-7372-7. doi: 10.5281/zenodo.8316051. Full text in Research Archive Show summary

  The paper presents a study of the noise level of accelerometer data from a mobile phone compared to three commercially available IMU-based devices (AX3, Equivital, and Movesense) and a marker-based infrared motion capture system (Qualisys). The sensors are compared in static positions and for measuring human micromotion, with larger motion sequences as reference. The measurements show that all but one of the IMU-based devices capture motion with an accuracy and precision that is far below human micromotion. However, their data and representations differ, so care should be taken when comparing data between devices.

• Guo, Jinyue & McFee, Brian (2023). Automatic Recognition of Cascaded Guitar Effects. In Serafin, Stefania; Fontana, Federico & Willemsen, Silvin (Ed.), Proceedings of the 26th International Conference on Digital Audio Effects. Aalborg University Copenhagen. ISSN 2413-6700. p. 189¨C195. doi: 10.5281/zenodo.7973536.
• Riaz, Maham & Christodoulou, Anna-Maria (2023). Using SuperCollider with OSC Commands for Spatial Audio Control in a Multi-Speaker Setup. In Andreopoulou, Areti & Boren, Braxton (Ed.), Proceedings of the Audio Engineering Society 155th Convention. Audio Engineering Society, Inc.. Show summary

  With the ever-increasing prevalence of technology, its application in various music-related processes, such as music composition and performance, has become increasingly prominent. One fascinating area where technology finds utility is in music performance, offering opportunities for extensive sound exploration and manipulation. In this paper, we introduce an approach utilizing SuperCollider and Open Sound Control (OSC) commands in a multi-speaker setup, enabling spatial audio control for a truly interactive audio spatialization experience. We delve into the musicological dimensions of these distinct methods, examining their integration within a live performance setting to uncover their artistic and expressive potential. By merging technology and musicology, our research aims to unlock new avenues for immersive and captivating musical experiences.

• Masu, Raul; Morreale, Fabio & Jensenius, Alexander Refsum (2023). The O in NIME: Reflecting on the Importance of Reusing and Repurposing Old Musical Instruments. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Aut¨®noma Metropolitana. ISSN 2220-4792. Show summary

  In this paper, we reflect on the focus of ¡°newness¡± in NIME research and practice and argue that there is a missing O (for ¡°Old¡±) in framing our academic discourse. A systematic review of the last year¡¯s conference proceedings reveals that most papers do, indeed, present new instruments, interfaces, or pieces of technology. Comparably few papers focus on the prolongation of existing NIMEs. Our meta-analysis identifies four main categories from these papers: (1) reuse, (2) update, (3) complement, and (4) long-term engagement. We discuss how focusing more on these four types of NIME development and engagement can be seen as an approach to increase sustainability.

• Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2023). Exploring Emerging Drumming Patterns in a Chaotic Dynamical System using ZRob. In Ortiz, Miguel & Marquez-Borbon, Adnan (Ed.), Proceedings of the International Conference on New Interfaces for Musical Expression. Universidad Aut¨®noma Metropolitana. ISSN 2220-4792. Full text in Research Archive Show summary

  ZRob is a robotic system designed for playing a snare drum. The robot is constructed with a passive flexible spring-based joint inspired by the human hand. This paper describes a study exploring rhythmic patterns by exploiting the chaotic dynamics of two ZRobs. In the experiment, we explored the control configurations of each arm by trying to create un- predictable patterns. Over 200 samples have been recorded and analyzed. We show how the chaotic dynamics of ZRob can be used for creating new drumming patterns.

• Riaz, Maham (2023). An Investigation of Supervised Learning in Music Mood Classification for Audio and MIDI. In Andreopoulou, Areti & Boren, Braxton (Ed.), Proceedings of the Audio Engineering Society 155th Convention. Audio Engineering Society, Inc.. Show summary

  This study aims to use supervised learning ¨C specifically, support vector machines ¨C as a tool for a music mood classification task. Four audio and MIDI datasets, each containing over four hundred files, were composed for use in the training and testing processes. Mood classes were formed according to the valence-arousal plane, resulting in the following: happy, sad, relaxed, and tense. Additional runs were also conducted with the linear discriminant analysis, a dimensionality reduction technique commonly used to better the performance of the classifier. The relevant audio and MIDI features were carefully selected for extraction. MIDI datasets for the same music generated better classification results than corresponding audio datasets. Furthermore, when music is composed with each mood associated with a particular key instead of mixed keys, the classification accuracy is higher.

• Remache-Vinueza, Byron; Trujillo-Le¨®n, Andr¨¦s; Clim, Maria-Alena; Sarmiento-Ortiz, Fabi¨¢n; Topon-Visarrea, Liliana & Jensenius, Alexander Refsum [Show all 7 contributors for this article] (2022). Mapping Monophonic MIDI Tracks to Vibrotactile Stimuli Using Tactile Illusions. In Saitis, Charalampos; Farkhatdinov, Ildar & Papetti, Stefano (Ed.), Haptic and Audio Interaction Design. Springer Nature. ISSN 978-3-031-15019-7. Show summary

  In this project, we propose an algorithm to convert musical features and structures extracted from monophonic MIDI files to tactile illusions. Mapping music to vibrotactile stimuli is a challenging process since the perceptible frequency range of the skin is lower than that of the auditory system, which may cause the loss of some musical features. Moreover, current proposed models do not warrant the correspondence between the emotional response to music and the vibrotactile version of it. We propose to use tactile illusions as an additional resource to convey more meaningful vibrotactile stimuli. Tactile illusions enable us to add dynamics to vibrotactile stimuli in the form of movement, changes of direction, and localization. The suggested algorithm converts monophonic MIDI files into arrangements of two tactile illusions: ¡°phantom motion¡± and ¡°funneling¡±. The validation of the rendered material consisted of presenting the audio rendered from MIDI files to participants and then adding the vibrotactile component to it. The arrangement of tactile illusions was also evaluated alone. Results suggest that the arrangement of tactile illusions evokes more positive emotions than negative ones. This arrangement was also perceived as more agreeable and stimulating than the original audio. Although musical features such as rhythm, tempo, and melody were mostly recognized in the arrangement of tactile illusions, it provoked a different emotional response from that of the original audio.

• Lesteberg, Mari & Jensenius, Alexander Refsum (2022). MICRO and MACRO - Developing New Accessible Musicking Technologies. In Iber, Michael & Enge, Kajetan (Ed.), Audio Mostly 2022: What you hear is what you see? Perspectives on modalities in sound and music interaction. ACM Publications. ISSN 978-1-4503-9701-8. p. 147¨C150. doi: 10.1145/3561212.3561231. Full text in Research Archive Show summary

  This paper describes the development of two musical instrument prototypes developed to explore how non-haptic music technologies can be accessed from a web browser and how they can offer accessibility for people with low fine motor skills. Two approaches to browser-based motion capture were developed and tested during an iterative design process. This was followed by observational studies of two user groups: one with low fine motor skills and one with normal motor skills. Contrary to our expectations, we found that avoiding the use of buttons and mice did not make the apps more accessible for the participants with low fine motor skills. Furthermore, motion speed was considered more important for people with low motor skills than the size of the control action. The most important finding is that browser-based musical instruments using sensor-based and video-based motion tracking are not only feasible but allow for reaching much larger groups of people than previously possible. This may ultimately lead to both more personalized and accessible musical experiences.

• Jensenius, Alexander Refsum (2021). Best versus Good Enough Practices for Open Music Research. Empirical Musicology Review. ISSN 1559-5749. 16(1). Full text in Research Archive Show summary

  Music researchers work with increasingly large and complex data sets. There are few established data handling practices in the field and several conceptual, technological, and practical challenges. Furthermore, many music researchers are not equipped for (or interested in) the craft of data storage, curation, and archiving. This paper discusses some of the particular challenges that empirical music researchers face when working towards Open Research practices: handling (1) (multi)media files, (2) privacy, and (3) copyright issues. These are exemplified through MusicLab, an event series focused on fostering openness in music research. It is argued that the "best practice" suggested by the FAIR principles is too demanding in many cases, but "good enough practice" may be within reach for many. A four-layer data handling "recipe" is suggested as concrete advice for achieving "good enough practice" in empirical music research.

• Laczko, Balint & Jensenius, Alexander Refsum (2021). Reflections on the Development of the Musical Gestures Toolbox for Python. In Kantan, Prithvi Ravi; Paisa, Razvan & Willemsen, Silvin (Ed.), Proceedings of the Nordic Sound and Music Computing Conference. Aalborg Universitetsforlag. Full text in Research Archive Show summary

  The paper presents the Musical Gestures Toolbox (MGT) for Python, a collection of modules targeted at researchers working with video recordings. The toolbox includes video visualization techniques such as creating motion videos, motion history images, and motiongrams. These visualizations allow for studying video recordings from different temporal and spatial perspectives. The toolbox also includes basic computer vision methods, and it is designed to integrate well with audio analysis toolboxes. The MGT was initially developed to analyze music-related body motion (of musicians, dancers, and perceivers) but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, pedagogy, psychology, and medicine.

View all works in Cristin

• Jensenius, Alexander Refsum (2022). Sound Actions: Conceptualizing Musical Instruments. MIT Press. ISBN 9780262544634. 304 p. Full text in Research Archive Show summary

  A techno-cognitive look at how new technologies are shaping the future of musicking. ¡°Musicking¡± encapsulates both the making of and perception of music, so it includes both active and passive forms of musical engagement. But at its core, it is a relationship between actions and sounds, between human bodies and musical instruments. Viewing musicking through this lens and drawing on music cognition and music technology, Sound Actions proposes a model for understanding differences between traditional acoustic ¡°sound makers¡± and new electro-acoustic ¡°music makers.¡± What is a musical instrument? How do new technologies change how we perform and perceive music? What happens when composers build instruments, performers write code, perceivers become producers, and instruments play themselves? The answers to these pivotal questions entail a meeting point between interactive music technology and embodied music cognition, what author Alexander Refsum Jensenius calls ¡°embodied music technology.¡± Moving between objective description and subjective narrative of his own musical experiences, Jensenius explores why music makes people move, how the human body can be used in musical interaction, and how new technologies allow for active musical experiences. The development of new music technologies, he demonstrates, has fundamentally changed how music is performed and perceived.

View all works in Cristin

• Jensenius, Alexander Refsum (2024). Stod stille hver dag i 10 minutter. [TV]. NRK Helgemorgen.
• Jensenius, Alexander Refsum & Laczko, Balint (2024). Video Visualization. Show summary

  This workshop is targeted at students and researchers working with video recordings. You will learn to use MG Toolbox, a Python package with numerous tools for visualizing and analyzing video recordings. This includes visualization techniques such as motion videos, motion history images, and motiongrams; techniques that, in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes some basic computer vision analysis, such as extracting quantity and centroid of motion, and using such features in analysis.MG Toolbox for Python is a collection of high-level modules for generating all of the above-mentioned visualizations and analyses. This toolbox was initially developed to analyze music-related body motion but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, psychology, medicine, and educational sciences.

• Jensenius, Alexander Refsum & Lilleeng, Sverre (2024). Professor stillstand. [Internet]. NRK.
• Jensenius, Alexander Refsum (2024). Hvorfor trenger vi lisenser p? data? Show summary

  QualiFAIR huben inviterer til en presentasjon og en diskusjon om rettighetene til data og behov for lisenser for data og annet forskningsmateriale.

• Jensenius, Alexander Refsum & Poutaraud, Joachim (2023). Video Visualization. Show summary

  This workshop is targeted at students and researchers working with video recordings. Even though the workshop will be based on quantitative tools, the aim is to provide solutions for qualitative research. This includes visualization techniques such as motion videos, motion history images, and motiongrams, which, in different ways, allow for looking at video recordings from different temporal and spatial perspectives. It also includes basic computer vision analysis modules, such as extracting quantity and centroid of motion, and using such features in analysis. The participants will learn to use the Musical Gestures Toolbox for Python, a collection of high-level modules for easily generating all of the above-mentioned visualizations and analyses. This toolbox was initially developed for analyzing music-related body motion but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, psychology, medicine, and educational sciences.

• Haaland, Tonette N. & Jensenius, Alexander Refsum (2023). SSO deltar i forskning: ¨C Skal finne ut hvordan musikk p?virker oss. [Newspaper]. Rogalands avis. Show summary

  Stavanger Symfoniorkester (SSO) inviterer elever p? 5.-10. trinn p? konsert, for ? gjennomf?re forskning.

• Jensenius, Alexander Refsum & Burnim, Kayla (2023). Forskere inntok Konserthuset. [Newspaper]. Stavanger Aftenblad. Show summary

  Hundrevis av elever kom for ? h?re p? Stavanger symfoniorkester. Mens orkesteret spilte, var musikerne, dirigenten og publikum del av et unikt forskningsprosjekt.

• Jensenius, Alexander Refsum & Rosenberg, Ingvild (2023). Unik forskningskonsert. [Radio]. NRK P1.
• Jensenius, Alexander Refsum (2023). Rhythmic Data Science. Show summary

  Rhythm is everywhere, from how we walk, talk, dance and play to telling stories about our past and even predicting the future. Rhythm is key to how we interact with our world. Our heartbeat, nervous system, and other bodily cycles work through rhythm. As such, rhythm is a crucial aspect of human action and perception, and it is in complex interaction with the world's cultural, biological and mechanical rhythms. At RITMO, they research rhythmic phenomena and their complex relationships with the rhythms of human bodies and brains. In the talk, Alexander will present examples of how they record, synchronize, and analyze data of complex, rhythmic human behavior, such as real-world concerts.

• Jensenius, Alexander Refsum (2023). Explorations of human micromotion through standing still. Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Conceptualizing Musical Instruments. Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my forthcoming book on "musicking in an electronic world". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments. This will be used at the heart of a new organology that embraces the qualities of both acoustic and electroacoustic instruments.

• Jensenius, Alexander Refsum (2023). Sound Actions: An Embodied approach to a Digital Organology. Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my forthcoming book on "musicking in an electronic world". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments. This will be used at the heart of a new organology that embraces the qualities of both acoustic and electroacoustic instruments.

• Jensenius, Alexander Refsum (2023). Wishful thinking about CVs: Perspectives from a researcher.
• Jensenius, Alexander Refsum (2023). Conceptualizing Musical Instruments. Show summary

  What is an instrument in our increasingly electrified world? In this talk I will present a set of theoretical building blocks from my recent book "Sound Actions". At the core of the argument is the observation that the introduction of new music technologies has led to an increased separation between action and sound in musical performance. This has happened gradually, with pianos and organs being important early examples of instruments that introduced mechanical components between the performer and resonating objects. Today's network-based instruments represent an extreme case of a spatiotemporal dislocation between action and sound. They challenge our ideas of what an instrument can be, who can perform on them, and how they should be analyzed. In the lecture I will explain how we can use the concepts of action-sound couplings and mappings to structure our thinking about such instruments.

• Olaisen, Sofie Retterst?l; Jensenius, Alexander Refsum & Vuoskoski, Jonna Katariina (2023). Una m? danse n?r ho h?yrer musikk: ¨C Eit urgamalt instinkt. [Internet]. NRK. Show summary

  Urgamle instinkt blir sett i sving n?r hjernen din oppfattar musikk. No kan forskarane ogs? sj? danselysta i augo dine.

• Jensenius, Alexander Refsum (2023). Ny teknologi vil alltid endre musikken. Aftenposten (morgenutg. : trykt utg.). ISSN 0804-3116. Show summary

  Musikerne forsvant ikke med grammofonen, det gj?r de ikke n? heller.

• Jensenius, Alexander Refsum & Tidemann, Grethe (2023). Cristin forsvinner. Uklart hva som blir bedre i det nye systemet. [Internet]. Uniforum. Show summary

  Cristin, det nasjonale systemet for forskningsdokumentasjon, skal erstattes av Nasjonalt vitenarkiv. Men hva som blir bedre i det nye systemet kan verken IT-direkt?ren eller forskningsdirekt?ren ved UiO svare p?.

• Jensenius, Alexander Refsum & Z¨¹rn, Christof (2023). Standing still with Alexander Refsum Jensenius. [Internet]. The Power of Music Thinking. Show summary

  What is the use of standing still for 10 minutes? I was asking myself when I saw a post on social media. It was a double picture of a man with a mobile phone around his neck displaying some data, and another picture showed the view he saw at that moment. I learned that he stood there for 10 minutes without any movement, listening to the sound that was already there. There were many pictures like this, and I decided to get in contact. So, today, we are in Oslo. We speak with Alexander Refsum Jensenius, a professor of music technology at the University of Oslo, a book author, a music researcher and researching musician working in the fields of embodied music cognition and new interfaces for musical expression. Alexander shares with us his experiences while performing and testing with artistic methods of embodied listening and how people experience music and sound. This goes from experiments with and without the conductor of a Symphony Orchestra to the sounds of our kitchen appliances. We talk about his motion capture lab, where a person¡¯s exact location and micro-movements can be detected while they hear different kinds of music, and how the researchers can understand what moves them. Alexander shares insights about the Norwegian Championship of Stand Still, where until now, 1000s of people have participated, and the winner is the person with the lowest average velocity on standing the stillest over some time. Alexander explains the interplay of body and mind and reveals some secrets on how to move people, for example, on the dance floor or to calm them down. It all has to do with our bpm, the average heartbeat of about 60 beats a minute.

• Jensenius, Alexander Refsum (2023). Still Standing: The effects of sound and music on people standing still. Show summary

  Throughout 2023, I have been standing still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for the conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Still Standing: The effects of sound and music on people standing still. Show summary

  Throughout 2023, I have been standing still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for the conscious and unconscious control of musical sounds.

• Serdar G?ks¨¹l¨¹k, Bilge (2023). Digital Intervention Into Dramaturgical Thoughts.
• Jensenius, Alexander Refsum (2023). Exploring large datasets of human, music-related standstill. Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum & Tytko, James (2023). Emerging tech creates music from dance movements. [Internet]. The Naked Scientists. Show summary

  Listen to the melodies composed with the help of motion capture body suits...

• Jensenius, Alexander Refsum (2023). Hvordan en videreutvikling av vurderingssystemet endrer hvordan man jobber faglig.
• Jensenius, Alexander Refsum (2023). Musikk og kunstig intelligens. Show summary

  Kunstig intelligens kan allerede skrive noter og mikse musikk. I tiden fremover vil vi se mange eksempler p? hvordan maskinl?ring tas i bruk i musikkut?ving og -produksjon og til ? skape nye lytteopplevelser. Men hva er egentlig musikalsk kunstig intelligens? Hva vil det si ? trene en maskinl?ringsmodell? Vil maskinene gj?re musikere og komponister overfl?dige? Denne forelesningen vil gi deg en del svar, men ogs? flere sp?rsm?l.

• Jensenius, Alexander Refsum (2023). How Findable, Accessible, Interoperable and Reusable data enables research-led education. Show summary

  FAIR data is an essential component of the open research ecosystem. In this article, Alexander Refsum Jensenius argues that "FAIRification" can also benefit research-based and research-led education, providing opportunities to bring together different university missions.

• Jensenius, Alexander Refsum (2023). Innovasjon og ?pen forskning.
• Jensenius, Alexander Refsum (2023). Observing spaces while standing still. Show summary

  Throughout 2023, I stand still for ten minutes around noon every day, in a different room each day. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. Previously, I have been interested in the impact of music. Now, I am listening to ventilation systems, elevators, and people walking and talking and reflecting on how they influence my body and mind. The aim is to understand more about the rhythms of the environment.

• Masu, Raul; Morreale, Fabio & Jensenius, Alexander Refsum (2023). The O in NIME: Reflecting on the Importance of Reusing and Repurposing Old Musical Instruments. Show summary

  In this paper, we reflect on the focus of ¡°newness¡± in NIME research and practice and argue that there is a missing O (for ¡°Old¡±) in framing our academic discourse. A systematic review of the last year¡¯s conference proceedings reveals that most papers do, indeed, present new instruments, interfaces, or pieces of technology. Comparably few papers focus on the prolongation of existing NIMEs. Our meta-analysis identifies four main categories from these papers: (1) reuse, (2) update, (3) complement, and (4) long-term engagement. We discuss how focusing more on these four types of NIME development and engagement can be seen as an approach to increase sustainability.

• Karbasi, Seyed Mojtaba; Jensenius, Alexander Refsum; God?y, Rolf Inge & T?rresen, Jim (2023). Exploring Emerging Drumming Patterns in a Chaotic Dynamical System using ZRob. Show summary

  ZRob is a robotic system designed for playing a snare drum. The robot is constructed with a passive flexible spring-based joint inspired by the human hand. This paper describes a study exploring rhythmic patterns by exploiting the chaotic dynamics of two ZRobs. In the experiment, we explored the control configurations of each arm by trying to create un- predictable patterns. Over 200 samples have been recorded and analyzed. We show how the chaotic dynamics of ZRob can be used for creating new drumming patterns.

• Bukvic, Ivica Ico; Jensenius, Alexander Refsum; Wittman, Hollis & Masu, Raul (2023). Implementing the new template for NIME music proceedings with the community. Show summary

  We will analyze a new possible template for NIME submissions which would simplify the integration of NIME music performances in the COMPEL, a database which facilitates navigation across different categories (pieces, persons, instruments). The template emerges from a workshop run last year at NIME about the structure of COMPEL and the process of entering all performances presented last year. From this workshop we expect to improve the template and validate it with a community.

• Riaz, Maham (2023). An Investigation of Supervised Learning in Music Mood Classification for Audio and MIDI. Show summary

  This study aims to use supervised learning ¨C specifically, support vector machines ¨C as a tool for a music mood classification task. Four audio and MIDI datasets, each containing over four hundred files, were composed for use in the training and testing processes. Mood classes were formed according to the valence-arousal plane, resulting in the following: happy, sad, relaxed, and tense. Additional runs were also conducted with the linear discriminant analysis, a dimensionality reduction technique commonly used to better the performance of the classifier. The relevant audio and MIDI features were carefully selected for extraction. MIDI datasets for the same music generated better classification results than corresponding audio datasets. Furthermore, when music is composed with each mood associated with a particular key instead of mixed keys, the classification accuracy is higher.

• Serdar G?ks¨¹l¨¹k, Bilge (2023). The Challenges and Possibilities of The Hybrid Format Creative Process.
• Guo, Jinyue (2023). Automatic Recognition of Cascaded Guitar Effects.
• Riaz, Maham (2023). Using SuperCollider with OSC Commands for Spatial Audio Control in a Multi-Speaker Setup. Show summary

  With the ever-increasing prevalence of technology, its application in various music-related processes, such as music composition and performance, has become increasingly prominent. One fascinating area where technology finds utility is in music performance, offering opportunities for extensive sound exploration and manipulation. In this paper, we introduce an approach utilizing SuperCollider and Open Sound Control (OSC) commands in a multi-speaker setup, enabling spatial audio control for a truly interactive audio spatialization experience. We delve into the musicological dimensions of these distinct methods, examining their integration within a live performance setting to uncover their artistic and expressive potential. By merging technology and musicology, our research aims to unlock new avenues for immersive and captivating musical experiences.

• Riaz, Maham (2023). Sound Design in Unity: Immersive Audio for Virtual Reality Storytelling. Show summary

  Research talk on sound design for games and immersive environments. The Unity game engine is used for environmental modeling. The Oculus Spatializer plugin provides control over binaural spatialization with native head related transfer functions (HRTF). Game scenes included C# scripts, which accounted for intermittent emitters (randomly triggered sounds of nature, critters and birds), crossfades, occlusion and raycasting. In the mixing stage, mixer groups, mixer snapshsots, snapshot triggers, SFX reverb sends, and low/high-pass filters were some of the tools demonstrated.

• Serdar G?ks¨¹l¨¹k, Bilge (2023). The Implications of Laban/Bartenieff Movement Studies in the Field of Dance Anthropology.
• Serdar G?ks¨¹l¨¹k, Bilge (2023). Hybrid Format Movement Training Under the Pandemic Measures: A Clash Between Physical and Digital Realm.
• Serdar G?ks¨¹l¨¹k, Bilge (2023). Phenomenological Inquiry of Movement as a Methodology in Performing Arts Education.
• Serdar G?ks¨¹l¨¹k, Bilge (2023). Embodied Knowledge Production Through Telematics in the Hybrid Realm.
• Serdar G?ks¨¹l¨¹k, Bilge (2023). Performative Quality of Aesthetics in Bio-Cultural Paradigm.
• Riaz, Maham; Upham, Finn; Burnim, Kayla; Bishop, Laura & Jensenius, Alexander Refsum (2023). Comparing inertial motion sensors for capturing human micromotion. Show summary

  The paper presents a study of the noise level of accelerometer data from a mobile phone compared to three commercially available IMU-based devices (AX3, Equivital, and Movesense) and a marker-based infrared motion capture system (Qualisys). The sensors are compared in static positions and for measuring human micromotion, with larger motion sequences as reference. The measurements show that all but one of the IMU-based devices capture motion with an accuracy and precision that is far below human micromotion. However, their data and representations differ, so care should be taken when comparing data between devices.

• Jensenius, Alexander Refsum (2023). Tverrfaglig forskning p? rytme, tid og bevegelse. Show summary

  RITMO er et unikt SFF p? grunn av sin radikalt tverrfaglige oppbygning. Hvordan fungerer det i praksis?

• Jensenius, Alexander Refsum (2023). RITMO Senter for tverrfaglig forskning p? rytme, tid og bevegelse. Show summary

  RITMO er et tverrfaglig senter som ?nsker ? avdekke de kognitive mekanismene som ligger til grunn for menneskelig rytme, i musikk, bevegelse og audiovisuelle medier.

• Jensenius, Alexander Refsum (2023). Sound Actions: Conceptualizing Musical Instruments. Show summary

  How do new technologies change how we perform and perceive music? What happens when composers build instruments, performers write code, perceivers become producers, and instruments play themselves? These are questions addressed in the new book by Professor Alexander Refsum Jensenius: Sound Actions: Conceptualizing Musical Instruments published by the MIT Press.

• Jensenius, Alexander Refsum (2023). Sound Actions - Conceptualizing Musical Instruments.
• Jensenius, Alexander Refsum (2023). Explorations of human micromotion through standing still. Show summary

  Throughout 2023, I will stand still for ten minutes around noon every day, in a different room each day. The aim is to collect data about my micromotion and compare it to the qualities of the environment. This project follows a decade-long exploration of human micromotion from both artistic and scientific perspectives. In the talk, I will present results from the annual Norwegian Championships of Standstill, where we have studied the influence of music on people's micromotion. I will also talk about how micromotion can be used in interactive music systems, allowing for conscious and unconscious control of musical sounds.

• Jensenius, Alexander Refsum (2023). Exploring Human Micromotion Through Standing Still. Show summary

  Moving slowly likely puts us into a special state of mind. Subjective reports from various practices including dance, Tai Chi and walking meditation suggest that slow movements can bring participants into a special state involving increased relaxation and awareness. Interestingly, relatively little research has been performed specifically to understand the underlying mechanisms and the possible applications of human slow movement. One reason might be that slow movements are not common in day-to-day life: when we want to move ¨C for example to pick up our cup of coffee - we usually want to do it now. Some evidence suggests that humans tend to avoid moving slowly in different tasks, for example, when improvising movements together. The goal of this meeting is to bring together scholars and practitioners interested in slow movement, and to foster interdisciplinary research on this somewhat neglected topic.

• Jensenius, Alexander Refsum (2023). Introducing MusicLab. Show summary

  In 2021, one of the world¡¯s finest string quartets, The Danish String Quartet (DSQ), and a large team of international researchers based at RITMO, co-hosted MusicLab Copenhagen ¨C a groundbreaking event where DSQ performed their best repertoire while researchers experimented with, measured, and analyzed the experiences and behavior of musicians and audience. Some of the questions we tried to answer were: Do we become one grand ¡°we¡± when absorbed in music together? How do we synchronize our bodily rhythms with the music during a concert? As an innovative musical and scientific format, the concert has been widely reported and won ¡°Event of the Year¡± by the Danish National Broadcasting Corporation (DR P2). Now, the researchers have completed their analyses, and we are excited to share findings in a hybrid launch event.

• Lesteberg, Mari & Jensenius, Alexander Refsum (2022). MICRO and MACRO - Developing New Accessible Musicking Technologies. Show summary

  This paper describes the development of two musical instrument prototypes developed to explore how non-haptic music technologies can be accessed from a web browser and how they can offer accessibility for people with low fine motor skills. Two approaches to browser-based motion capture were developed and tested during an iterative design process. This was followed by observational studies of two user groups: one with low fine motor skills and one with normal motor skills. Contrary to our expectations, we found that avoiding the use of buttons and mice did not make the apps more accessible for the participants with low fine motor skills. Furthermore, motion speed was considered more important for people with low motor skills than the size of the control action. The most important finding is that browser-based musical instruments using sensor-based and video-based motion tracking are not only feasible but allow for reaching much larger groups of people than previously possible. This may ultimately lead to both more personalized and accessible musical experiences.

• Jensenius, Alexander Refsum (2022). From ideas to reality: interdisciplinary collaborations.
• Jensenius, Alexander Refsum (2022). Alternatives to journal-based metrics in research assessment. Show summary

  Science Europe invites institutional leaders, researchers at all stages of their careers, and experts from the field to join its 18 and 19 October 2022 conference on Open Science to discuss two key questions: (1) Is Open Science ready to become the norm in research? (2) How do we ensure this becomes an equitable transition? To find answers to these questions, the conference will provide a comprehensive overview of practical and policy initiatives, research assessment reforms, and financial measures that support the transition to Open Science. We will also look forward to new and emerging trends.

• Jensenius, Alexander Refsum (2022). Experiencing the world through sound actions. Show summary

  This talk will reflect on my year-long project recording a daily "sound action". These are multimodal entities consisting of body motion and its resultant sound. When we only see a sound action, we can imagine its sound. If we only hear a sound action, we can imagine the body motion and objects involved in the interaction. Sound actions are ubiquitous in everyday life yet rarely discussed and reflected upon. My attempts at analyzing sound actions show some of the complexity involved in making sense of actions, reactions, and interactions with the world. This complexity can also inspire creative usage. I will present examples of meaningless and cognitively conflicting sound actions in the talk.

• Jensenius, Alexander Refsum (2022). Publish or Perish? Researcher assessment is about to change. Show summary

  In July 2022, the European Commission launched an Agreement On Reforming Research Assessment. After years of talking, there is significant momentum for changing how researchers are assessed. In this talk, I will present some work leading up to the new agreement and how Universities Norway took a lead when developing the Norwegian Career Assessment Matrix (NOR-CAM). The core idea is that academics need to get recognition for a broader range of activities. This is important for transitioning to more open research practices and diverse career paths within and outside academia.

• Jensenius, Alexander Refsum (2022). Data? ?pen forskningspraksis for ikke-datadrevne fagfelt. Show summary

  Hva er ?pen forskning og hva skal til for ? etablere en kultur for ?pen forskning i humanistiske fag og samfunnsfag? Hvordan vi skal komme til en ny normal der det vi i dag omtaler som ??pen forskning? kun kalles forskning?

• Langslet, Sebastian Fongen; Code, David L?berg; Smith, Hallie; Riaz, Maham; von Arnim, Hugh Alexander & Poutaraud, Joachim [Show all 7 contributors for this article] (2022). The Self-Playing Guitars at Deichman. Show summary

  For this iteration of the Self-playing Guitars we mainly used two patches; one which was based on the patch from Forskernatt, and one completely new!

• Jensenius, Alexander Refsum (2022). Kunstfag og ?pen forskning. Show summary

  Hvilke dilemmaer oppst?r n?r forskningsdata og resultater skal deles og gjenbrukes? Og hvilke muligheter medf?rer mer ?penhet og ?kt deling av data for fag som eksempelvis musikk, visuell kunst, film, scenekunst og design?

• Jensenius, Alexander Refsum (2022). Erfaringer med ? lage 3xMOOC. Show summary

  I denne presentasjonen vil jeg presentere hvordan vi gjennom ?rene har utviklet tre komplette nettkurs ved Universitetet i Oslo: Music Moves (2016), Motion Capture (2022) og Pupillometry (2023). Fokuset vil ligge p? muligheter og utfordringer i video i utdanningssammenheng.

• Jensenius, Alexander Refsum (2022). Responsible Research and Innovation in Sound and Music Computing. Show summary

  My presentation will focus on how the ongoing shift to Open Research within the field of sound and music computing (SMC) promotes Responsible Research and Innovation (RRI).

• Jensenius, Alexander Refsum (2022). Open music research between art and science. Show summary

  Many music researchers are turning towards studying music performance and perception in real-world settings. Collecting data in a concert situation is non-trivial, and FAIRifying the data is even more challenging. In this talk, I will discuss some challenges with handling privacy and copyright matters in music research. I will also discuss some benefits of working towards more open music research.

• Remache-Vinueza, Byron; Trujillo-Le¨®n, Andr¨¦s; Clim, Maria-Alena; Sarmiento-Ortiz, Fabi¨¢n; Topon-Visarrea, Liliana & Jensenius, Alexander Refsum [Show all 7 contributors for this article] (2022). Mapping Monophonic MIDI Tracks to Vibrotactile Stimuli Using Tactile Illusions. Show summary

  In this project, we propose an algorithm to convert musical features and structures extracted from monophonic MIDI files to tactile illusions. Mapping music to vibrotactile stimuli is a challenging process since the perceptible frequency range of the skin is lower than that of the auditory system, which may cause the loss of some musical features. Moreover, current proposed models do not warrant the correspondence between the emotional response to music and the vibrotactile version of it. We propose to use tactile illusions as an additional resource to convey more meaningful vibrotactile stimuli. Tactile illusions enable us to add dynamics to vibrotactile stimuli in the form of movement, changes of direction, and localization. The suggested algorithm converts monophonic MIDI files into arrangements of two tactile illusions: ¡°phantom motion¡± and ¡°funneling¡±. The validation of the rendered material consisted of presenting the audio rendered from MIDI files to participants and then adding the vibrotactile component to it. The arrangement of tactile illusions was also evaluated alone. Results suggest that the arrangement of tactile illusions evokes more positive emotions than negative ones. This arrangement was also perceived as more agreeable and stimulating than the original audio. Although musical features such as rhythm, tempo, and melody were mostly recognized in the arrangement of tactile illusions, it provoked a different emotional response from that of the original audio.

• Remache-Vinueza, Byron & Jensenius, Alexander Refsum (2022). Groundbreaking New Technology Allows People To Listen to Music Through Touch. [Internet]. SciTechDaily. Show summary

  An audio-tactile algorithm created by University of Malaga scientists conveys melodic information through vibration.

• Jensenius, Alexander Refsum (2022). Exploring music performance and perception through motion capture. Show summary

  This talk will present different approaches to capturing human bodily activity. Motion capture can be performed with sensor-based and camera-based systems, each of which has benefits and limitations. Sensor-based systems are flexible and scalable and can easily be used outside laboratory environments. They are good at tracking relative motion and rotation information but less suitable for tracking position. Camera-based systems come in many flavors and can be used with and without markers. They excel at tracking positions but are prone to reflections and environmental noise. As a consequence, camera-based motion capture systems are better suited for laboratory settings. I will discuss my twenty-year-long experience using different motion capture systems to study music-related body motion. This includes research on musicians, including rehearsal techniques and performance strategies. Such studies push the limits of the technology when it comes to precision and accuracy. It is particularly challenging when using motion capture equipment in real-world concert settings. At the University of Oslo, we have successfully captured the motion of both solo and ensemble performances and are currently trying to scale up to a full orchestra. We are also carrying out motion capture of perceivers, audience members in concerts, dancers, and other people moving to music. Through the Norwegian Championship of Standstill, we have delved into human micromotion, the tiniest actions we can perform and perceive. At this level, motion capture can detect physiological signals, such as breathing and heart rate. Data from such studies are interesting scientifically and have also been used in artistic practice. Finally, I will give examples of how real-time motion capture can be used in various creative applications, including "inverse" sonic interaction.

• Jensenius, Alexander Refsum & Platou, Jeanette (2022). Kan kunstig intelligens v?re kreativ? [Radio]. NRK P2 Arena. Show summary

  Hva er AI, eller kunstig intelligens, som vi kaller det p? norsk. I Arena i dag ser vi p? hvor kunstig intelligensk blir brukt, og hva det funker i. Kan vi f? en data til ? skrive poesi, og hva med musikken og kunsten?

• Serdar G?ks¨¹l¨¹k, Bilge (2022). From Bodily Interactions to Embodied Concepts.
• al Outa, Amani; Kn?velsrud, Helene; Laczko, Balint & Jensenius, Alexander Refsum (2022). Winner of RRI-inspired transdisciplinary side quest call. [Internet]. Centre for Digital Life Norway. Show summary

  Centre for Digital Life Norway (DLN) is excited to congratulate the team behind the project ¡°The autophagic symphony ¨C Unveiling the final rhythm¡± as winner of DLN¡¯s RRI-inspired transdisciplinary side quest call.

• Jensenius, Alexander Refsum; Furmyr, Frida; Poutaraud, Joachim; Widmer, Marcus & Laczko, Balint (2022). The Musical Gestures Toolbox for Python. Show summary

  The Musical Gestures Toolbox for Python is a collection of tools for video visualization and video analysis.

• Jensenius, Alexander Refsum (2022). RITMO and Interdisciplinarity. Show summary

  In this presentation I will discuss how we have been developing an interdisciplinary research centre, in which researchers from the arts and humanities and the social and natural sciences.

• Jensenius, Alexander Refsum (2021). Open Research as Communication Strategy.
• Laczko, Balint & Jensenius, Alexander Refsum (2021). Reflections on the Development of the Musical Gestures Toolbox for Python. Show summary

  The paper presents the Musical Gestures Toolbox (MGT) for Python, a collection of modules targeted at researchers working with video recordings. The toolbox includes video visualization techniques such as creating motion videos, motion history images, and motiongrams. These visualizations allow for studying video recordings from different temporal and spatial perspectives. The toolbox also includes basic computer vision methods, and it is designed to integrate well with audio analysis toolboxes. The MGT was initially developed to analyze music-related body motion (of musicians, dancers, and perceivers) but is equally helpful for other disciplines working with video recordings of humans, such as linguistics, pedagogy, psychology, and medicine.

View all works in Cristin