{"id":789,"date":"2021-03-18T03:39:00","date_gmt":"2021-03-18T03:39:00","guid":{"rendered":"https:\/\/resources.illc.uva.nl\/illc-blog\/?p=789"},"modified":"2021-05-21T09:52:27","modified_gmt":"2021-05-21T09:52:27","slug":"the-science-of-listening-to-music","status":"publish","type":"post","link":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-science-of-listening-to-music\/","title":{"rendered":"The science and mystery of listening"},"content":{"rendered":"\n

17 March 2021, Iris Proff<\/a><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Photo by Dollar Gill<\/a>. Edited by Arco Mul<\/a>.<\/p>\n\n\n\n

As a boy growing up in a village in the northeastern tip of the US, Ashley Burgoyne started singing at his aunt\u2019s piano along with his cousins. More often than not, Ashley would stay and keep singing long after his cousins had left. His fascination for music would only grow in the following years. He entered university studying music and mathematics and soon became a semi-professional choral singer. Only when moving to Europe for a postdoc at the ILLC, Ashley dropped his choral singing to give more room for his research into how humans listen to music.<\/p>\n\n\n\n

\u201cIt\u2019s almost embarrassing that we don\u2019t know what people hear when they listen to music,\u201d he says. Traditionally, Psychology assumes that there exist two types of listening. On the one hand, there is background music \u2013 the type of music which is playing in the supermarket while you do your shopping or in the bathroom of a fancy restaurant. On the other, there is deep listening, where people are fully concentrated on listening to music and nothing else.<\/p>\n\n\n\n

In real life however, this dichotomy does not hold. Most of the time, people consciously choose music they enjoy, but still do something else while listening \u2013 they read the news, cook, run, drive a car or work. When our attention is divided between two tasks, our brain filters things out. What is it that people pick up from the music they listen to? What sticks and what gets filtered out? And how might this differ between individuals?<\/p>\n\n\n\n

What makes songs stick in your head<\/strong><\/h2>\n\n\n\n
\"\"
Ashley Burgoyne is musicologist at the ILLC.<\/figcaption><\/figure><\/div>\n\n\n\n

Working towards these grand questions, Ashley investigates what it is that makes some pieces of music catchy \u2013 and others not. For that aim, the Music Cognition Group<\/a> <\/a>at the ILLC devised Hooked on Music<\/a>, a new type of experiment to measure if someone remembers a song. Usually, this is done by querying the title and artist of a song. However, this approach conflates two types of memory process, Ashley points out. You might very well recognize a song without having a clue about its title or the artist performing it.<\/p>\n\n\n\n

Singing or humming-along tasks are problematic as well. Some people are just not good at or uncomfortable with singing. Instead, in the new experiment people are asked to sing along in their head while the song is paused for a few seconds. Afterwards they indicate if they believe that the song proceeds at the right or the wrong moment.<\/p>\n\n\n\n

By now, the researchers designed four version of this task. They started off with an international version with hits from the British charts and a Dutch version with the famous Top 2000<\/em>, a list of popular songs that people in the Netherlands vote on each year. Currently, the research team is running two new editions of the experiment with Eurovision and Christmas songs. You can participate in the experiments here<\/a>. <\/p>\n\n\n\n

According to this research, what is it that makes music memorable? \u201cThe melody seems to dominate every other aspect of the music\u201d, says Ashley. Simple, conventional melodies that are easy to sing seem to be more memorable than complex and unusual melodies. It goes without saying that other factors than the music itself play an important role as well. Take for instance Queen\u2019s famous Bohemian Rhapsody.<\/em> The song does not score particularly high on musical memorability. That it became a tune everyone can sing along with might have as much to do with its history and context as with the music itself.<\/p>\n\n\n\n

Marketing, the timing of release, the name of the artist or label and pure luck \u2013 all of this influences if a piece of music becomes successful or not. Ashley found that 20 percent of a song\u2019s memorability was explained by musical features. The remaining 80 percent was explained by all the other factors.<\/p>\n\n\n\n

Haunting for the right representation of musical experience<\/strong><\/h2>\n\n\n\n

\u201cI see musical features as poor creatures trying to survive in the world of music business,\u201d says Ashley. Typically, musical features are properties from music theory, such as harmony, melody, and rhythm. But do those features really describe what people pick up from music? Unless you enjoyed a musical training, you are not likely to consciously notice if a song is in D major or A minor. You will probably not be able to tell apart a four-quarter from a three-quarter rhythm or to admire the intricate succession intervals that a melody is constructed of. These properties certainly influence how you perceive music \u2013 but do they capture your experience in its entirety?<\/p>\n\n\n\n

Music theoretical properties were long thought to express facts about music, but this assumption appears questionable when comparing music perception in different cultures. The concept of dissonance is at the root of Western music theory: there are certain \u2018consonant\u2019 combination of notes which sound pleasant to our ear, and other \u2018dissonant\u2019 combinations that are unpleasant, that don\u2019t quite fit. A study from 2016<\/a> <\/a>found that native Amazonians, who have not been in exposed to Western music, perceive consonant and dissonant sounds as equally pleasant \u2013 challenging the idea that dissonance is an objective property of music.<\/p>\n\n\n\n

Might there be musical features that are more universal, and map better onto human listening in the real world than music theoretical properties?<\/p>\n\n\n\n

Defining musical experience with AI<\/strong><\/h2>\n\n\n\n

The audio streaming provider Spotify also works with musical features, but those have little to do music theory: they capture how happy or sad, how danceable and energetic a song is, if it is acoustic or not, and if it contains vocals or not. Spotify uses artificial intelligence to automatically assign these features to songs, a method called feature learning.<\/em> The resulting features are then used by other algorithms that suggest new songs to Spotify users or to create playlists of songs that are similar to each other. How exactly any of this works is a well-kept company secret, but if you are curious, you can check how Spotify classifies your favorite songs here<\/a>.<\/p>\n\n\n\n

The graph below shows the Spotify Audio Features of some popular songs, where every feature ranges from 0 to 1. Most feature scores make intuitive sense: The rhythmic-happy Booty Swing<\/em> by Parov Stelar is inviting to dance. Beethoven\u2019s Moonlight Sonata<\/em> \u2013 quietly and elegantly performed on a piano \u2013 scores extremely low on energy, while Outcast\u2019s Hey Ya<\/em> is an outburst of energy. <\/p>\n\n\n\n

According to Spotify\u2019s Valence feature, Adele\u2019s heartbroken ballad Make You Feel My Love<\/em> is almost as sad as it gets, while Earth Wind and Fire\u2019s song September<\/em> scores 98 % happy. Queen\u2019s legendary Bohemian Rhapsody<\/em> scores quite average for most of the features.<\/p>\n\n\n\n

\nhttps:\/\/open.spotify.com\/playlist\/5XQ3xYEypwVybXpveeZWC3?si=otp0NNJtTTyiLYQA_eJ3qA\n<\/div><\/figure>\n\n\n\n\n
<\/div>\n\n \n