CMU-CS-22-153
Computer Science Department
School of Computer Science, Carnegie Mellon University



CMU-CS-22-153

A Study of Statistical and Music-Theoretical Melody Prediction

Huiran Yu

M.S. Thesis

December 2022

CMU-CS-22-153.pdf


Keywords: Melody Prediction, Statistical Models, Music theory

Melody prediction is an essential research focus in computer music, aiming to predict melody terms given musical context. Melody prediction can help people un derstand how humans form melodic anticipation while listening and also contributes to the melody generation task in automatic composition. Nowadays, most studies only focus on developing new methods to model musical sequences. However, con- structing effective techniques to measure model behavior also demands attention. In our research, we offer an information entropy metric that can be applied to standard models, then further combine music theory with models to see if we can get better outcomes.

We first established a metric to measure the capability of baseline models. Each model generates a probability distribution over terms in the sequence, and we calculate the average entropy throughout the melody. Stronger models are likely to generate lower entropy, which means music is more predictable under these models. We found models trained on the whole dataset and those trained within the particlar song show drastic differences. Surprisingly, training on a large dataset results in lower performance.

After setting up the baseline, we designed another model recognizing periodic occurrences of notes and patterns, incorporating music characteristics of fixed phrase length and periodic repetition of cycle position. This simple model makes satisfying predictions, and with two ensemble strategies: one considering the entropy value and confidence of each model; another one conditioned the statistical model with cycle position, we combined the new model with the statistical model reducing the prediction error from 9.9% to 6.5%.

39 pages

Thesis Committee:
Roger B. Dannenberg (Chair)
Daniel Sleator

Srinivasan Seshan, Head, Computer Science Department
Martial Hebert, Dean, School of Computer Science


Return to: SCS Technical Report Collection
School of Computer Science

This page maintained by reports@cs.cmu.edu