Rendering Audio Using Expressive MIDI

Stephen J. Welburn, Mark D. PlumbleyView 2009

Abstract

MIDI renderings of audio are traditionally regarded as lifeless and unnatural - lacking in expression. However, MIDI is simply a protocol for controlling a synthesizer. Lack of expression is caused by either an expressionless synthesizer or by the difficulty in setting the MIDI parameters to provide expressive output. We have developed a system to construct an expressive MIDI representation of an audio signal, i.e. an audio representation which uses tailored pitch variations in addition to the note base pitch parameters which audio-to-MIDI systems usually attempt. A pitch envelope is estimated from the original audio, and a genetic algorithm is then used to estimate pitch modulator parameters from that envelope. These pitch modulations are encoded in a MIDI file and rerendered using a sampler. We present some initial comparisons between the final output audio and the estimated pitch envelopes.
BibTeX
@inproceedings{welburn2009rendering,
  author = {Stephen J. Welburn and Mark D. Plumbley},
  title = {{Rendering Audio Using Expressive MIDI}},
  booktitle = {View},
  year = {2009},
}

Loading related content...

Figure