AI system reads novels, writes music for them

Works are assigned emotional density scores and interpreted in major or minor keys

What would "Alice in Wonderland" sound like if it were set to music? And what if the composer were a computer?

It's not something you might think of putting on your MP3 player, but researchers have trained an artificial intelligence system to read works of fiction and create music based on the texts. TransProse is a project that uses computers to translate literature into music.

First, the system reads the text of a work such as "Peter Pan." Based on word scans, it assigns "densities" of two different states, positive or negative, and eight different emotions -- joy, sadness, anger, disgust, anticipation, surprise, trust and fear.

Then, it sets about composing a musical piece that chronologically follows the novel, broken up into beginning, early middle, late middle, and end parts. 

The "emotion density data," as the researchers describe it, is used to determine the tempo, key, notes, octaves and other musical variables. Shorter notes, for instance, correspond with more emotionally dense areas of the narrative.

So what does literature-inspired AI music sound like?

"The Adventures of Sherlock Holmes," the detective classic by Arthur Conan Doyle, was assigned "trust" as its highest emotion, followed by "fear."

It's a simple, pretty but fairly bland piano composition in C major with a few trills that might evoke Mozart. But listeners expecting a hint of Holmes' criminal adversaries will be disappointed.

Joseph Conrad's "Heart of Darkness" is rendered as a brooding progression in C minor with "fear" and "sadness" as its themes. It may capture the atmosphere of the narrator's journey into colonial Africa, but it's not exactly a moving work.

"The current version of TransProse is just the beginning of our investigation and we don't claim to be making beautiful music at this point," Hannah Davis of New York University wrote in an email.

"This iteration is a starting point to see if we could programmatically translate the basic emotions of a novel into a musical piece that holds the same basic emotional feeling, which I think has been pretty successful."

TransProse grew out of a thesis project by Davis and a collaboration with Saif Mohammad, a researcher at the National Research Council Canada who had created a word-emotion lexicon.

The pair presented a paper on their work at a conference in Sweden last month, and plan to explore the technology by representing characters in novels as motifs in music.

"There are many creative ways in which going from text to music and from music to text can be used," Mohammad wrote in an email.

"One practical application might be in online book stores where a customer can click on a button to listen to the emotional tone of a book before deciding to buy it."

Tags popular science

Keep up with the latest tech news, reviews and previews by subscribing to the Good Gear Guide newsletter.

Tim Hornyak

IDG News Service

Comments

Comments are now closed.

Most Popular Reviews

Follow Us

Best Deals on GoodGearGuide

Shopping.com

Latest News Articles

Resources

GGG Evaluation Team

Kathy Cassidy

STYLISTIC Q702

First impression on unpacking the Q702 test unit was the solid feel and clean, minimalist styling.

Anthony Grifoni

STYLISTIC Q572

For work use, Microsoft Word and Excel programs pre-installed on the device are adequate for preparing short documents.

Steph Mundell

LIFEBOOK UH574

The Fujitsu LifeBook UH574 allowed for great mobility without being obnoxiously heavy or clunky. Its twelve hours of battery life did not disappoint.

Andrew Mitsi

STYLISTIC Q702

The screen was particularly good. It is bright and visible from most angles, however heat is an issue, particularly around the Windows button on the front, and on the back where the battery housing is located.

Simon Harriott

STYLISTIC Q702

My first impression after unboxing the Q702 is that it is a nice looking unit. Styling is somewhat minimalist but very effective. The tablet part, once detached, has a nice weight, and no buttons or switches are located in awkward or intrusive positions.

Latest Jobs

Shopping.com

Don’t have an account? Sign up here

Don't have an account? Sign up now

Forgot password?