Issuu on Google+

Chenyuan Cui


Research journal • 1. Color & Symbol


Research journal • 1. Color & Symbol • [1.1]John Gage, Color and Meaning: Art, Science, and

Symbolism, http://books.google.com/books?hl=zh-CN&lr=&id=EU74cB7kMMsC&oi=fnd& • [1.2]Charles J. Golden, The Measurement of Creativity by the Stroop Color and Word

Test, http://www.tandfonline.com/doi/abs/10.1207/s15327752jpa3905_9 • [1.3]Erella Hovers, Shimon Ilani, Ofer Bar, An Early Case of Color Symbolism: Ochre Use by

Modern Humans in Qafzeh Cave, http://www.jstor.org/discover/10.1086/375869?uid=3739616&uid=2&uid=4&uid=3739256&sid =21101172240237 • [1.4]baroque.me, http://blog.chenalexander.com/2011/folk-music-and-the-les-paul-doodle/ • [1.5]Music Visualization: Beautiful Tools to ‘See’

Sound, http://www.visualcomplexity.com/vc/blog/?p=811 (This site has a lot of sample) • [1.6]Visual Headphones, http://www.yankodesign.com/2012/06/11/visual-headphones/


Research journal • 2. Music & Lyrics Section


Research journal • 2. Music & Lyrics Section •

[2.1] Nick Zangwill, Music, Metaphor, and Emotion, http://www.dur.ac.uk/nick.zangwill/PDFs/MME.pdf

[2.2] Eric Nichols, Dan Morris, Sumit Basu and Christopher Raphael, Relationships between Lyrics and Melody in Popular Music, http://research.microsoft.com/enus/um/redmond/groups/cue/publications/ismir2009melodyandlyrics.pdf

[2.3] Lyrics Plugin, http://www.lyricsplugin.com/

[2.4] Last.fm API , www.last.fm/api

[2.5] Patricia M. Greenfield, etc, What is Rock Music Doing to the Minds of our Youth? A First Experimental Look at the Effects of Rock Music Lyrics and Music Videos, http://jea.sagepub.com/content/7/3/315.short

[2.6] Cyril Laurier, Multimodal Music Mood Classification using Audio and Lyrics, http://users.cis.fiu.edu/~lli003/Music/cla/42.pdf

[2.7] Beth Logan, Andrew Kositsky, Pedro Moreno, Semantic Analysis of Song Lyrics, http://www.hpl.hp.com/techreports/2004/HPL-2004-66.pdf?jumpid=reg_R1002_USEN


Research journal • 3. Interaction Section


Research journal • Question 1 coordination: • How do you think of the connection between music and photos? • Question 2 interestingness: • How do you think of the presentation style? • Question 3 colorfulness: • How well do you think the visual contents enrich the audio?


Research journal • 3. Interaction Section •

[3.1] Elias Pampalk, Islands of Music, Analysis, Organization, and Visualization of Music Archives, http://www.ofai.at/~elias.pampalk/publications/pam_oegai03.pdf

[3.2] Otmar Hilliges, P. Holzer, Rene Klüber, and Andreas Butz, Audio Radar: A metaphorical visualization for the navigation of large music collections, http://research.microsoft.com/apps/pubs/default.aspx?id=132449

[3.3] Chin-Han Chen, Ming-Fang Weng, Shyh-Kang Jeng, and Yung-Yu Chuang, Emotion-Based Music Visualization Using Photos, http://www.csie.ntu.edu.tw/~cyy/publications/papers/Chen2008EMV.pdf

[3.4] Honglak Lee, Yan Largman, Peter Pham, Andrew Y. Ng, Unsupervised feature learning for audio classification, using convolutional deep belief networks, http://research.microsoft.com/en-us/um/people/dongyu/nips2009/papers/leenips2009_1171.pdf

[3.5] Xian-Sheng HUA, Lie LU, Hong-Jiang ZHANG, Automatic Music Video Generation Based on Temporal Pattern Analysis, http://research.microsoft.com/en-us/um/people/xshua/publications/pdf/2004_acmmm_musicvideo.pdf

[3.6] Music Genome Project, http://en.wikipedia.org/wiki/Music_Genome_Project

[3.7] Spotify, http://en.wikipedia.org/wiki/Spotify

[3.8] Midomi, http://www.midomi.com/

[3.9] Songsmith, http://research.microsoft.com/en-us/um/redmond/groups/cue/compmusic/ (Songsmith generates musical accompaniment to match a singer’s voice.)

[3.10] process software, Music Visualizer, http://www.openprocessing.org/sketch/5989


Research journal • Should: • More focus on the project and data visualization


Outline • Introduction • Basic Definitions • Music visualization • Real-time music visualization • Music Lyrics

• Problem statement • Scientist keep find the strange feature of music to visualize, arts keep using the random pattern to

visualize. Sometimes no ‘meaningful’. • Thesis Statement • Lyrics-based visualization can improve listeners' emotion in music. (Project introduction - overview)

• History of Music Visualization • Early age – visualized by person in advance • Later – try to auto-generated, sometimes add personal element • Now – more music features are detected. • Current Development Trends • By Music • Music genome project (Pandora) • Query by humming (Midomi) • Simple visualized software (Media player/ iPhone App)

• By People • More different languages songs are produced


Outline • Project Description • Design goals • Non-English speakers can better understand or experience the English songs.

• Solutions to immediate problem • song styles • lyrics types • Methodology • Methods • Lyrics analysis • why only English song • relationship between lyrics and melody

• Melody and other features analysis • Current APIs • Last.fm • OpenAL

• Additional tools

• Design process • Idea • Design sketches • Prototyping • Development • Testing • Revision


Outline • Reception of My Project • Feedback • Observations • Others

• Conclusion • better understand music and so. • Further Works • Other type music • Other language lyrics


Task list & schedule • Now: • This project is a cross-subject project related to

Psychology, Computer Vision, Music, and Graphics.

• What I should do: • Refine the topic, focus on data visualization first!


Task list & schedule • Almost done in studio I: • Strengthen the knowledge of psychology; continue researching

on music, metaphor, emotion and the relationships between lyrics and melody. • Initially list what pattern and words will influence people’s emotion. • Then try to research more articles about the relationship among music, language and psychology and how they influence each other. • Start to make the interactive prototype. (The interface is more like an application) if the final project is an installation, I will consider how to build it, how to test it, and how many projectors will be used.


Task list & schedule • To be done: • Keep refining "Studio I". • Coding, then test the pre-built and real-time visualization

by using Last.fm API. • Testing, refine the algorithm based the lyrics context. • Once the above is finished, start to collect the data from testing people. What is the feeling of same people when see the visualized music or not. • At the end of the project, process and analysis those data, to finish the paper.


Task list & schedule


123