Header image  
Research  
 
   

PhD Thesis

Multimedia Annotation Through Search and Mining PDF

 

 

Areas


Graph Theory Learning

Label propagation, clustering, classification. Specifically as applied to multimedia annotation and social media data.

Collaborative Geo and Text-Tagging of Images
Tag suggestion for use with geo-tagged Flickr data. Work presented at CIVR 2009, ICME 2009 Invited Talk, ACM MIR 2008 Brave New Topics. Web interface.
Concepts: very large database management, web development, image search and retrieval, natural scene analysis, geographic footprints of abstract terms, multimodal learning, multimedia annotation, semantic knowledge extraction, graph theory learning.

Video Annotation Through Search and Mining 

Patent pending. Use of mining to filter and extend existing tags for video, in automatic, unsupervised fashion.
Concepts: multimodal learning, video search and retrieval, multimedia annotation, graph theory learning.

Video Search

Search and retrieval of concepts in videos using text, image, and video examples. Participation in TRECVID 2007.

Video Summarization
Creation of video summaries based on a user-attention model to find most salient 4% of original. Presented at ACM MM TRECVID Video Summarization workshop.
Concepts: video search and retrieval, feature selection, user attention modelling, multimodal learning and fusion.

Video Fingerprinting
Compact video "signature" creation that allows for speedy similar and duplicate video retrieval, presented at SPIE 2008.
Concepts: feature selection, video search and retrieval, dimensionality reduction.

Global News Visualization
Public installation that allows user-driven browsing of global news stories. Can be seen at UCSB's Davidson Library, and presented at SIGGRAPH 2007.
Concepts: document similarity and clustering, interactive spaces.



Publications:


Emily Moxley, Tao Mei, B.S. Manjunath. "Video Annotation Through Search and Graph Reinforcement Mining," Accepted to IEEE Transactions on Multimedia, 2009.

Brent Hecht and Emily Moxley. "Terabytes of Tobler: Evaluating the First Law in a Massive, Domain-Neutral Representation of World Knowledge." Conference on Spatial Information Theory, Aber Wrac'h, France, Sep. 2009

Emily Moxley, Jim Kleban, Jiejun Xu, B.S. Manjunath. "All Tags Are Not Created Equal," Invited Talk, ICME: Knowledge Discovery over Community-Sharing Media, Cancun, Mexico, Jun.2009. PDF

Jim Kleban, Emily Moxley, Jiejun Xu, B.S. Manjunath. "Global Annotation on Georeferenced Photographs," Conference on Image and Video Retrieval, Santorini, Greece, Jul.2009. PDF

Emily Moxley, Jim Kleban and B.S. Manjunath, "SpiritTagger: A Geo-Aware Tag Suggestion Tool Mined from Flickr," Proc. ACM International Conference on Multimedia Information Retrieval (MIR2008), Vancouver, Canada, Oct. 2008. PDF

Emily Moxley and Tao Mei and Xian-Sheng Hua and Wei-Ying Ma and B.S. Manjunath, "Automatic Video Annotation Through Search and Mining," Proc. IEEE International Conference on Multimedia and Expo (ICME), Hannover, Germany, Jun. 2008. PDF

Anindya Sarkar, Pratim Ghosh, Emily Moxley and B. S. Manjunath,
"Video Fingerprinting: Features for Duplicate and Similar Video Detection and Query-based Video Retrieval," Proc. SPIE - Multimedia Content Access: Algorithms and Systems II, San Jose, California, Jan. 2008. PDF

E. Drelie Gelasca, S. Joshi, J. Kleban, S. Mangiat, B.S. Manjunath, E. Moxley, A. Sarkar, and J. Xu, "The Vision Research Lab of UCSB at TRECVID 2007," Proc. Proceedings of the TRECVID 2007 Workshop, Nov. 2007. PDF

J. Kleban, A. Sarkar, E. Moxley, S. Mangiat, S. Joshi, T. Kuo and B.S. Manjunath, "Feature fusion and redundancy pruning for rush video summarization," Proc. International Workshop on TRECVID Video Summarization, Augsburg, Bavaria, Germany, pp. 84-88, Sep. 2007. PDF

Elisa Drelie Gelasca, Joriz De Guzman, Steffen Gauglitz, Pratim Ghosh, JieJun Xu, Emily Moxley, Amir M. Rahimi, Zhiqiang Bi and B. S. Manjunath, "CORTINA: Searching a 10 Million + Images Database", Technical Report, VRL, ECE, University of California, Santa Barbara, Sep. 2007. PDF

Alexander Villacorta, Karl Grossner, Jonathan Ventura, Anne-Marie Hansen, Emily Moxley, Joriz De Guzman, Matt Peterson. "Spheres of Influence," SIGGRAPH 2007. PDF--abstract only



Reviewer for:

Transactions on Pattern Analysis and Machine Intelligence
, Apr. 2009.

International Conference on Multimedia and Expo
, Mar. 2009.

Transactions on Multimedia,
Sep. 2008.

Transactions on Multimedia, Communities and Media Computing, Jul. 2008.

ICIP 2008. Video Segmentation, Oct. 2008.



Other Professional Activities:

Vespucci Institute on Spatial Cognition
Scholarship Awardee

Coordinator for Undergraduate and High School Mentoring Program

Interactive Digital Multimedia

NSF IGERT Project Meeting Presentation, May 2008.
SACNAS Presentation, October 2006.

Internship, UCSB Dean of Students Yonie Harris, 2008-2009.



Email me for my C.V., resume.