Material
Teaching Material
Audio processing - Gaël Richard
- slides
- video presentation - 1 hour 25 minutes, 32MB (video)*
Semantic Web - Steffen Staab
- part 0: Motivation and Agenda
- part 1: Ontologies and their languages
- video presentation - 1 hour 46 minutes, 64MB (video)*
- part 2: Query language
- part 3: Multimedia Ontology
- part 4: Multmedia Annotation (not covered)
- video presentation - 1 hour 20 minutes, 52MB (video)*
Human language technology for multimedia analysis - Thierry Declerck
- slides
- video presentation - 1 hour 20minutes, 60MB (video)*
Speech processing - Steve Renals
- slides
- video presentation - 1 hour 33minutes, 35MB (video)*
Image and Video Processing - Noel O'Connor
- slides
- video presentation - 1 hour 15 minutes, 49MB (video)*
- video presentation - 1 hour 24 minutes, 54MB (video)*
Cross-modal analysis - Alex Hauptmann
- part 1
- video presentation - 1 hour 25 minutes, 32MB (video)*
- part 2
- video presentation - 1 hour 25 minutes, 32MB (video)*
Concept-based video indexing & retrieval - Cees Snoek
IR foundations - Keith van Rijsbergen
- slides
- Keith's IR book
- video presentation - 1 hour 33 minutes, 35MB (video)*
Multimedia IR evaluation initiatives - Alan Smeaton
- slides
- video presentation - 1 hour 33 minutes, 35MB (video)*
Character retrieval and annotation in multimedia - or "How to find Buffy" - Andrew Zisserman
- slides
- video presentation - 1 hour 25 minutes, 32MB (video)*
- Video Google - faces: http://www.robots.ox.ac.uk/~vgg/research/fgoogle/
Music information retrieval - Stephen Downie
- slides
- video presentation - 1 hour 25 minutes, 32MB (video)*
Multimedia interaction - Lynda Hardman
- part 1: eCulture07, Guss Schreiber
- video presentation - 1 hour 23 minutes, 55MB (video)*
- part 2: Flexible Interfaces
- video presentation - 1 hour 19 minutes, 50MB (video)*
*only plays in Internet Explorer
Posters
Links to external resources
Please email us with links to relevant external resources (software, demos, teaching material, books, etc.)!
Libraries
- OpenCV: http://www.intel.com/technology/computing/opencv/index.htm
This library implements a lot of computer vision algorithm for segmentation, learning, detection, tracking, etc, and is useful as a starting point (not to reinvent the wheel). - libDAI: http://www.mbfys.ru.nl/~jorism/libDAI/
A useful library for the inference in graphical models. It supports a number of exact and approximate inference algorithms. - LIBSVM: http://www.csie.ntu.edu.tw/~cjlin/libsvm/
A Library for Support Vector Machines.
Reading
- A sample chapter of a nice book on pattern recognition, covering the
inference on graphical models, that can be useful:
http://research.microsoft.com/~cmbishop/PRML/Bishop-PRML-sample.pdf
Systems/demos
- The esp game: http://www.espgame.org/
- Flickr - annotated data: http://www.flickr.com
Other Resources
- Evaluation Initiatives/Benchmarking
- TRECVID Benchmark: http://trecvid.nist.gov/
- VideOlympics - benchmarking the fun factor in multimedia retrieval: http://www.videolympics.org
- Concept detectors
- LSCOM - annotated lexicon of 1000 concepts:
http://www.ee.columbia.edu/ln/dvmm/lscom/ + http://www.lscom.org/ - MediaMill Challenge - a baseline for 101 multimedia concept detectors:
http://www.mediamill.nl/challenge/ - Columbia374 - a baseline for 374 visual concept detectors:
http://www.ee.columbia.edu/ln/dvmm/columbia374/
- LSCOM - annotated lexicon of 1000 concepts:
Resources from participants
- Aistair's experiment
Please take part in the captioning experiments for the Tripod Project at http://snipurl.com/tripod_experiments.
Your participation in these experiments will help to create new services to automatically annotate images with geographical concepts describing where photographs have been taken and their likely content. - Peyman's performance videos
- SOAS Greek & Kurdish-Iranian concert: 23 June 2005
http://www.youtube.com/watch?v=aDBRZxyYrcw
http://www.youtube.com/watch?v=WvSwbBKV_3o
http://www.youtube.com/watch?v=FlLUshi55tg - Centre for Digital Music’s internal rehearsal/concert (Klezmer &
Persian): 28 June, 2007
http://www.youtube.com/watch?v=JMRCg_hRtng
http://www.youtube.com/watch?v=RSe7Qxl_kk4 - You are also invited to my next concert in Italy: Rovigo festival,
Itlay 7-9 Sep. 2007
http://www.minelliana.it/2007/index.htm
- SOAS Greek & Kurdish-Iranian concert: 23 June 2005