Spring 2010 - CIS 8590.002

Visual Information Analysis

Basic Information

·  Lecture Time: Mon 5:30-8:00pm, TL 403B

·  Instructor: Haibin Ling | Wachman Hall, Room 305 | 215-204-6973 | hbling AT temple.edu

·  Office Hours: Mon 3:30-5:30pm, or by appointment

·  Syllabus: PDF


Topics and Materials

Week 1

General introduction. (Slides)

·  Background

·  Topics in visual data analysis

·  Applications

·  Related fields

Week 2

Introduction to statistical tools. (Slides)

·  Linear analysis (PCA, LDA, etc.)

·  Graph algorithms (HMM, MRF, etc.)

Introduction to optimization

·  Basic ideas and principles

Week 3

Introduction to optimization (Slides)

·  Basic idea and linear optimization

·  Convex optimization


·  Convex optimization by Boyd and Vandenberghe.

Week 4

Generative vs. discriminative models, Dr. Montillo (guest lecturer, Slides)

·  Manifold representation

Paper selection due!

Paper presentation (Slides):

·  [Presenter: Haibin Ling], A Global Geometric Framework for Nonlinear Dimensionality Reduction, Joshua B. Tenenbaum, Vin de Silva, John C. Langford, Science.

·  [Presenter: Haibin Ling], Nonlinear Dimensionality Reduction by Locally Linear Embedding, Sam T. Roweis, Lawrence K. Saul, Science.

Week 5

Object recognition - binary cases

·  Shape matching and classification (Slides)

Paper presentation:

·  [Presenter: Ana Milicic, Slides], Shape Matching and Object Recognition Using Shape Contexts, Serge Belongie, Jitendra Malik and Jan Puzicha, PAMI, 24(4):509-522, April 2002.

·  [Presenter: Gregory Johnson, Slides], A new point matching algorithm for non-rigid registration, Haili Chui and Anand Rangarajan, Computer Vision and Image Understanding (CVIU), 89:114-141, 2003.

Week 6

Object recognition - image based

·  Face recognition (Slides)

Paper presentation:

·  [Presenter: Nan Li (Slides)], Robust Face Recognition via Sparse Representation, John Wright, Allen Yang, Arvind Ganesh, Shankar Sastry, and Yi Ma, PAMI'09

·  [Presenter: Nemanja Djuric (Slides)], Attribute and Simile Classifiers for Face Verification, by N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, ICCV'09

Additional materials

·  Eigenfaces for recognition. Journal of Cognitive Neuroscience, Turk, M. & Pentland, A. (1991) 3, 71-86

·  Patchwork of Parts Models for Object Recognition, Y. Amit, A.PTrouve, IJCV 2007.

·  Lambertian Reflectance and Linear Subspaces, IEEE Trans. on Pattern Analysis and Machine Intelligence, 25(2):218-233, (2003). R. Basri and D. Jacobs.

Spring Break!

Week 8

Category recognition and scene understanding

·  Random forest, Dr. Montillo (guest lecturer, Slides)

Paper presentation:

·  [Presenter: Solomon Jones, (Slides)], I know what you did last summer: object-level auto-annotation of holiday snapsStephan Gammeter, Lukas Bossard, Till Quack, and Luc Van Gool, ICCV'09

·  [Presenter: Soumya Musku, (Slides)], Modeling the shape of the scene: a holistic representation of the spatial envelope, Aude Oliva, Antonio Torralba, International Journal of Computer Vision, Vol. 42(3): 145-175, 2001.

Week 9

Object detection - image based

·  Face detection

Project proposal (presentation)!

Paper presentation:

·  [Presenter: Yang Liu, (Slides)], Robust Real-time Object Detection, P. Viola and M. Jones, IJCV 2002.

·  [Presenter: Haibin Ling, (Slides)], Additive logistic regression: a statistical view of boosting, J. Friedman, T. Hastie, and R. Tibshirani, The Annals of Statistics 2000.

Week 10

Video analysis

·  Visual tracking

Paper presentation:

·  [Presenter: Gregory Johnson], CONDENSATION - conditional density propagation for visual tracking, M. Isard and A. Blake, IJCV 1998.

·  [Presenter: Meng Yi, (Slides)], Visual Tracking with Online Multiple Instance Learning, Boris Babenko, Ming-Hsuan Yang, Serge Belongie, CVPR'09.

Week 11

Video analysis

·  Action and activity recognition (Slides)

Paper presentation:

·  [Presenter: Tianyang Ma, (Slides)], Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words, Juan Carlos Niebles, Hongcheng Wang and Li Fei-Fei, IJCV 2008.

·  [Presenter: Jin Sun, (Slides)], On space-time interest points, I Laptev, IJCV 2005.

Additional materials:

·  Behavior Recognition via Sparse Spatio-Temporal Features, P Dollar, V Rabaud, G Cottrell, S Belongie, VS-PETS, 2005.

·  Actions as space-time shapes, Gorelick, L., Blank, M., Shechtman, E., Irani, M., and Basri, R. PAMI 2007.

Week 12

Medical imaging analysis

·  Background introduction

·  Computer aided diagnosis

Week 13

Medical imaging analysis

·  Introduction

Paper presentation:

·  [Presenter: Tatyana Nuzhnaya, (Slides)], Fast Automatic Heart Chamber Segmentation from 3D CT Data Using Marginal space Learning and Steerable Features, Y. Zheng, A. Barbu, B. Georgescu, M. Scheuering, D. Comaniciu, ICCV'07

·  [Presenter: Erkang Cheng], Random walks for image segmentation, Leo Grady, PAMI, 2006.

Additional references

·  Fast Approximate Energy Minimization via Graph Cuts, Yuri Boykov, Olga Veksler, Ramin Zabih, PAMI, 2001.

Week 14

Project presentation by Y. Meng; T. Ma; S. Johns; J. Sun; G. Johnson & S. Musku

Week 15

Project presentation by T. Nuzhnaya; E. Cheng; N. Li; Y. Liu; N. Djuric & A. Milicic


Project report due!