Computational Perception     COMP 546  
Winter 2018
Tues/Thurs  8:35-9:55
 ENGTR 1080



Instructor:    Professor Michael Langer
                      School of Computer Science
Office:           ENGMC 329
Tel:               514-398-3740
Email:           langer  [at] cim.mcgill.ca
Office Hours:  Tues and Thurs 10 AM -11 AM or by appointment
Teaching Assistants (T.A.)

Veronica Rally
Tabish Syed

Their email contacts, office locations, and hours will be announced on mycourses.
Announcements Resources

LECTURE SCHEDULE
  1. introduction (slides)
    levels of analysis in perception, course outline
VISUAL IMAGE FORMATION
  1. geometry (slides)   (notes)
    origins of spatial vision, visual angle, aperture, image projection, binocular disparity
  2. focus and blur (slides)  (notes)
    sampling, thin lens equation, depth of field, accommodation, aging and abnormal vision
  3. photoreceptors, color (slides)  (notes)
    spectra: emission, reflectance, absorptance; rods and cones, metamers, color displays, color blindness
EARLY VISION
  1. retina (slides)   (notes)
    spikes, color opponency, center-surround DOGs, cross-correlation
  2. orientation selectivity (slides)     (notes)
    retinotopic maps, simple cells, Gabor models
  3. disparity tuned cells (slides)   (notes)  
    complex cells in V1, monocular vs. binocular
  4. image motion 1 (slides)   (notes)  
    XYT, time dependent receptive fields, 3D Gabors and sine waves, normal velocity
  5. image motion 2 (slides)   (notes)  
    motion constraint equation, intersection of constraints, velocity tuned cells (MT)
3D SURFACE AND SPACE PERCEPTION
  1. egomotion (slides)   (notes)  
    translation and direction of heading; rotation: VOR, smooth pursuit eye movements
  2. depth from blur, binocular steropsis (slides)   (notes)  
    blur on slanted planes, Panum's fusional area, accommodation-vergence conflict, random dot stereograms
  3. shape from X: perspective, texture, shading (slides)   (notes)  
    vanishing points, depth gradient and texture cues, slant & tilt; curvature, Lambert's law
  4. illumination and reflectance (slides)   (notes)  
    shape from shading (linear & cloudy day), lightness & color constancy
MEASURING AND MODELLING PERFORMANCE
  1. psychophysics (slides)   (notes)  
    psychometric curves, thresholds, contrast and disparity sensitivity
  2. maximum likelihood (slides)   (notes)
    examples of likelihoods, probability review
  3. cue combinations, Bayesian models (slides)   (notes)
    priors, MAP, depth reversal ambiguity
LINEAR SYSTEMS THEORY
I will remove some of this material in Winter 2018 to reduce to 2 lectures.
  1. convolution (slides)   (notes)
    impulse response functions
  2. Fourier transform (slides)   (notes)
    examples, convolution theorem, inverse Fourier transform
    filtering (slides)   (notes)
    white noise, low/band/high pass filters, Gaussian and Gabor, 2D Fourier transforms
AUDITORY IMAGE FORMATION  
  1. sound 1 (slides)   (notes)
    waves, intensity, dB, interaural differences
  2. sound 2 (slides)     (notes)
    music and speech sounds, spectrograms
AUDITORY SYSTEM & SPATIAL HEARING        
  1. head and ear (slides)   (notes)  
    head and outer ear (HRIR, HRTF), inner ear and neural coding, critical bands
  2. auditory pathway in brain, source localization (slides)   (notes)  
    from brain stem to cortex (A1), duplex theory, level and timing differences
  3. echolocation and recognition by bats and porpoises (slides)   (notes)  
    constant frequency, frequency modulation, echos
  4. [MAYBE DROP THIS IN 2018]
MID- AND HIGH-LEVEL VISION & AUDITION (TIME PERMITTING)  
I will try to add some audition material to these lectures (and remove some stuff).
  1. attention (slides)   (notes)
    feature maps, saliency, visual search
  2. perceptual organization (slides)     (notes)
    Gestalt laws of grouping, computational auditory scene analysis
  3. object recognition
    Biederman, Marr, RSVP, machine learning-based models

Exercises





  Exercises 1 - image formation geometry


  Exercises 2 - focus


  Exercises 3 - color



  Exercises 4 - retina      

  Exercises 5 - orientation: simple cells

  Exercises 6 - complex cells

  Exercises 7 - motion 1

  Exercises 8 - motion 2




  Exercises 9 - egomotion

  Exercises 10 - blur and stereopsis


  Exercises 11 - shape from texture

  Exercises 12 - illumination and reflectance