Computational Perception     COMP 546  
Winter 2018
Tues/Thurs  8:35-9:55
 ENGTR 1080



Instructor:    Professor Michael Langer
                      School of Computer Science
Office:           ENGMC 329
Tel:               514-398-3740
Email:           langer  [at] cim.mcgill.ca
Office Hours:  Tues and Thurs 10 AM -11 AM or by appointment
Teaching Assistants (T.A.)

Veronica Rally
Tabish Syed

Their email contacts, office locations, and hours will be announced on mycourses.
Announcements Resources

LECTURE SCHEDULE
  1. introduction (slides)
    levels of analysis in perception, course outline
VISUAL IMAGE FORMATION
  1. geometry (slides)   (notes)
    origins of spatial vision, visual angle, aperture, image projection, binocular disparity
  2. focus and blur (slides)  (notes)
    sampling, thin lens equation, depth of field, accommodation, aging and abnormal vision
  3. photoreceptors, color (slides)  (notes)
    spectra: emission, reflectance, absorptance; rods and cones, metamers, color displays, color blindness
EARLY VISION
  1. retina (slides)   (notes)
    spikes, color opponency, center-surround DOGs, cross-correlation
  2. orientation selectivity (slides)     (notes)
    retinotopic maps, simple cells, Gabor models
  3. disparity tuned cells (slides)   (notes)  
    complex cells in V1, monocular vs. binocular, disparity space
  4. image motion 1 (slides)   (notes)  
    XYT, time dependent receptive fields, 3D Gabors and sine waves, normal velocity
  5. image motion 2 (slides)   (notes)  
    motion constraint equation, intersection of constraints, velocity tuned cells (MT)
3D SURFACE AND SPACE PERCEPTION
  1. egomotion (slides)   (notes)  
    translation and direction of heading; rotation: VOR, smooth pursuit eye movements
  2. depth from blur, binocular steropsis (slides)   (notes)  
    blur on slanted planes, Panum's fusional area, accommodation-vergence conflict, random dot stereograms
  3. shape from X: perspective, texture, shading (slides)   (notes)  
    vanishing points, depth gradient and texture cues, slant & tilt; curvature, Lambert's law
  4. illumination and reflectance (slides)   (notes)  
    shape from shading (linear & cloudy day), lightness & color constancy
MEASURING AND MODELLING PERFORMANCE
  1. psychophysics (slides)   (notes)  
    psychometric curves, thresholds, contrast and disparity sensitivity
  2. maximum likelihood (slides)   (notes)
    examples of likelihoods, probability review
  3. cue combinations, Bayesian models (slides)  (notes)
    priors, MAP, depth reversal ambiguity
LINEAR SYSTEMS THEORY
  1. convolution (slides)   (notes)
    impulse response functions, complex numbers review
  2. Fourier transform and filtering (slides)   (notes)
    examples, convolution theorem, low/band/high pass filters
AUDITORY IMAGE FORMATION  
  1. sound 1 (slides)  (notes)
    pressure vs. intensity, dB
  2. sound 2 (slides)    (notes)
    music and speech sounds, spectrograms
AUDITORY SYSTEM & SPATIAL HEARING        
  1. head and ear (slides)  (notes) 
    head and outer ear (HRIR, HRTF)
  2. auditory pathway, sound localization (slides)  (notes) 
    cochlea and neural coding, duplex theory, Jeffress model, level and timing differences
  3. auditory filters (slides)  (notes) 
    spectrograms revisited, critical bands and masking, spike triggered averaging and A1
  4. echolocation and recognition by bats and porpoises (slides)  (notes) 
    constant frequency, frequency modulation, interference

  5. What to review for final exam (slides)

Exercises





  Exercises 1 - image formation geometry


  Exercises 2 - focus


  Exercises 3 - color



  Exercises 4 - retina      

  Exercises 5 - orientation: simple cells

  Exercises 6 - complex cells

  Exercises 7 - motion 1

  Exercises 8 - motion 2




  Exercises 9 - egomotion

  Exercises 10 - blur and stereopsis


  Exercises 11 - shape from texture

  Exercises 12 - illumination and reflectance


  Exercises 13 - psychophysics

  Exercises 14 - maximum likelihood

  Exercises 15 - Bayes



  Exercises 16 - linear systems 1

  Exercises 17 - linear systems 2



  Exercises 18 - sound 1


  Exercises 19 - sound 2



  Exercises 20 - head, ear

  Exercises 21 - spatial hearing

  Exercises 22 (none)

  Exercises 23 - echolocation