Computational Perception     COMP 546  
Winter 2018
Tues/Thurs  8:35-9:55
 ENGTR 1080



Instructor:    Professor Michael Langer
                      School of Computer Science
Office:           ENGMC 329
Tel:               514-398-3740
Email:           langer  [at] cim.mcgill.ca
Office Hours:  Tues and Thurs 10 AM -11 AM or by appointment
Announcements
  • This is NOT the course web page for Winter 2019. For Winter 2019, I will only use mycourses. I will leave this legacy web page as is.

    Here is the Course Outline for Winter 2019
    The main change in Winter 2019 will be the Evaluation.. In addition to three assignments and a midterm and final exam, there will be a research paper presentation + report. The presentation will be part of a poster session. The purpose of this course component is to give you some research exposure, and a chance to interact with each other.

  • Winter 2018 lecture notes in one file

Resources

LECTURE SCHEDULE
  1. introduction (slides)
    levels of analysis in perception, course outline
IMAGE FORMATION, EARLY VISUAL PROCESSING
  1. geometry (slides)   (notes)
    origins of spatial vision, visual angle, aperture, image projection, binocular disparity
  2. focus and blur (slides)  (notes)
    sampling, thin lens equation, depth of field, accommodation, aging and abnormal vision
  3. photoreceptors, color (slides)  (notes)
    spectra: emission, reflectance, absorptance; rods and cones, metamers, color displays, color blindness
  4. retina (slides)   (notes)
    spikes, color opponency, center-surround DOGs, cross-correlation
  5. orientation selectivity (slides)     (notes)
    retinotopic maps, simple cells, Gabor models
  6. disparity tuned cells (slides)   (notes)  
    complex cells in V1, monocular vs. binocular, disparity space
  7. image motion 1 (slides)   (notes)  
    XYT, time dependent receptive fields, 3D Gabors and sine waves, normal velocity
  8. image motion 2 (slides)   (notes)  
    motion constraint equation, intersection of constraints, velocity tuned cells (MT)
VISUAL CUES FOR SURFACE AND DEPTH PERCEPTION
  1. egomotion (slides)   (notes)  
    translation and direction of heading; rotation: VOR, smooth pursuit eye movements
  2. depth from blur, binocular steropsis (slides)   (notes)  
    blur on slanted planes, Panum's fusional area, accommodation-vergence conflict, random dot stereograms
  3. shape from X: perspective, texture, shading (slides)   (notes)  
    vanishing points, depth gradient and texture cues, slant & tilt; curvature, Lambert's law
  4. illumination and reflectance (slides)   (notes)  
    shape from shading (linear & cloudy day), lightness & color constancy
MEASURING AND MODELLING PERFORMANCE
  1. psychophysics (slides)   (notes)  
    psychometric curves, thresholds, contrast and disparity sensitivity
  2. maximum likelihood (slides)   (notes)
    examples of likelihoods, probability review
  3. cue combinations, Bayesian models (slides)  (notes)
    priors, MAP, depth reversal ambiguity
LINEAR SYSTEMS THEORY
  1. convolution (slides)   (notes)
    impulse response functions, complex numbers review
  2. Fourier transform and filtering (slides)   (notes)
    examples, convolution theorem, low/band/high pass filters
AUDITORY IMAGE FORMATION  
  1. sound 1 (slides)  (notes)
    pressure vs. intensity, dB
  2. sound 2 (slides)    (notes)
    music and speech sounds, spectrograms
AUDITORY SYSTEM & SPATIAL HEARING        
  1. head and ear (slides)  (notes) 
    head and outer ear (HRIR, HRTF)
  2. auditory pathway, sound localization (slides)  (notes) 
    cochlea and neural coding, duplex theory, Jeffress model, level and timing differences
  3. auditory filters (slides)  (notes) 
    spectrograms revisited, critical bands and masking, spike triggered averaging and A1
  4. echolocation and recognition by bats and porpoises (slides)  (notes) 
    constant frequency, frequency modulation, interference

  5. What to review for final exam (slides)

Exercises





  Exercises 1 - image formation geometry


  Exercises 2 - focus


  Exercises 3 - color



  Exercises 4 - retina      

  Exercises 5 - orientation: simple cells

  Exercises 6 - complex cells

  Exercises 7 - motion 1

  Exercises 8 - motion 2




  Exercises 9 - egomotion

  Exercises 10 - blur and stereopsis


  Exercises 11 - shape from texture

  Exercises 12 - illumination and reflectance


  Exercises 13 - psychophysics

  Exercises 14 - maximum likelihood

  Exercises 15 - Bayes



  Exercises 16 - linear systems 1

  Exercises 17 - linear systems 2



  Exercises 18 - sound 1


  Exercises 19 - sound 2



  Exercises 20 - head, ear

  Exercises 21 - spatial hearing

  Exercises 22 (none)

  Exercises 23 - echolocation