Jeremy R. Cooperstock - Director, Shared Reality Lab
jeremy
Photo credit: M. Mostyn

My lab is broadly concerned with human-computer interaction technologies, emphasizing multimodal sensory augmentation for communication in both co-present and distributed contexts. Our research tackles the full pipeline of sensory input, analysis, encoding, data distribution, and rendering, as well as interaction capabilities and quality of user experience. Applications of these efforts include distributed training of medical and music students, augmented environmental awareness for the blind community, treatment of lazy eye syndrome, low-latency uncompressed HD videoconferencing and a variety of multimodal immersive simulation experiences. Most of our research takes place within the Shared Reality Environment, a facility that includes two different configurations of multi-projector displays, camera and loudspeaker arrays, and a high-fidelity vibrotactile sensing and actuated floor.

BIO · Jeremy Cooperstock (Ph.D., University of Toronto, 1996) is an associate professor in the department of Electrical and Computer Engineering, a member of the Centre for Intelligent Machines, and a founding member of the Centre for Interdisciplinary Research in Music Media and Technology at McGill University. He directs the Shared Reality Lab, which focuses on computer mediation to facilitate high-fidelity human communication and the synthesis of perceptually engaging, multimodal, immersive environments. He led the development of the Intelligent Classroom, the world's first Internet streaming demonstrations of Dolby Digital 5.1, multiple simultaneous streams of uncompressed high-definition video, a high-fidelity orchestra rehearsal simulator, and a simulation environment that renders graphic, audio, and vibrotactile effects in response to footsteps. Cooperstock's work on the Ultra-Videoconferencing system was recognized by an award for Most Innovative Use of New Technology from ACM/IEEE Supercomputing and a Distinction Award from the Audio Engineering Society. The research he supervised on the Autour project earned the Hochhausen Research Award from the Canadian National Institute for the Blind and an Impact Award from the Canadian Internet Registry Association, and his Real-Time Emergency Response project won the Gold Prize (brainstorm round) of the Mozilla Ignite Challenge. Cooperstock has worked with IBM at the Haifa Research Center, Israel, and the T.J. Watson Research Center in Yorktown Heights, New York, the Sony Computer Science Laboratory in Tokyo, Japan, and was a visiting professor at Bang & Olufsen, Denmark, where he conducted research on telepresence technologies as part of the World Opera Project. Cooperstock led the theme of Enabling Technologies for a Networks of Centres of Excellence on Graphics, Animation, and New Media (GRAND) and is an associate editor of the Journal of the AES. (FULL CV AVAILABLE)

selected publications
Blum, J., Frissen, I., and Cooperstock, J.R. (2015).
Improving Haptic Feedback on Wearable Devices through Accelerometer Measurements
User Interface Software and Technology (UIST)
measurement of user motion immediately prior to delivery of a haptic stimulus can help predict the likelihood of that stimulus being perceived
Blum, J., Eichhorn, A., Smith, S., Sterle-Contala, M., and Cooperstock, J.R. (2014).
Real-Time Emergency Response: Improved Management of Real-Time Information During Crisis Situations
Multimodal User Interfaces
describes our video streaming and management architecture as a prototype for NG-911 systems, offering to enhance situational awareness in crisis scenarios
Panëels, S., Olmos, A., Blum, J., and Cooperstock, J. R. (2013).
Listen to It Yourself! Evaluating Usability of "What's Around Me?" for the Blind
Human Factors in Computing Systems (CHI)
task-based and long-term deployment studies of In-Situ Audio Services
Olmos, A., Bouillot, N., Knight, T., Mabire, N., Redel, J., and Cooperstock, J. R. (2012).
A High-Fidelity Orchestra Simulator for Individual Musicians' Practice
Computer Music Journal
simulator architecture to provide an immersive audiovisual experience of ensemble rehearsal or performance
Blum, J., Greencorn, D., and Cooperstock, J.R. (2012).
Smartphone sensor reliability for augmented reality applications.
Mobile and Ubiquitous Systems (Mobiquitous) an extensive analysis of GPS, compass, and gyroscope sensor reliability in current generation smartphones
Blum, J., Bouchard, M., and Cooperstock, J.R. (2011).
What's around me? Spatialized audio augmented reality for blind users with a smartphone
Mobile and Ubiquitous Systems (Mobiquitous)    BEST PAPER AWARD
design of a mobile system to provide environmental awareness to the visually impaired community
Visell, Y., Giordano, B.L., Millet, G., and Cooperstock, J.R. (2011).
Vibration Influences Haptic Perception of Surface Compliance During Walking
PLoS ONE
investigation of how the perception of ground surface compliance is altered by plantar vibration feedback
Cooperstock, J.R. (2011).
Multimodal Telepresence Systems
IEEE Signal Processing Magazine, Special Issue on Immersive Communications
overview of multimodal signal acquisition, processing, transport, and rendering technologies for next generation telepresence systems
To, L., Thompson, B., Blum, J.R., Maehara, G., Hess, R., and Cooperstock, J.R. (2011).
A game platform for treatment of amblyopia
IEEE Transactions on Neural Systems and Rehabilitation Engineering
describes development of a prototype device for take-home use that can be used in the treatment of amblyopia; despite training being relatively intermittent throughout the week, significant improvements were observed
Visell, Y. and Cooperstock, J.R. (2010).
Design of a Vibrotactile Display via a Rigid Surface
IEEE Haptics Symposium    BEST PAPER AWARD
analysis, optimized redesign and evaluation of a high fidelity vibrotactile interface integrated in a rigid surface
Cooperstock, J.R. (2008)
Human-Computer Interaction
Chapter in Wiley Encyclopedia of Computer Science and Engineering, ISBN 978-0-471-38393-2, Benjamin W. Wah, ed., Vol. 3, 1529-1542.
A tutorial overview of the field of HCI, including history, use and context, human characteristics, usability principles, design and evaluation principles, interaction paradigms, related domains, risks of computer technology, and challenges ahead.
FULL PUBLICATIONS LIST
"I do remember students who took your classes. They were clearly divided as those who complained saying that you were a hard grader and expected them to do work, and those who were appreciative for the hard work and what they learned. All those who were willing to do work thought you were a great educator."
winter 2016ECSE487 · Computer Architecture Lab
Monday 8:35 –9:25 · ENGTR 0070
fall 2015ECSE424 · Human-Computer Interaction
Tuesday & Thursday, 11:35 –12:55 · ENGTR 0060
ECSE526 · Artificial Intelligence
Tuesday & Thursday, 8:35 – 9:55 ·  ENGTR 2100
EARLIER COURSES
recent media
Regarding Real-time Emergency Response
GCN, July 24, 2013
National Science Foundation press release, June 25, 2013
Regarding Air Canada's overbooking compensation
Radio-Canada, June 11, 2013
News 1130 Vancouver, June 7, 2013
La Presse, June 7, 2013
Toronto Star, June 6, 2013
Regarding Montreal's transit system
Montreal Gazette, September 11, 2010
Montreal Gazette, March 17, 2010
Global National News, January 29, 2010
Montreal Gazette, January 27, 2010
National Post, January 27, 2010
CBC As It Happens, January 27 2010 ( audio begins at 21:43)
Regarding research activities
Associated Press, Future tech on show at 36th SIGGRAPH, Aug. 3, 2009
Montreal Gazette, January 19, 2009
PREVIOUS MEDIA
videos