From Vision-Realistic Rendering to Vision Correcting Displays

On the afternoon of Oct 16, 2015, Brian A. Barsky, a professor from the University of California, Berkeley, gave a talk named From Vision-Realistic Rendering to Vision Correcting Displays to ShanghaiTech faculty and students. In this talk, Prof. Barsky introduced the prospect of novel computer vision, some of the innovations and breakthroughs that are required to realize this vision.

Firstly, Prof. Barsky introduced present research on simulating human vision and on vision correcting displays. The simulation is not an abstract model but incorporates real measurements of a particular individual’s entire optical system. In its simplest form, these measurements can be the individual’s eyeglasses prescription; beyond that, more detailed measurements can be obtained using an instrument that captures the individual's wave front aberrations. Using these measurements, synthetics images are generated. This process modifies input images to simulate the appearance of the scene for the individual. Then, Prof. Barsky showed the examples of simulations using data measured from individuals with high myopia (near-sightedness), astigmatism, and keratoconus, as well as simulations based on measurements obtained before and after corneal refractive (LASIK) surgery.

After that, Prof. Barsky discussed his recent work on vision-correcting displays. Given the measurements of the optical aberrations of a user’s eye, a vision correcting display will present a transformed image that will appear in sharp focus when viewed by this individual. This could impact computer monitors, laptops, tablets, and mobile phones. Vision correction could be provided in some cases where spectacles are ineffective. One of the potential applications of possible interest is a heads-up display that would enable a driver or pilot to read the instruments and gauges with his or her lens still focused for the far distance.

At the end of the seminar, Professor Barsky answered many teachers’ and students’ questions.

Brian A. Barsky is on the faculty of the University of California, Berkeley where he is Professor of Computer Science and Vision Science, Affiliate Professor of Optometry, Member of the Joint Graduate Grouping Bioengineering with the UCSF medical school, Member of the Berkeley Center for New Media, Member of Berkeley Institute of Design, and an Arts Research Center Affiliate. He holds degrees from McGill University, Cornell University, and the University of Utah. He is a Fellow of the American Academy of Optometry(F.A.A.O.).