From Vision-Realistic Rendering to Vision Correcting Displays

On the afternoon of Oct 16, 2015, Brian A. Barsky, aprofessor from the University of California, Berkeley, gave a talk named "FromVision-Realistic Rendering to Vision Correcting Displays" to ShanghaiTechfaculty and students. In this talk, Prof. Barsky introduced the prospect ofnovel computer vision, some of the innovations and breakthroughs that arerequired to realize this vision.

Firstly, Prof. Barsky introduced present research onsimulating human vision and on vision correcting displays. The simulation isnot an abstract model but incorporates real measurements of a particular individual’sentire optical system. In its simplest form, these measurements can be theindividual's eyeglasses prescription; beyond that, more detailed measurementscan be obtained using an instrument that captures the individual's wavefrontaberrations. Using these measurements, synthetics images are generated. Thisprocess modifies input images to simulate the appearance of the scene for theindividual. Then, Prof. Barsky showed the examples of simulations using datameasured from individuals with high myopia (near-sightedness), astigmatism, andkeratoconus, as well as simulations based on measurements obtained before andafter corneal refractive (LASIK) surgery.

After that, Prof. Barsky discussed his recent work onvision-correcting displays. Given the measurements of the optical aberrationsof a user’s eye, a vision correcting display will present a transformed imagethat will appear in sharp focus when viewed by this individual. This couldimpact computer monitors, laptops, tablets, and mobile phones. Visioncorrection could be provided in some cases where spectacles are ineffective. Oneof the potential applications of possible interest is a heads-up display thatwould enable a driver or pilot to read the instruments and gauges with his orher lens still focused for the far distance.

At the end of the seminar, Professor Barsky answered manyteachers’ and students’ questions.

Brian A. Barsky is on the faculty of the University ofCalifornia, Berkeley where he is Professor of Computer Science and VisionScience, Affiliate Professor of Optometry, Member of the Joint Graduate Groupin Bioengineering with the UCSF medical school, Member of the Berkeley Centerfor New Media, Member of Berkeley Institute of Design, and an Arts ResearchCenter Affiliate. He holds degrees from McGill University, Cornell University,and the University of Utah. He is a Fellow of the American Academy of Optometry(F.A.A.O.).