Jingyi Yu
Deputy Provost, Executive Dean, Professor
Graduated School: Ph.D., Massachusetts Institute of Technology, USA
Tel:(021) 20685380
Office:Room 1A-217, SIST Building
Research Interests
Biography
Selected Publications

RESEARCH INTERESTS

  • Computer Vision

  • Computer Graphics

  • Computational Imaging and Photography

  • Medical Imaging

  • Bioinformatics


Prof. Jingyi Yu is the Vice Provost of ShanghaiTech University. He also serves as the Executive Dean of the School of Information Science and Technology at ShanghaiTech University. He received B.S. from Caltech in 2000 and Ph.D. from MIT in 2005. Before joining ShanghaiTech, he was a full professor at the University of Delaware. His research interests span a range of topics in computer vision and computer graphics, especially on computational photography and non-conventional optics and camera designs. He has published over 120 papers at highly refereed conferences and journals including over 70 papers at the premiere conferences and journals CVPR/ICCV/ECCV/TPAMI. He has also been granted 10 US patents. His research has been generously supported by the National Science Foundation (NSF), the National Institute of Health, the Army Research Office, and the Air Force Office of Scientific Research (AFOSR). He is a recipient of the NSF CAREER Award, the AFOSR YIP Award, and the Outstanding Junior Faculty Award at the University of Delaware. He has served as general chair, program chair, and area chair of many international conferences such as CVPR, ICCV, ECCV, ICCP and NIPS. He is currently an Associate Editor of IEEE TPAMI, IEEE TIP and Elsevier CVIU, and is the program chair of ICPR 2020, IEEE CVPR 2021, IEEE WACV 2021, and ICCV 2025. For his contributions to computer vision and computational photography, he was elevated to IEEE Fellow.

SELECTED PUBLICATIONS

Journals

  1. Siyuan Shen, Zi Wang, Ping Liu, Zhengqing Pan, Ruiqian Li, Tian Gao, Shiying Li and Jingyi Yu, Non-line-of-sight Imaging via Neural Transient Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021(accepted)

  2. Qi Zhang, Qing Wang, Hongdong Li and Jingyi Yu, Ray-Space Epipolar Geometry for Light Field Cameras, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 (accepted)

  3. Xianqiang Lv, Xue Wang, Qing Wang, Jingyi Yu, 4D Light Field Segmentation from Light Field Super-pixel Hypergraph Representation, IEEE Transactions on Visualization and Computer Graphics (TVCG), 2020 (accepted)

  4. JWei Yang, Yingliang Zhang, Jinwei Ye, Yu Ji, Zhong Li, Mingyuan Zhou and Jingyi Yu, Structure from Motion on XSlit Cameras, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 43(5): 1691-1704, 2019

  5. Wentao Lyu, Peng Ding, Yingliang Zhang, Anpei Chen, Minye Wu, Shu Yin and Jingyi Yu, Refocusable Giga-Pixel Panoramas for Immersive VR Experiences, IEEE Transactions on Visualization and Computer Graphics (TVCG), 27(3): 2028-2040, 2019

  6. Mingyuan Zhou, Yuqi Ding, Yu Ji, Shiqiong Susan Young, Jingyi Yu, Jinwei Ye, Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 42 (7): 1594-1605, 2020

  7. Cen Wang, Minye Wu, Ziyu Wang, Liao Wang, Hao Sheng and Jingyi Yu, Neural Opacity Point Cloud, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 42 (7): 1570-1581, 2020

  8. Yongri Piao, Xiao Li, Miao Zhang, Jingyi Yu, Huchuan Lu, “Saliency Detection via Depth-Induced Cellular Automata on Light Field”, IEEE Transactions on Image Processing (TIP), 2019, 29: 1879 – 1889.

  9. Jinwei Ye, Yu Ji, Mingyuan Zhou, Sing Bing Kang and Jingyi Yu, “Content Aware Image Pre-Compensation”, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019, 41(7): 1545-1558.

  10. Kang Zhu, Yujia Xue, Qiang Fu, Sing Bing Kang, Xilin Chen and Jingyi Yu, “Hyperspectral Light Field Stereo Matching”, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019, 41(5): 1131-1143.

  11. Xin Chen, Yuwei Li, Xi Luo, Tianjia Shao, Jingyi Yu, Kun Zhou, Youyi Zheng, “AutoSweep: Recovering 3D Editable Objects from a Single Photograph”, IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018, 14(8): 1-10.

  12. Hao Sheng, Jiahui Chen, Yang Zhang, Wei Ke, Zhang Xiong, Jingyi Yu, “Iterative Multiple Hypothesis Tracking with Tracklet Level Association”, in IEEE Transactions on Circuit and Systems for Video Technology (TCSVT), 2019, 29(12): 3660 – 3672.

  13. Yanyu Xu, Shenghua Gao, Junru Wu, Nianyi Li, Jingyi Yu, “Personalized Saliency and Its Prediction”, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019, 41(12): 2975 – 2989.

  14. Qi Zhang, Chunping Zhang, Jinbo Ling, Qing Wang, Jingyi Yu, “A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras”, in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019, 41(11): 2539 – 2552.

  15. Dongze Lian, Lina Hu, Weixin Luo, Yanyu Xu, Lixin Duan, Jingyi Yu, Shenghua Gao, “Multiview Multitask Gaze Estimation With Deep Convolutional Neural Networks”, IEEE transactions on neural networks and learning systems, 2019, 30(10): 3010-3023.

  16. Yu ZhuShiying LiXi LuoKang ZhuQiang FuXilin ChenHuixing GongJingyi Yu, “A Shared Augmented Virtual Environment for Real‐time Mixed Reality Applications”, Computer Animation &Virtual Worlds, 2018, 1805: 1-14

  17. Mingyuan Zhou, Haiting Lin, S. Susan Young, Jingyi Yu, “Hybrid Sensing Face Detection and Registration for Low-light and Unconstrained Conditions”, Applied Optics, 2018, 57(1): 69~78.

  18. Hao Zhu, Qing Wang, Jingyi Yu, “Light Field Imaging: Models, Calibrations, Reconstructions, and Applications”, Frontiers of Information Technology & Electronic Engineering, vol. 18, no. 9, pp. 1236~1249, 2017.

  19. Yebin Liu, Lu Fang, Diego Gutierrez, Qing Wang, Jingyi Yu, Feng Wu, “Introduction to the Issue on Light Field Image Processing”, IEEE Journal of Selected Topics in Signal Processing (JSTSP), vol. 11, no. 7, pp. 923~925, 2017.

  20. Jing Li, Tao Yang, Jingyi Yu, “Random Sampling and Model Competition for Guaranteed Multiple Consensus Sets Estimation”,International Journal of Advanced Robotic Systems, pp. 1~11, 2017.

  21. Hao Zhu, Qing Wang, and Jingyi Yu, “Occlusion-Model Guided Anti-Occlusion Depth Estimation in Light Field”, IEEE Journal of Selected Topics in Signal Processing, 2017.

  22. Zhaolin Xiao, Qing Wang, and Jingyi Yu, “Aliasing Detection and Reduction Scheme on Angularly Undersampled Light Fields”, IEEE Transaction on Image Processing (TIP), 2017.

  23. Jingyi Yu, “A Light Field Journal to Virtual Reality”, IEEE Multimedia, 2017.

  24. Nianyi Li, Jinwei Ye, Yu Ji, Haibin Ling, and Jingyi Yu, “Saliency Detection on Light Field”, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2017.

  25. Yang Yang, Haiting Lin, Zhan Yu, Sylvain Paris, and Jingyi Yu, “Virtual DSLR: High Quality Dynamic Depth-of-Field Synthesis on Mobile Platforms”, SPIE Electronic Imaging, pp. 1-9, 2016.

  26. Xinqing Guo, Zhan Yu, Sing Bing Kang, Haiting Lin, and Jingyi Yu, “Enhancing Light Fields through Ray-Space Stitching”, IEEE Transactions on Visualization & Computer Graphics (TVCG), 2015.

  27. Tao Yang, Jing Li, Jingyi Yu, Yanning Zhang, Wenguang Ma, Xiaomin Tong, Rui Yu, and Lingyan Ran, “Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion”, Sensors, vol. 15, no. 8, pp. 18965-18984, 2015.

  28. Tao Yang, Wenguang Ma, Sibing Wang, Jing Li, Jingyi Yu, and Yanning Zhang, “Kinect based real-time synthetic aperture imaging through occlusion”, Multimedia Tools and Applications, pp. 1-19, 2015.

  29. Xiaogang Chen, Sing Bing Kang, Jie yang, and Jingyi Yu, “Fast Edge-Aware Denoising by Approximated patch Geodesic Paths”, in IEEE Transactions on Circuit and Systems for Video Technology (TCSVT), 2015. 

 

Premiere Conference Publications (Top conferences in Computer Vision/Computer Gaphics/Bioinformatics, Ranked by Microsoft Academic) 

  1. Ziheng Zhang, Anpei Chen, Ling Xie, Jingyi Yu, Shenghua Gao, “Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentation”, ACM International Conference on Multimedia (ACM MM), 2019.

  2. Anpei Chen, Zhang Chen, Guli Zhang, Ziheng Zhang, Kenny Mitchell and Jingyi Yu, “Photo-Realistic Facial Details Synthesis from Single Image”, in Proceeding of IEEE International Conference on Computer Vision (ICCV), 2019 (Oral) .

  3. Qi Zhang, Jinbo Ling, Qing Wang, Jingyi Yu, “Ray-space Projection Model for Light Field Camera”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

  4. Jie Lu, Yu Ji, Jingyi Yu, Jinwei Ye, “Mirror Surface Reconstruction Using Polarization Field”, IEEE International Conference on Computational Photography (ICCP), May 15-17, 2019.

  5. Xuan Cao, Zhang Chen, Anpei Chen, Xin Chen, Shiying Li and Jingyi Yu, “Sparse Photometric 3D Face Reconstruction Guided by Morphable Models”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.

  6. Zhong Li, Minye Wu, Wangyiteng Zhou and Jingyi Yu, “4D Human Body Correspondences from Panoramic Depth Maps”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.

  7. Yang Yang, Shi Jin, Ruiyang Liu, Sing Bing Kang and Jingyi Yu, “Automatic 3D Indoor Scene Modeling from Single Panorama”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.

  8. Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, and Shenghua Gao, “Gaze Prediction in Dynamic 360° Immersive Videos”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.

  9. Can Chen, Scott McCloskey, Jingyi Yu, “Focus Manipulation Detection via Photometric Histogram Analysis”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.

  10. Shi Jin, Jinwei Ye, Yu Ji, Ruiyang Liu, and Jingyi Yu, “Learning to Dodge a Bullet”, European Conference on Computer Vision (ECCV), Munich, Germany, September 8–14, 2018.

  11. Ziheng Zhang, Yanyu Xu, Jingyi Yu, Shenghua Gao, “Saliency detection in 360 videos”, European Conference on Computer Vision (ECCV), Munich, Germany, September 8–14, 2018.

  12. Anpei Chen, Minye Wu, Yingliang Zhang, Nianyi Li, Jie Lu, Shenghua Gao and Jingyi Yu, “Deep Surface Light Fields”, ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 2018.

  13. Yiangliang Zhang, Peihong Yu, Wei Yang, Yuanxi Ma and Jingyi Yu, “Ray Space Features for Plenoptic Strucutre-from-Motion”, in Proceedings of IEEE International Conference on Computer Vision (ICCV), 2017.

  14. Yujia Xue, Kang Zhu, Qiang Fu, Xilin Chen and Jingyi Yu, “Catadioptric Hyperspectral Light Field Imaging”, in Proceedings of IEEE International Conference on Computer Vision (ICCV), 2017.

  15. Yanyu Xu, Nianyi Li, Junru Wu, Jingyi Yu, Shenghua Gao, “Beyond Universal Saliency: Personalized Saliency Prediction with Multi-task CNN”, in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2017. (Best student paper finalist)

  16. Yingliang Zhang, Haiting Lin, Wei Yang, Peihong Yu, and Jingyi Yu, “The Light Field 3D Scanner”, in Proceedings of IEEE International Conference on Computational Photography (ICCP), 2017.

  17. Can Chen, Scott McCloskey, and Jingyi Yu, “Camera Response Curve Analysis on Modern Cameras”, in Proceedings of IEEE International Conference on Computational Photography (ICCP), 2017.

  18. Can Chen, Scott McCloskey and Jingyi Yu, “Image Splicing Detection via Blurred Content Analysis”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.

  19. Nianyi Li, Haiting Lin, Bilin Sun, Mingyuan Zhou, and Jingyi Yu, “Rotational Crossed-Slit Light Field”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. (AR: 29%)

  20. Haiting Lin, Can Chen, Sing Bing Kang, and Jingyi Yu, “Depth Recovery from Light Field Using Focal Stack Symmetry”, in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2015. (AR: 31%)

  21. Wei Yang, Yu Ji, Sing Bing Kang, and Jingyi Yu, “Ambient Occlusion via Compressive Visibility Estimation”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. (AR: 29%)

  22. Nianyi Li, Bilin Sun, and Jingyi Yu, “A Weighted Sparse Coding Framework for Saliency Detection”, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015. (AR: 29%)