Depth-based Image Processing for Occlusion and Reflection Removal

Venue

E11-1006 (University of Macau)

Abstract

In 3D computer graphics, the depth map of a scene is a dataset that provides information about the distance of the surfaces of scene objects from a viewpoint. Nowadays, we can effectively estimate the depth map of a scene using different hardware or software techniques. It is particularly the case with the recent high-end mobile devices which are all equipped with multiple cameras. The depth map can be estimated using different triangulation methods based on the multiple images captured by the cameras. Once the depth map is obtained, the next question is what we can do with such additional information of the scene. In this seminar, the use of the depth information in occlusion removal and reflection removal is discussed. It will be shown that the depth information enables some interesting image processing functions that can hardly be achieved in the past. By using modern data-driven methods, these depth-based image processing applications can be accomplished within a couple of seconds when running with a GPU. They will be the next applications of modern mobile devices with GPU support.

Biography

Daniel, P.K. Lun received his B.Sc.(Hons.) degree with 1st Class Honours from the University of Essex, U.K., and PhD degree from the Hong Kong Polytechnic University (formerly called Hong Kong Polytechnic) in 1988 and 1991, respectively. In 1991, he joined the Hong Kong Polytechnic University, and is now an Associate Professor and Associate Head of the Department of Electronic and Information Engineering. Dr Lun is active in research. He has published more than 150 international journals and conference papers in the areas of wavelets theory, signal and image enhancement, computational imaging and deep neural networks. One of his research projects “A study of the Computer Tomography and the Wavelet Transform” was rate as Excellent by the Hong Kong Research Grants Council. He and his research students have also received three best paper awards in international conferences. Dr Lun was the Chairman of the IEEE Hong Kong Chapter of Signal Processing in 1999-00. He was the General Chair of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing (ISIMP 2004), and General Co-Chair of 19th International Conference on Digital Signal Processing (DSP 2014). He was also the Technical Co-Chair of 2015 APSIPA Annual Summit and Conference (APSIPA ASC 2015), and Technical Co-Chair of 2015 IEEE 20th International Conference on Digital Signal Processing (DSP 2015). He was the executive committee members of a number of other conferences including the 2003 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2003), 2010 IEEE International Conference on Image Processing (ICIP 2010) and 2017 IEEE International Conference on Multimedia and Expo (ICME 2017). He received the Certificate of Merit from the IEEE Signal Processing Society for dedication and leadership in organizing the 2010 IEEE International Conference on Image Processing (ICIP). He is a member of the IEEE Circuits and Systems Society VSPC and DSP Technical Committees. He was the Editor of HKIE Transactions published by the Hong Kong Institution of Engineers in the area of Electrical Engineering. He was also the leading guest editor of a special issue of EURASIP journal of Advances in Signal Processing. He is currently an Associate Editor of IEEE Signal Processing Letters and IEEE Open Journal of Circuits and Systems. Dr Lun is a Chartered Engineer, a fellow of IET, a corporate member of HKIE and a senior member of IEEE.