김종현 학생 Depth Super-resolution 연구, IEEE Access 논문 게재
2020.09.07 19:40
강문기 교수 연구팀이 “Multi-Frame Depth Super-Resolution for ToF Sensor with Total Variation Regularized L1 Function” 논문을 IEEE Access (Impact factor: 3.745, Rank: Q1) 에 게재하였다.
본 연구는 연세대학교 전기전자공학과 통합과정 김종현 학생(제1저자), 한재덕 학생(제2저자), 강문기 교수(교신저자)가 진행하였다.
Abstract :
In this paper, we propose a multi-frame depth super-resolution (SR) method based on L1 data fidelity with the total variation regularization (TV-L1) model. The majority of time-of-flight (ToF) sensors exhibit limited spatial resolution compared to RGB sensors and the improvement of the depth image resolution is an inherently ill-posed problem. To overcome this under-determined problem, the solution space is limited by the regularization term through prior knowledge and the data fidelity term using statistical information of the noise. Firstly, the statistical characteristics of ToF depth images are analyzed to specify the appropriate observation model. Thereafter, the objective function for multi-frame depth SR based on the TV-L1 model is designed by considering the prior knowledge of the depth images. This approach enables the sharpness of the edges to be preserved and the noise amplification to be suppressed simultaneously. Furthermore, an efficient solver based on half-quadratic splitting is proposed. The algorithm minimizes the objective function for the multi-frame SR problem consisting of the TV regularization term and L1 data fidelity term. The proposed method is verified on a synthetic dataset and real-world data acquired from a ToF sensor. The experimental results demonstrate that the proposed method can substantially reconstruct high-resolution depth images in terms of preserving sharp depth discontinuities, without any obvious artifacts, and can increase robustness to noise.
https://doi.org/10.1109/ACCESS.2020.3022910
