| Citation: | WANG Jian-min, ZHAO Hao-bing, WANG Ke, SONG Xiao-sheng, SUN You-wen, HU Xiao-min, LIU Bi-heng, LI Da-chuang. Attitude compensation and reconstruction methods for single-photon dynamic imaging during UAV flight[J]. Chinese Optics, 2026, 19(3): 605-618. doi: 10.37188/CO.2026-0004 |
To mitigate shot noise and background interference in single-photon depth imaging, alongside single-axis image deviation induced by UAV attitude fluctuations during flight, this paper proposes a robust depth reconstruction method. Building upon the SPIRAL-TAP framework, the proposed approach integrates multi-scale image features with an adaptive thresholding strategy. Firstly, an image weighting matrix is constructed via multi-scale gradients and local variance to effectively characterize texture complexity. Subsequently, a dynamic threshold adjustment mechanism, guided by Rough Order Map (ROM) estimation, is implemented to enhance noise robustness. In the screening phase, an adaptive strategy merges scale-space smoothing with weighting matrix soft-tuning to stabilize the filtering process. Experimental results demonstrate that the proposed method significantly outperforms the conventional SPIRAL-TAP algorithm under varying signal-to-background ratios (SBR) and photon intensities. Specifically, at tilt angles of 10° and 15°, the RMSE is reduced from 0.32 to 0.14 and from 0.43 to 0.21, respectively. This method provides an effective solution for UAV-borne single-photon depth reconstruction and exhibits significant potential for high-speed airborne imaging systems.
| [1] |
HENDERSON R K, JOHNSTON N, ROCCA F M D, et al. A 192×128 time correlated SPAD image sensor in 40-nm CMOS technology[J]. IEEE Journal of Solid-State Circuits, 2019, 54(7): 1907-1916. doi: 10.1109/JSSC.2019.2905163
|
| [2] |
SHIN D, KIRMANI A, GOYAL V K, et al. Photon-efficient computational 3-D and reflectivity imaging with single-photon detectors[J]. IEEE Transactions on Computational Imaging, 2015, 1(2): 112-125. doi: 10.1109/TCI.2015.2453093
|
| [3] |
TAYLOR M A, BOWEN W P. Quantum metrology and its application in biology[J]. Physics Reports, 2016, 615: 1-59.
|
| [4] |
BRUSINI P, HOMULLO A, ZAPPALA A, et al. Single-photon avalanche diode imagers in biophotonics: review and outlook[J]. Light: Science & Applications, 2024, 13: 75.
|
| [5] |
PIRON F, MORRISON D, YUCE M R, et al. A review of single-photon avalanche diode time-of-flight imaging sensor arrays[J]. IEEE Sensors Journal, 2021, 21(11): 12654-12666.
|
| [6] |
HARMANY Z T, MARCIA R F, WILLETT R M. This is SPIRAL-TAP: Sparse Poisson intensity reconstruction ALgorithms—theory and practice[J]. IEEE Transactions on Image Processing, 2012, 21(3): 1084-1096. doi: 10.1109/TIP.2011.2168410
|
| [7] |
ALTMANN Y, ASPDEN R, PADGETT M, et al. A Bayesian approach to denoising of single-photon binary images[J]. IEEE Transactions on Computational Imaging, 2017, 3(3): 460-471.
|
| [8] |
CHAN S H, ZICKLER T, LU Y M. Monte Carlo non-local means: Random sampling for large-scale image filtering[J]. IEEE Transactions on Image Processing, 2014, 23(8): 3711-3725. doi: 10.1109/TIP.2014.2327813
|
| [9] |
KIRMANI A, VENKATRAMAN D, SHIN D, et al. First-photon imaging[J]. Science, 2013, 343(6166): 58-61. doi: 10.1364/cosi.2015.ct3f.1
|
| [10] |
朱思宇, 朱磊, 王文武, 等. 基于融合特征分布学习与图像重建的异常检测[J]. 液晶与显示, 2024, 39(8): 1116-1127.
ZHU S Y, ZHU L, WANG W W, et al. Abnormity detection based on fusion feature distribution learning and image reconstruction[J]. Chinese Journal of Liquid Crystals and Displays, 2024, 39(8): 1116-1127.
|
| [11] |
RAPP J, GOYAL V K. A few photons among many: Unmixing signal and noise for photon-efficient active imaging[J]. IEEE Transactions on Computational Imaging, 2017, 3(3): 445-459. doi: 10.1109/TCI.2017.2706028
|
| [12] |
HEIDE F, DIAMOND S, LINDELL D B, et al. Sub-picosecond photon-efficient 3D imaging using single-photon sensors[J]. Scientific Reports, 2018, 8(1): 17726. doi: 10.1038/s41598-018-35212-x
|
| [13] |
RUDIN L I, OSHER S, FATEMI E. Nonlinear total variation based noise removal algorithms[J]. Physica D: Nonlinear Phenomena, 1992, 60(1-4): 259-268.
|
| [14] |
张永兴, 连博文, 顾乃庭, 等. 基于多尺度空间注意力互补的红外与可见光图像融合[J]. 光学 精密工程, 2025, 33(7): 1152-1168.
ZHANG Y X, LIAN B W, GU N T, et al. Infrared and visible image fusion based on multi-scale spatial attention complementary[J]. Optics and Precision Engineering, 2025, 33(7): 1152-1168.
|
| [15] |
SHIN D, XU F, VENKATRAMAN D, et al. Photon-efficient imaging with a single-photon camera[J]. Nature Communications, 2016, 7: 12046.
|
| [16] |
O'TOOLE M, LINDSELL D B, WETZSTEIN G. Confocal non-line-of-sight imaging based on the light-cone transform[J]. Nature, 2018, 555(7696): 338-341.
|
| [17] |
RAPP J, GUTIERREZ-BARRAGAN F, HENDERSON R, et al. Single-photon imaging for ultrafast and high-resolution 3D perception[J]. Nature Communications, 2020, 11: 2747.
|
| [18] |
赵云涛, 邓新辉. 基于多模态数据的注意特征融合姿态估计网络[J]. 液晶与显示, 2025, 40(4): 598-606.
ZHAO Y T, DENG X H. Pose estimation network based on attention feature fusion of multimodal data[J]. Chinese Journal of Liquid Crystals and Displays, 2025, 40(4): 598-606.
|
| [19] |
METZLER C A, LINDELL D B, HEIDE F, et al. Deep-inverse correlography: towards real-time high-resolution non-line-of-sight imaging[J]. Optica, 2020, 7(1): 63-71.
|
| [20] |
KIRMANI A, VENKATRAMAN D, SHIN D, et al. First-photon imaging[J]. Science, 2014, 343(6166): 58-61.
|
| [21] |
LAI T Q, LIANG X L, ZHU Y, et al. Single-pixel 3D imaging based on fusion temporal data of single-photon detector and millimeter-wave radar[J]. Chinese Optics Letters, 2024, 22(2): 022701.
|
| [22] |
PAWLIKOWSKA A M, HALIMI A, LAMB R A, et al. Single-photon three-dimensional imaging at up to 10 kilometers range[J]. Optics Express, 2017, 25(10): 11919-11931. doi: 10.1364/OE.25.011919
|
| [23] |
BULLER G, WALLACE A. Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition[J]. IEEE Journal of Selected Topics in Quantum Electronics, 2007, 13(4): 1006-1015. doi: 10.1109/JSTQE.2007.902850
|
| [24] |
BECKER W. Advanced Time-correlated Single Photon Counting Techniques[M]. New York: Springer, 2005.
|