| Citation: | WANG Jian-min, ZHAO Hao-bing, WANG Ke, SONG Xiao-sheng, SUN You-wen, HU Xiao-min, LIU Bi-heng, LI Da-chuang. Attitude compensation and reconstruction methods for single-photon dynamic imaging during UAV flight[J]. Chinese Optics. doi: 10.37188/CO.2026-0004 |
To mitigate shot noise and background interference in single-photon depth imaging, alongside single-axis image deviation induced by UAV attitude fluctuations during flight, this paper proposes a robust depth reconstruction method. Building upon the SPIRAL-TAP framework, the proposed approach integrates multi-scale image features with an adaptive thresholding strategy. Firstly, an image weighting matrix is constructed via multi-scale gradients and local variance to effectively characterize texture complexity. Subsequently, a dynamic threshold adjustment mechanism, guided by Rough Order Map (ROM) estimation, is implemented to enhance noise robustness. In the screening phase, an adaptive strategy merges scale-space smoothing with weighting matrix soft-tuning to stabilize the filtering process. Experimental results demonstrate that the proposed method significantly outperforms the conventional SPIRAL-TAP algorithm under varying signal-to-background ratios (SBR) and photon intensities. Specifically, at tilt angles of 10° and 15°, the RMSE is reduced from 0.32 to 0.14 and from 0.43 to 0.21, respectively. This method provides an effective solution for UAV-borne single-photon depth reconstruction and exhibits significant potential for high-speed airborne imaging systems.
| [1] |
HENDERSON R K, JOHNSTON N, ROCCA F M D, et al. A 192×128 time correlated SPAD image sensor in 40-nm CMOS technology[J]. IEEE Journal of Solid-State Circuits, 2019, 54(7): 1907-1916. doi: 10.1109/JSSC.2019.2905163
|
| [2] |
SHIN D, KIRMANI A, GOYAL V K, et al. Photon-efficient computational 3-D and reflectivity imaging with single-photon detectors[J]. IEEE Transactions on Computational Imaging, 2015, 1(2): 112-125. doi: 10.1109/TCI.2015.2453093
|
| [3] |
TANNER M G, GALLAND C, ZBINDEN H, et al. Single-photon imaging and its application in biological microscopy[J]. Proceedings of SPIE, 2015, 9504: 95040A. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [4] |
RECH I, GULINATTI A, GHIONI M. Optical imaging using single-photon detectors: from physics to biomedical applications[J]. Journal of Optics, 2021, 23(10): 103501. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [5] |
MAIRE M, HENDERSON R K, CHARBON E. SPAD imagers for space applications: trends and perspectives[J]. Sensors, 2020, 20(6): 1451. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [6] |
HARMANY Z T, MARCIA R F, WILLETT R M. This is SPIRAL-TAP: Sparse Poisson intensity reconstruction ALgorithms—theory and practice[J]. IEEE Transactions on Image Processing, 2012, 21(3): 1084-1096. doi: 10.1109/TIP.2011.2168410
|
| [7] |
ALTMANN Y, MCCARTHY A, BULLER G S, et al. Bayesian approach to denoising of single-photon binary images[J]. IEEE Transactions on Image Processing, 2016, 25(5): 1935-1946. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [8] |
CHAN S H, ZICKLER T, LU Y M. Monte Carlo non-local means: Random sampling for large-scale image filtering[J]. IEEE Transactions on Image Processing, 2014, 23(8): 3711-3725. doi: 10.1109/TIP.2014.2327813
|
| [9] |
KIRMANI A, VENKATRAMAN D, SHIN D, et al. First-photon imaging[J]. Science, 2013, 343(6166): 58-61. doi: 10.1364/cosi.2015.ct3f.1
|
| [10] |
朱思宇, 朱磊, 王文武, 等. 基于融合特征分布学习与图像重建的异常检测[J]. 液晶与显示, 2024, 39(8): 1116-1127.
ZHU S Y, ZHU L, WANG W W, et al. Abnormity detection based on fusion feature distribution learning and image reconstruction[J]. Chinese Journal of Liquid Crystals and Displays, 2024, 39(8): 1116-1127.
|
| [11] |
RAPP J, GOYAL V K. A few photons among many: Unmixing signal and noise for photon-efficient active imaging[J]. IEEE Transactions on Computational Imaging, 2017, 3(3): 445-459. doi: 10.1109/TCI.2017.2706028
|
| [12] |
HEIDE F, DIAMOND S, LINDELL D B, et al. Sub-picosecond photon-efficient 3D imaging using single-photon sensors[J]. Scientific Reports, 2018, 8(1): 17726. doi: 10.1038/s41598-018-35212-x
|
| [13] |
REN W, DAI W, LIU Z, et al. Robust image deblurring with structures-preserving via adaptive total variation[J]. Signal Processing, 2016, 122: 63-76. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [14] |
张永兴, 连博文, 顾乃庭, 等. 基于多尺度空间注意力互补的红外与可见光图像融合[J]. 光学 精密工程, 2025, 33(7): 1152-1168.
ZHANG Y X, LIAN B W, GU N T, et al. Infrared and visible image fusion based on multi-scale spatial attention complementary[J]. Optics and Precision Engineering, 2025, 33(7): 1152-1168.
|
| [15] |
TSAI C, KIRMANI A, SHIN D, et al. Beyond 3D imaging: Reflectance, illumination, and geometry from depth cameras[J]. International Journal of Computer Vision, 2017, 125(1-3): 1-16. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [16] |
ZHU X, SONG C, DU J, et al. Single-photon 3D imaging using statistical filtering and depth histogram shaping[J]. Optics Express, 2020, 28(6): 8843-8857. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [17] |
XUE T, XU D, CHEN S, et al. Single-photon imaging via spatiotemporal correlation filtering[J]. Optics Letters, 2021, 46(4): 770-773. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [18] |
赵云涛, 邓新辉. 基于多模态数据的注意特征融合姿态估计网络[J]. 液晶与显示, 2025, 40(4): 598-606.
ZHAO Y T, DENG X H. Pose estimation network based on attention feature fusion of multimodal data[J]. Chinese Journal of Liquid Crystals and Displays, 2025, 40(4): 598-606.
|
| [19] |
LINDELL D B, WETZSTEIN G. Single-photon 3D imaging with deep sensor fusion[J]. IEEE Transactions on Computational Imaging, 2021, 7: 677-689. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [20] |
ZHAO Y, LI J, GAO F, et al. Adaptive photon thresholding and fusion for robust single-photon imaging[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 1-9. (查阅网上资料, 未找到本条文献信息, 请确认).
|
| [21] |
MAIRE M, HENDERSON R K, CHARBON E. SPAD imagers for space applications: Trends and perspectives[J]. Sensors, 2020, 20(6): 1451. (查阅网上资料, 未找到本条文献信息, 请确认)(查阅网上资料, 本条文献与第5条文献重复, 请核对).
|
| [22] |
PAWLIKOWSKA A M, HALIMI A, LAMB R A, et al. Single-photon three-dimensional imaging at up to 10 kilometers range[J]. Optics Express, 2017, 25(10): 11919-11931. doi: 10.1364/OE.25.011919
|
| [23] |
BULLER G, WALLACE A. Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition[J]. IEEE Journal of Selected Topics in Quantum Electronics, 2007, 13(4): 1006-1015. doi: 10.1109/JSTQE.2007.902850
|
| [24] |
BECKER W. Advanced Time-correlated Single Photon Counting Techniques[M]. New York: Springer, 2005.
|