Turn off MathJax
Article Contents
WANG Jian-min, ZHAO Hao-bing, WANG Ke, SONG Xiao-sheng, SUN You-wen, HU Xiao-min, LIU Bi-heng, LI Da-chuang. Attitude compensation and reconstruction methods for single-photon dynamic imaging during UAV flight[J]. Chinese Optics. doi: 10.37188/CO.2026-0004
Citation: WANG Jian-min, ZHAO Hao-bing, WANG Ke, SONG Xiao-sheng, SUN You-wen, HU Xiao-min, LIU Bi-heng, LI Da-chuang. Attitude compensation and reconstruction methods for single-photon dynamic imaging during UAV flight[J]. Chinese Optics. doi: 10.37188/CO.2026-0004

Attitude compensation and reconstruction methods for single-photon dynamic imaging during UAV flight

cstr: 32171.14.CO.2026-0004
Funds:  Aeronautical Science Fund (No. 2024Z075078003); Anhui Provincial Key Research and Development Project (No. 2022b13020002); Anhui Provincial Major Natural Science Research Project of Higher Education Institutions (No. 2022AH040289); Anhui Provincial Academic and Technical Leaders and Reserve Personnel Research Activity Funding Project (No. 2019H208); National Natural Science Foundation of China (Grant No. 62322513)
More Information
  • To mitigate shot noise and background interference in single-photon depth imaging, alongside single-axis image deviation induced by UAV attitude fluctuations during flight, this paper proposes a robust depth reconstruction method. Building upon the SPIRAL-TAP framework, the proposed approach integrates multi-scale image features with an adaptive thresholding strategy. Firstly, an image weighting matrix is constructed via multi-scale gradients and local variance to effectively characterize texture complexity. Subsequently, a dynamic threshold adjustment mechanism, guided by Rough Order Map (ROM) estimation, is implemented to enhance noise robustness. In the screening phase, an adaptive strategy merges scale-space smoothing with weighting matrix soft-tuning to stabilize the filtering process. Experimental results demonstrate that the proposed method significantly outperforms the conventional SPIRAL-TAP algorithm under varying signal-to-background ratios (SBR) and photon intensities. Specifically, at tilt angles of 10° and 15°, the RMSE is reduced from 0.32 to 0.14 and from 0.43 to 0.21, respectively. This method provides an effective solution for UAV-borne single-photon depth reconstruction and exhibits significant potential for high-speed airborne imaging systems.

     

  • loading
  • [1]
    HENDERSON R K, JOHNSTON N, ROCCA F M D, et al. A 192×128 time correlated SPAD image sensor in 40-nm CMOS technology[J]. IEEE Journal of Solid-State Circuits, 2019, 54(7): 1907-1916. doi: 10.1109/JSSC.2019.2905163
    [2]
    SHIN D, KIRMANI A, GOYAL V K, et al. Photon-efficient computational 3-D and reflectivity imaging with single-photon detectors[J]. IEEE Transactions on Computational Imaging, 2015, 1(2): 112-125. doi: 10.1109/TCI.2015.2453093
    [3]
    TANNER M G, GALLAND C, ZBINDEN H, et al. Single-photon imaging and its application in biological microscopy[J]. Proceedings of SPIE, 2015, 9504: 95040A. (查阅网上资料, 未找到本条文献信息, 请确认).
    [4]
    RECH I, GULINATTI A, GHIONI M. Optical imaging using single-photon detectors: from physics to biomedical applications[J]. Journal of Optics, 2021, 23(10): 103501. (查阅网上资料, 未找到本条文献信息, 请确认).
    [5]
    MAIRE M, HENDERSON R K, CHARBON E. SPAD imagers for space applications: trends and perspectives[J]. Sensors, 2020, 20(6): 1451. (查阅网上资料, 未找到本条文献信息, 请确认).
    [6]
    HARMANY Z T, MARCIA R F, WILLETT R M. This is SPIRAL-TAP: Sparse Poisson intensity reconstruction ALgorithms—theory and practice[J]. IEEE Transactions on Image Processing, 2012, 21(3): 1084-1096. doi: 10.1109/TIP.2011.2168410
    [7]
    ALTMANN Y, MCCARTHY A, BULLER G S, et al. Bayesian approach to denoising of single-photon binary images[J]. IEEE Transactions on Image Processing, 2016, 25(5): 1935-1946. (查阅网上资料, 未找到本条文献信息, 请确认).
    [8]
    CHAN S H, ZICKLER T, LU Y M. Monte Carlo non-local means: Random sampling for large-scale image filtering[J]. IEEE Transactions on Image Processing, 2014, 23(8): 3711-3725. doi: 10.1109/TIP.2014.2327813
    [9]
    KIRMANI A, VENKATRAMAN D, SHIN D, et al. First-photon imaging[J]. Science, 2013, 343(6166): 58-61. doi: 10.1364/cosi.2015.ct3f.1
    [10]
    朱思宇, 朱磊, 王文武, 等. 基于融合特征分布学习与图像重建的异常检测[J]. 液晶与显示, 2024, 39(8): 1116-1127.

    ZHU S Y, ZHU L, WANG W W, et al. Abnormity detection based on fusion feature distribution learning and image reconstruction[J]. Chinese Journal of Liquid Crystals and Displays, 2024, 39(8): 1116-1127.
    [11]
    RAPP J, GOYAL V K. A few photons among many: Unmixing signal and noise for photon-efficient active imaging[J]. IEEE Transactions on Computational Imaging, 2017, 3(3): 445-459. doi: 10.1109/TCI.2017.2706028
    [12]
    HEIDE F, DIAMOND S, LINDELL D B, et al. Sub-picosecond photon-efficient 3D imaging using single-photon sensors[J]. Scientific Reports, 2018, 8(1): 17726. doi: 10.1038/s41598-018-35212-x
    [13]
    REN W, DAI W, LIU Z, et al. Robust image deblurring with structures-preserving via adaptive total variation[J]. Signal Processing, 2016, 122: 63-76. (查阅网上资料, 未找到本条文献信息, 请确认).
    [14]
    张永兴, 连博文, 顾乃庭, 等. 基于多尺度空间注意力互补的红外与可见光图像融合[J]. 光学 精密工程, 2025, 33(7): 1152-1168.

    ZHANG Y X, LIAN B W, GU N T, et al. Infrared and visible image fusion based on multi-scale spatial attention complementary[J]. Optics and Precision Engineering, 2025, 33(7): 1152-1168.
    [15]
    TSAI C, KIRMANI A, SHIN D, et al. Beyond 3D imaging: Reflectance, illumination, and geometry from depth cameras[J]. International Journal of Computer Vision, 2017, 125(1-3): 1-16. (查阅网上资料, 未找到本条文献信息, 请确认).
    [16]
    ZHU X, SONG C, DU J, et al. Single-photon 3D imaging using statistical filtering and depth histogram shaping[J]. Optics Express, 2020, 28(6): 8843-8857. (查阅网上资料, 未找到本条文献信息, 请确认).
    [17]
    XUE T, XU D, CHEN S, et al. Single-photon imaging via spatiotemporal correlation filtering[J]. Optics Letters, 2021, 46(4): 770-773. (查阅网上资料, 未找到本条文献信息, 请确认).
    [18]
    赵云涛, 邓新辉. 基于多模态数据的注意特征融合姿态估计网络[J]. 液晶与显示, 2025, 40(4): 598-606.

    ZHAO Y T, DENG X H. Pose estimation network based on attention feature fusion of multimodal data[J]. Chinese Journal of Liquid Crystals and Displays, 2025, 40(4): 598-606.
    [19]
    LINDELL D B, WETZSTEIN G. Single-photon 3D imaging with deep sensor fusion[J]. IEEE Transactions on Computational Imaging, 2021, 7: 677-689. (查阅网上资料, 未找到本条文献信息, 请确认).
    [20]
    ZHAO Y, LI J, GAO F, et al. Adaptive photon thresholding and fusion for robust single-photon imaging[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 1-9. (查阅网上资料, 未找到本条文献信息, 请确认).
    [21]
    MAIRE M, HENDERSON R K, CHARBON E. SPAD imagers for space applications: Trends and perspectives[J]. Sensors, 2020, 20(6): 1451. (查阅网上资料, 未找到本条文献信息, 请确认)(查阅网上资料, 本条文献与第5条文献重复, 请核对).
    [22]
    PAWLIKOWSKA A M, HALIMI A, LAMB R A, et al. Single-photon three-dimensional imaging at up to 10 kilometers range[J]. Optics Express, 2017, 25(10): 11919-11931. doi: 10.1364/OE.25.011919
    [23]
    BULLER G, WALLACE A. Ranging and three-dimensional imaging using time-correlated single-photon counting and point-by-point acquisition[J]. IEEE Journal of Selected Topics in Quantum Electronics, 2007, 13(4): 1006-1015. doi: 10.1109/JSTQE.2007.902850
    [24]
    BECKER W. Advanced Time-correlated Single Photon Counting Techniques[M]. New York: Springer, 2005.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(12)  / Tables(3)

    Article views(14) PDF downloads(0) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return