Design and three-dimensional reconstruction of a cage-type light field camera based on a dual-lens relay structure
-
摘要:
目的 笼式光场相机具有光学组件可更换、系统参数可调节等特点，已逐渐应用于流体三维速度场测量、燃烧诊断等领域。由于笼式光场成像系统引入了中继镜，光场图像边缘区域容易出现渐晕现象，进而影响微透镜阵列下子图像形状和光场图像成像质量，并缩小有效光场成像区域。因此，为了改善笼式光场相机的渐晕效应，分析中继镜参数对笼式光场相机成像质量影响至关重要。
方法 本文提出了一种基于大通光孔径双镜头中继结构的笼式光场相机设计思路，并优化了微透镜阵列位置调试方法。在此基础上，选取F1.8 50 mm和F1.4 85 mm两种参数的双镜头中继镜开展对比实验，研究不同中继镜参数对光场图像渐晕效应的影响，并对渐晕区域位置、子图像形状以及有效光场成像区域尺寸进行分析。
结果 实验结果表明，与F1.8 50 mm中继镜相比，采用F1.4 85 mm中继镜时，光场图像边缘区域子图像形变更小，渐晕范围更小，有效光场成像区域更大，综合成像质量更优。因此，本文采用两枚F1.4 85 mm镜头构成双镜头中继结构，构建了大通光孔径笼式光场相机，并利用该系统实现静态目标场景的多视角图像提取、深度图恢复与三维点云重建，同时以Lytro商用光场相机的重建结果作为参考。
结论 结果表明，本文构建的笼式光场相机可以有效获取目标场景的视差信息，并成功恢复出目标的三维空间结构，验证了该系统面向静态目标开展深度恢复与三维重建的可行性。
Abstract:ObjectiveCage-type light field cameras feature replaceable optical components and adjustable system parameters, and have been increasingly applied to three-dimensional (3D) fluid velocity measurement, combustion diagnostics, and other fields. However, the introduction of a relay lens in a cage-type light field imaging system may cause vignetting at the edges of light field images, thereby distorting the sub-images formed by the microlens array, degrading image quality, and reducing the effective imaging area of the system. Therefore, to mitigate the vignetting effect in cage-type light field cameras, it is crucial to analyze the influence of relay lens parameters on the imaging quality of cage-type light field cameras.
MethodsThis paper proposes a design concept for a cage-type light field camera based on a dual-lens relay structure with a large-aperture lens, and optimizes the method for adjusting the position of the microlens array. Based on this design, comparative experiments were conducted using two dual-lens relay systems, respectively equipped with F1.8 50 mm and F1.4 85 mm lenses, to investigate the effects of different relay lens parameters on vignetting in light field images. The vignetting region, sub-image shape, and effective light field imaging area were analyzed.
Results: The experimental results show that, compared with the F1.8 50 mm relay system, the F1.4 85 mm relay system produces less distortion of the peripheral sub-images, a smaller vignetting region, and a larger effective imaging area, resulting in superior overall imaging quality. Therefore, a dual-lens relay structure composed of two F1.4 85 mm lenses was adopted to construct a large-aperture cage-type light field camera. The system was then used to extract multi-view images, recover depth maps, and reconstruct 3D point clouds of static target scenes, with reconstruction results from a commercial Lytro light field camera serving as a reference.
ConclusionThe results demonstrate that the cage-type light field camera developed in this paper can effectively capture disparity information from target scenes and successfully reconstruct the target’s 3D spatial structure, demonstrating the feasibility of the proposed system for depth recovery and 3D reconstruction of static targets.
-
Key words:
- cage-type light field camera /
- relay lens /
- vignetting /
- depth map /
- 3D point clouds
-
图 1 笼式光场相机的结构及成像原理示意图
Figure 1. Schematic diagram of the structure and imaging principle of a cage-type light field camer
图 2 微透镜阵列下子孔径视图提取原理示意图
Figure 2. Schematic diagram illustrating the principle of sub-aperture view extraction under a microlens array
图 3 水平视差与场景深度的几何关系图
Figure 3. Diagram of the geometric relationship between horizontal parallax and scene depth
图 4 EPI中直线斜率与场景深度的对应关系
Figure 4. The relationship between line slope and scene depth in EPI
图 5 深度图反投影生成三维点云示意图
Figure 5. Schematic diagram of 3D point clouds generation via depth map backprojection
图 6 基于双镜头中继镜笼式光场相机的系统装置
Figure 6. System diagram of a dual-lens relay cage-type light field camera
图 10 光场白图像的部分子图像、子图像的中心和子图像内部的灰度值分布
Figure 10. Subimages of the white image in the light field, the centers of the subimages, and the grayscale value distributions within the subimages
图 12 不同中继镜参数下原始白图像的灰度值分布
Figure 12. Gray-scale value distribution of raw white images under different relay lens parameters
图 13 不同参数中继镜下笼式光场相机的有效光场成像区域
Figure 13. Effective optical field imaging area of a cage-type light field camera under different parameter relay lens
图 14 笼式光场相机和Lytro商用光场相机采集目标场景的原始光场图像
Figure 14. Cage-type light field cameras and Lytro commercial light field cameras capture raw light field images of the target scenes
图 15 笼式光场相机光场图像的多视角图像、深度图及三维点云结果
Figure 15. Multi-view images, depth map, and 3D point clouds results from a cage-type light field camera
图 16 Lytro商用光场相机光场图像的多视角图像、深度图及三维点云结果
Figure 16. Multi-view images, depth map, and 3D point clouds results from Lytro commercial light field camera
图 17 笼式光场相机重建点云离群点的分布及特征分析。(a)离群点的空间分布区域; (b)各离群点区域占全部离群点的比例; (c)不同区域的平均视差代价间隔; (d)不同区域的局部纹理梯度均值
Figure 17. Reconstruction of point cloud outliers and analysis of their characteristics using a cage-type light field camera. (a) The spatial distribution of outliers. (b) Percentage of each outlier region relative to the total number of outliers. (c) Average parallax cost intervals for different regions. (d) Mean of local texture gradients in different regions
表 1 两种光场相机重建结果的统计特征参数
Table 1. Statistical feature parameters of reconstruction results from two types of light field cameras
类别 指标 笼式光场相机 Lytro商用光场相机 深度图 有效视差比例（%） 100.00 100.00 深度图 平均视差梯度 0.008762 0.005763 三维点云 平均邻域距离 1.131703 1.111369 三维点云 离群点比例（%） 4.12 0.46 
下载: 导出CSV
-
[1] 殷永凯, 于锴, 于春展, 等. 几何光场三维成像综述[J]. 中国激光, 2021, 48(12): 1209001. doi: 10.3788/CJL202148.1209001YIN Y K, YU K, YU CH ZH, et al. 3D imaging using geometric light field: a review[J]. Chinese Journal of Lasers, 2021, 48(12): 1209001. (in Chinese). doi: 10.3788/CJL202148.1209001 [2] 张润南, 周宁, 周子豪, 等. 光场表征及其分辨率提升技术: 文献综述及最新进展(特邀)[J]. 红外与激光工程, 2024, 53(9): 202403. doi: 10.3788/IRLA20240347ZHANG R N, ZHOU N, ZHOU Z H, et al. Light field representation and its resolution improvement techniques: an overview (invited)[J]. Infrared and Laser Engineering, 2024, 53(9): 202403. (in Chinese). doi: 10.3788/IRLA20240347 [3] 李明翰, 魏凯, 封晓华. 压缩光场成像: 原理、方法及应用[J]. 上海理工大学学报, 2025, 47(6): 622-639. doi: 10.13255/j.cnki.jusst.20250806001LI M H, WEI K, FENG X H. Compressive light field imaging: principles, methods, and applications[J]. Journal of University of Shanghai for Science and Technology, 2025, 47(6): 622-639. (in Chinese). doi: 10.13255/j.cnki.jusst.20250806001 [4] ZHOU L L, WU G X, ZUO Y B, et al. A comprehensive review of vision-based 3D reconstruction methods[J]. Sensors, 2024, 24(7): 2314. doi: 10.3390/s24072314 [5] GAO Y X, ZHANG H W, CHEN ZH H, et al. Enhanced light field depth estimation through occlusion refinement and feature fusion[J]. Optics and Lasers in Engineering, 2025, 184: 108655. doi: 10.1016/j.optlaseng.2024.108655 [6] GERSHUN A. The light field[J]. Journal of Mathematics and Physics, 1939, 18(1-4): 51-151. doi: 10.1002/sapm193918151 [7] LIPPMANN G. Reversible prints integral photographs[J]. Academy of Sciences, 1908, 3(7): 821-825. (查阅网上资料, 未找到本条文献信息, 请确认). [8] COFFEY D. Apparatus for making a composite stereograph: US, 2063985A[P]. 1936-12-15. [9] ADELSON E H, WANG J Y A. Single lens stereo with a plenoptic camera[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 99-106. doi: 10.1109/34.121783 [10] 田杏, 曹丽霞. 基于前向光线追迹技术的单光场相机空间分辨率研究[J]. 中国光学(中英文), 2026, 19(1): 69-84. doi: 10.37188/CO.2025-0119TIAN X, CAO L X. Research on spatial resolution of a single light field camera based on forward ray tracing technique[J]. Chinese Optics, 2026, 19(1): 69-84. (in Chinese). doi: 10.37188/CO.2025-0119 [11] NG R. Digital Light Field Photography[D]. Stanford: Stanford University, 2006. [12] GEORGIEV T G, LUMSDAINE A. Focused plenoptic camera and rendering[J]. Journal of Electronic Imaging, 2010, 19(2): 021106. doi: 10.1117/1.3442712 [13] HU X M, LI ZH T, MIAO L, et al. Measurement technologies of light field camera: an overview[J]. Sensors, 2023, 23(15): 6812. doi: 10.3390/s23156812 [14] ZHU X Y, XU CH L, HOSSAIN M M, et al. High-resolution three-dimensional flow measurement through dual-frame light field particle tracking velocimetry[J]. Physics of Fluids, 2025, 37(2): 023617. doi: 10.1063/5.0252060 [15] TAN Z P, THUROW B S. Perspective on the development and application of light-field cameras in flow diagnostics[J]. Measurement Science and Technology, 2021, 32(10): 101001. doi: 10.1088/1361-6501/ac026e [16] ZHAO ZH, DING J F, SHI SH X, et al. Volumetric flow characterisation of a rectangular orifice impinging synthetic jet with single-camera light-field PIV[J]. Experimental Thermal and Fluid Science, 2021, 123: 110327. doi: 10.1016/j.expthermflusci.2020.110327 [17] QI Q, HOSSAIN M M, LEI G, et al. Optimum angular arrangement of a multi-light field imaging technique for flame temperature reconstruction[J]. Measurement, 2022, 204: 112110. doi: 10.1016/j.measurement.2022.112110 [18] LIU Y D, ZHU M J, WANG T X, et al. Spatial resolution of light field sectioning pyrometry for flame temperature measurement[J]. Optics and Lasers in Engineering, 2021, 140: 106545. doi: 10.1016/j.optlaseng.2021.106545 [19] ZHAO R X, HUA X W, BAEK W, et al. A review of light-field imaging in biomedical sciences[J]. Med-X, 2025, 3(1): 25. doi: 10.1007/s44258-025-00070-6 [20] LIU F, HOU G Q. Depth estimation from a hierarchical baseline stereo with a developed light field camera[J]. Applied Sciences, 2024, 14(2): 550. doi: 10.3390/app14020550 [21] 朱效宇. 单相机光场成像三维流场测量方法与系统研究[D]. 南京: 东南大学, 2022.ZHU X Y. Study of three-dimensional flow field measurement with a single light field camera[D]. Nanjing: Southeast University, 2022. (in Chinese). [22] BROXTON M, GROSENICK L, YANG S, et al. Wave optics theory and 3-D deconvolution for the light field microscope[J]. Optics Express, 2013, 21(21): 25418-25439. doi: 10.1364/OE.21.025418 [23] SONG X L, GU M T, CAO L X, et al. A microparticle image velocimetry based on light field imaging[J]. IEEE Sensors Journal, 2019, 19(21): 9806-9817. doi: 10.1109/JSEN.2019.2927414 [24] LIU Y D, HOSSAIN M M, SUN J, et al. Design a cage-typed light field camera system for flame measurement[C]. 2017 IEEE Sensors Conference, IEEE, 2017: 1-4. [25] TAN Z P, JOHNSON K, CLIFFORD C, et al. Development of a modular, high-speed plenoptic-camera for 3D flow-measurement[J]. Optics Express, 2019, 27(9): 13400-13415. doi: 10.1364/OE.27.013400 -
下载:
计量
- 文章访问数: 7
- HTML全文浏览量: 2
- PDF下载量: 0
- 被引次数: 0
