应用于眼底成像的可见光瞳孔定位与对准方法

邢利娜; 孔文; 唐宁; 陈一巍; 史国华; 何益

doi:10.37188/CO.2024-0065

应用于眼底成像的可见光瞳孔定位与对准方法

doi: 10.37188/CO.2024-0065

邢利娜^{1, 2,},
孔文^1,,
唐宁^1,,
陈一巍^2,,
史国华^2,,
何益^2, ,

1.
中国科学技术大学生物医学工程学院(苏州), 江苏苏州 215163
2.
中国科学院苏州生物医学工程技术研究所江苏省医用光学重点实验室, 江苏苏州 215163

基金项目: 国家重点研发计划（No. 2021YFC2401401）；国家自然科学基金项目（No. 62075235）；中国科学院青年创新促进会（No. 2019320）；中国科学院战略性先导科技专项（No. XDA16021304）

详细信息

作者简介:
邢利娜（1985—），女，河南洛阳人，在读博士研究生，副研究员，主要从事光学成像、高分辨率眼科成像与检测等方面的研究。E-mail：xingln@sibet.ac.cn

孔　文（1992—），男，山东枣庄人，在读博士生，主要从事光学眼科成像方面的研究。E-mail：kongw.stu@sibet.ac.cn

唐　宁（1995—），男，黑龙江哈尔滨人，博士，主要从事OCT图像处理方面的研究。E-mail：tang_ning95@mail.ustc.edu.cn

陈一巍(1987—)，男，福建厦门人，博士，副研究员，主要从事光学图像处理方面的研究。E-mail: yiwei.chen@sibet.ac.cn

史国华（1981—），男，博士，研究员，博士生导师，主要从事高分辨率眼科成像与检测、在体光学超分辨成像、活体视觉神经网络等方面的研究。E-mail: shigh@sibet.ac.cn

何　益（1984—），男，四川营山人，博士，研究员，博士生导师，主要从事波前处理、眼科光学、生物光子学、基于智能计算的精准医疗等方面的研究。E-mail：heyi@sibet.ac.cn

中图分类号: TP23;TH786
计量
- 文章访问数: 62
- HTML全文浏览量: 28
- PDF下载量: 3
- 被引次数: 0
出版历程
- 收稿日期: 2024-04-02
- 录用日期: 2024-05-09
- 网络出版日期: 2024-05-22

Visible light pupil localization and alignment method for fundus imaging

XING Li-na^{1, 2
,},
KONG Wen^1
,,
TANG Ning^1
,,
CHEN Yi-wei^2
,,
SHI Guo-hua^2
,,
HE Yi^{2
, ,}

1.
School of Biomedical Engineering (Suzhou), University of Science and Technology of China, Suzhou, Jiangsu, 215163, China
2.
Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, Jiangsu, 215163, China

Funds: Supported by National Key Research and Development Program of China (No.2021YFC2401401); National Natural Science Foundation of China (No. 62075235); Youth Innovation Promotion Association, CAS (No.2019320); Strategic Priority Research Program of the Chinese Academy of Sciences (No. XDA16021304)

More Information

Corresponding author: heyi@sibet.ac.cn

摘要

摘要:
目的：为了降低眼底成像过程中对操作人员的依赖，采用可见光瞳孔成像，提出了一种人眼瞳孔自动快速定位与对准的方法。方法：首先采用可见光摄像模组和三维电动位移台，在实验室眼底成像系统上搭建瞳孔对准装置。其次，用霍夫梯度法提取图像的有效区域，得到眼底成像系统的中心；利用最大类间方差法和图像直方图特征得到了瞳孔区域；通过最小圆拟合方法，确定瞳孔的中心。最后，反馈控制电动位移台的移动，实现眼底成像系统中心与瞳孔中心对准。结果：实验结果表明：人眼瞳孔的平均识别速度0.11s，瞳孔中心的识别平均准确率达98.7%，中心偏差的欧氏距离平均为4.3个像素。结论：满足眼底成像系统的实时性和准确性的要求，为眼底成像系统提供了一种高效的自动瞳孔对准解决方案。
- 眼底成像 /
- 瞳孔定位 /
- 自动对准 /
- 可见光
Abstract:
Objetive
To mitigate reliance on operators during fundus imaging, an automated rapid localization and alignment method for the human pupil was proposed for visible light pupil imaging.
Method
Initially, the pupil alignment device was constructed on the laboratory fundus imaging system using a visible light camera module and a three-axis motorized displacement stage.Subsequently, the effective area of the image was extracted using the Hough gradient method to determine the center of the fundus imaging system. The pupil region was identified through the maximum inter-class variance method and image histogram feature, while the center of the pupil was ascertained via the minimum circle fitting method. Ultimately, the electric displacement stage's movement is regulated through feedback mechanisms, ensuring that the center of the fundus imaging system aligns precisely with the pupil's center.
Result
The experimental results show that the average recognition speed of human pupil is 0.11s, the average recognition accuracy of the pupil center is 98.7%, and the average Euclidean distance of the center deviation is 4.3 pixels.
Conclusion
It can satisfy the system requirements of the real-time and accuracy, and provides an efficient automatic pupil alignment solution for fundus imaging system.
- fundus imaging /
- pupil localization /
- automatic alignment /
- visible light

HTML全文

图 1 瞳孔对准装置

Figure 1. The pupil alignment device

下载: 全尺寸图片幻灯片

图 2 瞳孔对准流程图

Figure 2. Flow chart of pupil alignment

下载: 全尺寸图片幻灯片

图 3 Sobel算子矩阵

Figure 3. The Sobel operator matrix

下载: 全尺寸图片幻灯片

图 4 成像系统中心定位的流程图

Figure 4. Flow chart of localization imaging system center

下载: 全尺寸图片幻灯片

图 5 成像系统中心、原始图像及有效区域

Figure 5. The imaging system center, the original image, and the effective region

下载: 全尺寸图片幻灯片

图 6 有效区域和核心区域图像的直方图

Figure 6. The histograms of the effective area and the core region

下载: 全尺寸图片幻灯片

图 7 瞳孔中心定位的流程图

Figure 7. Flow chart of localization pupil center

下载: 全尺寸图片幻灯片

图 8 形态学运算和瞳孔中心的图像

Figure 8. Images of morphological operations and pupil center

下载: 全尺寸图片幻灯片

图 9 采用最大类间方差法的图像 a）成像系统中心 b）核心区域 c）二值化 d）形态学 e）瞳孔中心

Figure 9. Images using maximum inter-class variance method a）imaging system center b）core region c）binarization d）morphological e）pupil center

下载: 全尺寸图片幻灯片

图 10 采用直方图谷值识别瞳孔中心a）成像系统中心 b）核心区域 c）两次最大类间方差法 d）二值化 e）形态学 f）瞳孔中心

Figure 10. Pupil center determination using maximum inter-class variance method a）imaging system center b）core region c）using twice maximum between-cluster variance method d）binarization e）morphological e）pupil center

下载: 全尺寸图片幻灯片

图 11 成像系统中心和瞳孔中心的定位

Figure 11. localization of imaging system center and pupil center

下载: 全尺寸图片幻灯片

图 12 与手工标记的瞳孔中心偏差的欧氏距离

Figure 12. Euclidean distance of deviation from manually marked pupil center

下载: 全尺寸图片幻灯片

图 13 原始图像及瞳孔对准后的图像 a）原始图像 b）原始图像的瞳孔定位 c）对准后的原始图像 d）对准后图像的瞳孔定位

Figure 13. The original image and the pupil-aligned image a ) the original image b ) the pupil localization of the original image c ) the aligned original image d ) the pupil localization of the aligned image

下载: 全尺寸图片幻灯片

参考文献(19)

[1]	汪路涵, 巩岩, 张艳微, 等. 人眼自动对焦及瞳孔中心自动对准系统[J]. 光学学报,2023,43(5):0511002. doi: 10.3788/AOS221703 WANG L H, GONG Y, ZHANG Y W, et al. Human eye autofocus and pupil center auto-alignment system[J]. Acta Optica Sinica, 2023, 43(5): 0511002. (in Chinese). doi: 10.3788/AOS221703
[2]	王鹏, 温宏韬, 王世龙. 基于近眼红外图像的高精度瞳孔中心定位方法[J]. 哈尔滨理工大学学报,2022,27(5):38-46. WANG P, WEN H T, WANG SH L. High-precision pupil center positioning method based on near-eye infrared image[J]. Journal of Harbin University of Science and Technology, 2022, 27(5): 38-46. (in Chinese).
[3]	蔡怀宇, 史玉, 娄世良, 等. 应用于红外眼科疾病检测的瞳孔定位算法[J]. 中国光学,2021,14(3):605-614. doi: 10.37188/CO.2020-0170 CAI H Y, SHI Y, LOU SH L, et al. Pupil location algorithm applied to infrared ophthalmic disease detection[J]. Chinese Optics, 2021, 14(3): 605-614. (in Chinese). doi: 10.37188/CO.2020-0170
[4]	王晶, 高峰, 李婉越, 等. 瞳孔中心点自动定位与对准装置[J]. 光学精密工程,2019,27(6):1370-1377. doi: 10.3788/OPE.20192706.1370 WANG J, GAO F, LI W Y, et al. Device for automatic pupil center location and alignment[J]. Optics and Precision Engineering, 2019, 27(6): 1370-1377. (in Chinese). doi: 10.3788/OPE.20192706.1370
[5]	CHEN G ZH, DONG ZH H, WANG J, et al. Pupil localization algorithm based on improved U-Net network[J]. Electronics, 2023, 12(12): 2591. doi: 10.3390/electronics12122591
[6]	XUE P X, WANG CH Y, HUANG W B, et al. Pupil Centre's localization with transformer without real pupil[J]. Multimedia Tools and Applications, 2023, 82(16): 25467-25484. doi: 10.1007/s11042-023-14403-3
[7]	王鉴, 张荣福. 基于可变形卷积的单帧图像眼球定位追踪[J]. 光学仪器,2021,43(6):26-31. WANG J, ZHANG F R. Single-frame image eyeball tracking based on deformable convolution[J]. Optical Instruments, 2021, 43(6): 26-31. (in Chinese).
[8]	张贺童, 姚康, 裴融浩, 等. 基于ADEU-Net分割网络的瞳孔精确分割方法[J]. 计算机工程与应用,2023,59(2):212-221. ZHANG H T, YAO K, PEI R H, et al. Accurate pupil segmentation based on ADEU-Net segmentation network[J]. Computer Engineering and Applications, 2023, 59(2): 212-221. (in Chinese).
[9]	张宏薇, 王仕洋, 李宪龙, 等. 基于Hough变换的瞳孔识别方法研究与实现[J]. 液晶与显示,2016,31(6):621-625. doi: 10.3788/YJYXS20163106.0621 ZHANG H W, WANG SH Y, LI X L, et al. Research and implementation of pupil recognition based on Hough transform[J]. Chinese Journal of Liquid Crystals and Displays, 2016, 31(6): 621-625. (in Chinese). doi: 10.3788/YJYXS20163106.0621
[10]	ABDULLAH M A M, DLAY S S, WOO W L. Fast and accurate pupil isolation based on morphology and active contour[J]. International Journal of Information and Electronics Engineering, 2014, 4(6): 418-422.
[11]	JAN F, USMAN I, AGHA S. Iris localization in frontal eye images for less constrained iris recognition systems[J]. Digital Signal Processing, 2012, 22(6): 971-986. doi: 10.1016/j.dsp.2012.06.001
[12]	陈静瑜, 林丽媛, 刘冠军, 等. 一种基于几何形状特征的实时瞳孔定位追踪技术[J]. 天津科技大学学报,2021,36(3):65-71. CHEN J Y, LIN L Y, LIU G J, et al. A real-time pupil positioning and tracking technology based on geometric shape features[J]. Journal of Tianjin University of Science & Technology, 2021, 36(3): 65-71. (in Chinese).
[13]	WAN ZH H, XIONG C H, CHEN W B, et al. Robust and accurate pupil detection for head-mounted eye tracking[J]. Computers & Electrical Engineering, 2021, 93: 107193.
[14]	童言, 穆平安, 林玉莹. 基于圆形滑动窗口的瞳孔定位算法[J]. 电子测量技术,2021,44(2):99-103. TONG Y, MU P A, LIN Y Y. Pupil location algorithm based on circular sliding window[J]. Electronic Measurement Technology, 2021, 44(2): 99-103. (in Chinese).
[15]	MIN-ALLAH N, JAN F, ALRASHED S. Pupil detection schemes in human eye: a review[J]. Multimedia Systems, 2021, 27(4): 753-777. doi: 10.1007/s00530-021-00806-5
[16]	JAN F, USMAN I, AGHA S. Reliable iris localization using Hough transform, histogram-bisection, and eccentricity[J]. Signal Processing, 2013, 93(1): 230-241. doi: 10.1016/j.sigpro.2012.07.033
[17]	KHAN T M, KHAN M A, MALIK S A, et al. Automatic localization of pupil using eccentricity and iris using gradient based method[J]. Optics and Lasers in Engineering, 2011, 49(2): 177-187. doi: 10.1016/j.optlaseng.2010.08.020
[18]	LIN ZH H, YU H F. The pupil location based on the OTSU method and Hough transform[J]. Procedia Environmental Sciences, 2011, 8: 352-356. doi: 10.1016/j.proenv.2011.10.055
[19]	ZHOU W J, LU X Y, WANG Y. A robust pupil localization via a novel parameter optimization strategy[J]. Wireless Communications and Mobile Computing, 2022, 2022: 2378911.