推扫式多光谱遥感相机动态范围拓展方法

孙武; 韩诚山; 吕恒毅; 薛旭成; 胡长虹

doi:10.3788/CO.20191204.0905

推扫式多光谱遥感相机动态范围拓展方法

doi: 10.3788/CO.20191204.0905

cstr: 32171.14.CO.20191204.0905

孙武^{1, 2, ,},
韩诚山^1,,
吕恒毅^{1, 2},
薛旭成¹,
胡长虹¹

1.
中国科学院长春光学精密机械与物理研究所, 吉林长春 130033
2.
中国科学院大学, 北京 100049

基金项目:

吉林省自然科学基金资助项目 20150520059JH

详细信息

作者简介:
孙武(1990-), 男, 山东滕州人, 博士, 2013年于哈尔滨工业大学获得学士学位, 2018年于中国科学院长春光学精密机械与物理研究所获得博士学位, 主要从事航天遥感成像电子学及图像处理的研究。E-mail:sunwuhit@163.com

韩诚山(1972-), 男, 辽宁盖州人, 博士, 研究员, 博士生导师。1993年于吉林工业大学获得学士学位, 1998年、2004年于中国科学院长春光学精密机械与物理研究所分别获得硕士、博士学位, 主要从事空间相机自动控制技术研究。E-mail:xuan_han@yahoo.com.cn

中图分类号: P236;TN386.5
计量
- 文章访问数: 3417
- HTML全文浏览量: 1561
- PDF下载量: 118
- 被引次数: 0
出版历程
- 收稿日期: 2018-12-07
- 修回日期: 2019-01-15
- 刊出日期: 2019-08-01

Dynamic range extending method for push-broom multispectral remote sensing cameras

SUN Wu^{1, 2
, ,},
HAN Cheng-shan^1
,,
LV Heng-yi^{1, 2},
XUE Xu-cheng¹,
HU Chang-hong¹

1.
Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
2.
University of Chinese Academy of Sciences, Beijing 100049, China

Funds:

Natural Science Foundation of Jilin Province 20150520059JH

More Information

Corresponding author: SUN Wu, E-mail:sunwuhit@163.com

摘要

摘要: 为了提高推扫式航天遥感相机的动态范围，对TDI-CCD(Time Delay Integration-Charge Coupled Device)的全色谱段和多光谱谱段积分级数的特殊设置方法、相应图像的插值与融合方法进行研究。首先，介绍了常见的TDI-CCD的像元尺寸和谱段构成等参数，以及现有高分辨率多谱段融合图像的获取方法，分析了常规的积分级数设置规律。接着，提出在提高全色谱段的积分级数，降低多光谱谱段积分级数的情形下，分别获取各个谱段的灰度数据，为提高相机的动态范围提供原始数据。最后，针对性地提出了图像的融合、插值算法，可以得到高动态范围、高分辨率的全色图像。实验和计算结果表明：该方法能够有效提高相机的动态范围，当P谱段积分级数提高2倍，全色谱段降低为原来的1/4时，最终获取的融合图像动态范围可以提高18.06 dB。基本满足应用单排TDI CCD提高推扫式航天遥感相机动态范围的要求。
- TDI CCD /
- 积分级数 /
- 推扫式遥感相机 /
- 动态范围
Abstract: In order to increase the dynamic range of push-broom remote sensing cameras, we investigate the special setup of TDI stages of panchromatic and multispectral bands and study the interpolation method and the image fusion method of according images. Firstly, parameters, including common pixel size and bands of TDI CCD image sensors, and the present methods for obtaining high-resolution fused images are introduced. The traditional strategies for TDI stages' setup are analyzed. Secondly, raw data for high dynamic range(HDR) images are obtained by increasing the value of the panchromatic band's TDI stages and decreasing the value of multispectral band's TDI stages. Finally, the unique fusion and interpolation algorithm is proposed and high-dynamic-range and high-resolution gray images can be obtained. The calculation and experimental results indicate that this method can effectively improve the dynamic range of push-broom cameras. Meanwhile, the dynamic range of final fusion images can be improved by 18.06 dB when the TDI stages of the panchromatic band are multiplied by 2 and the TDI stages of multispectral bands are decreased by 1/4. The method proposed in this paper can successfully extend the dynamic range of push-broom remote sensing cameras.
- TDI-CCD /
- TDI stage /
- push-broom remote sensing cameras /
- dynamic range

HTML全文

图 1 B_x谱段图像与P谱段图像的像元对应关系

Figure 1. Corresponding relationship of pixels betweene B_x band image and P band image

下载: 全尺寸图片幻灯片

图 2 两个积分级数各自对应的P谱段图像

Figure 2. Two images of band P with different values of M_P

下载: 全尺寸图片幻灯片

图 3 按照第二组积分级数设置所得到的8个B谱段图像

Figure 3. Eight images of band B when selecting the second group of TDI stages

下载: 全尺寸图片幻灯片

图 4 Γ_B：由8个B谱段图像融合所得到的灰度图像

Figure 4. Γ_B:gray image fused from the 8 images of band style="class:table_bottom_border"

下载: 全尺寸图片幻灯片

图 5 Γ_BIN：上采样后的Γ_B

Figure 5. Γ_BIN:Γ_B image after upsampled

下载: 全尺寸图片幻灯片

图 6 Γ_HDR：由Γ_BIN和Γ_P融合得到的高动态范围图像

Figure 6. Γ_HDR: the HDR image fused by Γ_BIN and Γ_P

下载: 全尺寸图片幻灯片

图 7 灰度调整后的高动态范围图像

Figure 7. HDR image after a grayscale adjustment

下载: 全尺寸图片幻灯片

表 1 商业高分辨率遥感卫星地面像元分辨率

Table 1. Ground pixel resolution of commercial high-resolution remote sensing satellites(nadir)

卫星	P谱段地面像元分辨率δ_p/m	B谱段地面像元分辨率δ_b/m	δ_b/δ_p
IKONOS	1	4	4
SPOT5	5	10	2
QUICKBIRD	0.61	2.44	4
ALOS	2.5	10	4
KOMPSAT	1	4	4
WorldView-3	0.31	1.24	4
Beijing-1	4	32	8

下载: 导出CSV

表 2 两组积分级数设置

Table 2. Two groups of TDI stages

谱段	第一组积分级数	第二组积分级数
P	32	64
B₁	24	6
B₂	12	3
B₃	12	3
B₄	24	6
B₅	12	3
B₆	24	6
B₇	12	3
B₈	24	6

下载: 导出CSV

参考文献(23)

[1]	宣明, 王家骐.长春光机所航天光学遥感器研制基地建设进展[J].中国光学, 2015, 8(1):1-16. http://www.chineseoptics.net.cn/CN/abstract/abstract9258.shtml XUAN M, WANG J Q. Current status of space remote sensing equipments research base in CIOMP[J]. Chinese Optics, 2015, 8(1):1-16.(in Chinese) http://www.chineseoptics.net.cn/CN/abstract/abstract9258.shtml
[2]	巩盾.空间遥感测绘光学系统研究综述[J].中国光学, 2015, 8(5):714-724. http://www.chineseoptics.net.cn/CN/abstract/abstract9339.shtml GONG D. Review on mapping space remote sensor optical system[J]. Chinese Optics, 2015, 8(5):714-724.(in Chinese) http://www.chineseoptics.net.cn/CN/abstract/abstract9339.shtml
[3]	DEBEVEC P E, MALIK J. Recovering high dynamic range radiance maps from photographs[C]. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press, 1997: 369-378.
[4]	ROBERTSON M A, BORMAN S, STEVENSON R L. Estimation-theoretic approach to dynamic range enhancement using multiple exposures[J]. Journal of Electronic Imaging, 2003, 12(2):219-228. doi: 10.1117/1.1557695
[5]	SZELISKI R. System and process for improving the uniformity of the exposure and tone of a digital image: US, 6687400[P]. 2004-02-03.
[6]	GOSHTASBY A A. Fusion of multi-exposure images[J]. Image and Vision Computing, 2005, 23(6):611-618. doi: 10.1016/j.imavis.2005.02.004
[7]	薛旭成, 韩诚山, 薛栋林, 等.应用双排TDI CCD提高空间推扫遥感相机动态范围[J].光学精密工程, 2012, 20(12):2791-2795. http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201212028 XUE X CH, HAN CH SH, XUE D L, et al.. Increasing dynamic range of space push-broom remote sensing camera by two-row TDI CCD[J]. Opt. Precision Eng., 2012, 20(12):2791-2795.(in Chinese) http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201212028
[8]	周继权, 王庆.基于相机阵列的高动态范围图像合成方法[J].计算机应用研究, 2013, 30(9):2858-2860, 2864. doi: 10.3969/j.issn.1001-3695.2013.09.076 ZHOU J Q, WANG Q. Camera array-based HDR image synthesis method[J]. Application Research of Computers, 2013, 30(9):2858-2860, 2864.(in Chinese) doi: 10.3969/j.issn.1001-3695.2013.09.076
[9]	吕涛, 付东辉, 陈小云, 等.利用DMD获取高动态范围图像技术[J].中国光学, 2015, 8(4):644-650. http://www.chineseoptics.net.cn/CN/abstract/abstract9289.shtml LV T, FU D H, CHEN X Y, et al.. High dynamic range imaging technology using DMD[J]. Chinese Optics, 2015, 8(4):644-650.(in Chinese) http://www.chineseoptics.net.cn/CN/abstract/abstract9289.shtml
[10]	吕伟振, 刘伟奇, 魏忠伦, 等.基于DMD的高动态范围成像光学系统设计[J].红外与激光工程, 2014, 43(4):1167-1171. doi: 10.3969/j.issn.1007-2276.2014.04.026 LV W ZH, LIU W Q, WEI ZH L, et al.. Design of high dynamic range imaging optical system based on DMD[J]. Infrared and Laser Engineering, 2014, 43(4):1167-1171.(in Chinese) doi: 10.3969/j.issn.1007-2276.2014.04.026
[11]	张锐, 潘明忠, 杨晋, 等.基于数字微镜器件的中阶梯光栅光谱仪的光学系统设计[J].光学精密工程, 2017, 25(12):2994-3000. http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201712003 ZHANG R, PAN M ZH, YANG J, et al.. Optical system of echelle spectrometer based on DMD[J]. Opt. Precision Eng., 2017, 25(12):2994-3000.(in Chinese) http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201712003
[12]	JIN D, ZHOU R J, YAQOOB Z, et al.. Dynamic spatial filtering using a digital micromirror device for high-speed optical diffraction tomography[J]. Optics Express, 2018, 26(1):428-437. doi: 10.1364/OE.26.000428
[13]	TURTAEV S, LEITE I T, MITCHELL K J, et al.. Comparison of kinematic liquid-crystal and DMD based spatial light modulation in complex photonics[J]. Optics Express, 2017, 25(24):29874-29884. doi: 10.1364/OE.25.029874
[14]	SUN W, HAN CH SH, XUE X CH, et al.. An HDR imaging method with DTDI technology for push-broom cameras[J]. Photonic Sensors, 2018, 8(1):34-42. doi: 10.1007/s13320-017-0448-7
[15]	吕恒毅, 刘杨, 薛旭成.遥感相机中时间延时积分电荷耦合器件积分级数的最优选择[J].光子学报, 2012, 41(6):642-648. http://d.old.wanfangdata.com.cn/Periodical/gzxb201206003 LV H Y, LIU Y, XUE X CH. Selecting the optimal integral grade for TDI CCD in remote sensing cameras[J]. Acta Photonica Sinica, 2012, 41(6):642-648.(in Chinese) http://d.old.wanfangdata.com.cn/Periodical/gzxb201206003
[16]	那彦, 焦李成.基于多分辨分析理论的图像融合方法[M].西安:西安电子科技大学出版社, 2007. NA Y, JIAO L CH. Image Fusion Method Based on Multiresolution Theory[M]. Xi'an:Xidian University Press, 2007.(in Chinese)
[17]	周胜明, 张玉叶, 王春歆.基于图像特征提取的脱机手写数字识别方法[J].光学与光电技术, 2016, 14(5):43-47. http://d.old.wanfangdata.com.cn/Periodical/gxygdjs201605010 ZHOU SH M, ZHANG Y Y, WANG CH X. An off-line handwritten numeral recognition method combined with the statistical characteristics and structural features[J]. Optics & Optoelectronic Technology, 2016, 14(5):43-47.(in Chinese) http://d.old.wanfangdata.com.cn/Periodical/gxygdjs201605010
[18]	严军, 王典洪.基于支持向量机的舰船图像识别[J].光学与光电技术, 2004, 2(4):54-57. doi: 10.3969/j.issn.1672-3392.2004.04.018 YAN J, WANG D H. Warship image recognition based on support vector machine[J]. Optics & Optoelectronic Technology, 2004, 2(4):54-57.(in Chinese) doi: 10.3969/j.issn.1672-3392.2004.04.018
[19]	田云翔, 武江龙, 田小林.鲁棒主成份分析与IHS变换相结合的卫星图像融合[J].光学精密工程, 2015, 23(10):504-508. http://d.old.wanfangdata.com.cn/Conference/8796487 TIAN Y X, WU J L, TIAN X L. Satellite image fusion using RPCA combined IHS transform[J]. Opt. Precision Eng., 2015, 23(10):504-508.(in Chinese) http://d.old.wanfangdata.com.cn/Conference/8796487
[20]	高向东, 蓝重洲, 陈子琴, 等.焊接缺陷磁光成像动态检测与识别[J].光学精密工程, 2017, 25(5):1135-1141. http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201705003 GAO X D, LAN CH ZH, CHEN Z Q, et al.. Dynamic detection and recognition of welded defects based on magneto-optical imaging[J]. Opt. Precision Eng., 2017, 25(5):1135-1141.(in Chinese) http://d.old.wanfangdata.com.cn/Periodical/gxjmgc201705003
[21]	刘志强, 尹建芹, 张玲, 等.基于Kinect数据主成分分析的人体动作识别[J].光学精密工程, 2015, 23(10):702-711. http://d.old.wanfangdata.com.cn/Conference/8796540 LIU ZH Q, YIN J Q, ZHANG L, et al.. Human action recognition based on Kinect data principal component analysis[J]. Opt. Precision Eng., 2015, 23(10):702-711.(in Chinese) http://d.old.wanfangdata.com.cn/Conference/8796540
[22]	陈莹, 朱明.多子直方图均衡微光图像增强及FPGA实现[J].中国光学, 2014, 7(2):225-233. http://www.chineseoptics.net.cn/CN/abstract/abstract9121.shtml CHEN Y, ZHU M. Multiple sub-histogram equalization low light level image enhancement and realization on FPGA[J]. Chinese Optics, 2014, 7(2):225-233.(in Chinese) http://www.chineseoptics.net.cn/CN/abstract/abstract9121.shtml
[23]	SU N, ZHANG Y, TIAN SH, et al.. Object-based illumination normalization for multi-temporal satellite images in urban area[J]. Proceedings of SPIE, 2016, 9976:99760Q.