基于容器云技术的典型遥感智能解译算法集成

doi:10.11959/j.issn.2096-0271.2022015

Abstract

Abstract:

With the development of cloud computing technology in remote sensing data processing, container cloud technology was applied to remote sensing data processing, remote sensing intelligent processing algorithm image was deployed and storage services were distributed in the computing cluster, shielding complex environmental dependence problems.And management through configuration files was processed forming an overall technical route from development to deployment, which provides an efficient and reliable new scheme for the integration of remote sensing intelligent processing algorithms.Taking several typical remote sensing intelligent algorithms as examples, the efficiency of the scheme in the integrated development and deployment was proved, and the feasibility of the new cloud mode of remote sensing intelligent technology was explored.

Key words: artificial intelligence, deep learning, remote sensing image, intelligent processing, container cloud technology

CLC Number:

TP75

Zhitao ZHAO, Lijun ZHAO, Zheng ZHANG, Ping TANG. Integration of remote sensing intelligent processing algorithm using container cloud technology[J]. Big Data Research, 2022, 8(2): 58-74.

Figures/Tables 20

References 22

[1]	李振举, 李学军, 刘涛 ,等. 遥感云计算:研究现状与展望[J]. 装备学院学报, 2015,26(5): 95-100.
	LI Z J , LI X J , LIU T ,et al. Remote sensing cloud computing:current research and prospect[J]. Journal of Equipment Academy, 2015,26(5): 95-100.
[2]	李朋飞 . 遥感云计算中的基础设施关键技术研究[D]. 秦皇岛:燕山大学, 2017.
	LI P F . Research on key technologies of remote sensing cloud computing infrastructure[D]. Qinhuangdao:Yanshan University, 2017.
[3]	张兵 . 遥感大数据时代与智能信息提取[J]. 武汉大学学报·信息科学版, 2018,43(12): 1861-1871.
	ZHANG B . Remotely sensed big data era and intelligent information extraction[J]. Geomatics and Information Science of Wuhan University, 2018,43(12): 1861-1871.
[4]	李德仁, 马军, 邵振峰 . 论时空大数据及其应用[J]. 卫星应用, 2015(9): 7-11.
	LI D R , MA J , SHAO Z F . Spacetime big data and its applications[J]. Satellite Application, 2015(9): 7-11.
[5]	宫鹏 . 对遥感科学应用的一点看法[J]. 遥感学报, 2019,23(4): 567-569.
	GONG P . Towards more extensive and deeper application of remote sensing[J]. Journal of Remote Sensing, 2019,23(4): 567-569.
[6]	李德仁, 张良培, 夏桂松 . 遥感大数据自动分析与数据挖掘[J]. 测绘学报, 2014,43(12): 1211-1216.
	LI D R , ZHANG L P , XIA G S . Automatic analysis and mining of remote sensing big data[J]. Acta Geodaetica et Cartographica Sinica, 2014,43(12): 1211-1216.
[7]	高常鑫, 桑农 . 基于深度学习的高分辨率遥感影像目标检测[J]. 测绘通报, 2014(S1): 108-111.
	GAO C X , SANG N . Deep learning for object detection in remote sensing image[J]. Bulletin of Surveying and Mapping, 2014(S1): 108-111.
[8]	徐永斌, 王树文 . 基于地学分析与遥感智能解译模型的土地覆盖/土地利用分类[J]. 测绘与空间地理信息, 2010,33(4): 64-66,69.
	XU Y B , WANG S W . Land cover and land use classification based on earth sciences analysis and automatic interpretation model of remote sensing[J]. Geomatics ＆Spatial Information Technology, 2010,33(4): 64-66,69.
[9]	刘大伟, 韩玲, 韩晓勇 . 基于深度学习的高分辨率遥感影像分类研究[J]. 光学学报, 2016,36(4): 0428001.
	LIU D W , HAN L , HAN X Y . High spatial resolution remote sensing image classification based on deep learning[J]. Acta Optica Sinica, 2016,36(4): 0428001.
[10]	佟国峰, 李勇, 丁伟利 ,等. 遥感影像变化检测算法综述[J]. 中国图象图形学报, 2015,20(12): 1561-1571.
	TONG G F , LI Y , DING W L ,et al. Review of remote sensing image change detection[J]. Journal of Image and Graphics, 2015,20(12): 1561-1571.
[11]	杨桄, 刘湘南 . 遥感影像解译的研究现状和发展趋势[J]. 国土资源遥感, 2004,16(2): 7-10,15.
	YANG G , LIU X N . The present research condition and development trend of remotely sensed imagery interpretation[J]. Remote Sensing for Land ＆ Resources, 2004,16(2): 7-10,15.
[12]	肖熠, 鲁永泉, 谢思烨 . 一种针对GPU资源的深度学习容器云研究[J]. 中国传媒大学学报(自然科学版), 2017,24(6): 16-20.
	XIAO Y , LU Y Q , XIE S Y . A deep learning container cloud study for GPU resources[J]. Journal of Communication University of China (Science and Technology), 2017,24(6): 16-20.
[13]	董宁宁 . 基于Kubernetes的软件工程教育云基础容器平台子系统的设计与实现[D]. 南京:南京大学, 2019.
	DONG N N . The design and implementation of container infrastructure subsystem in software engineering education cloud based on kubernetes[D]. Nanjing:Nanjing University, 2019.
[14]	朱天放, 梁明, 王家乐 ,等. 基于容器云的深度学习平台设计与实现[J]. 电子设计工程, 2019,27(9): 21-25.
	ZHU T F , LIANG M , WANG J L ,et al. Design and implementation of deep learning platform based on Kubernetes[J]. Electronic Design Engineering, 2019,27(9): 21-25.
[15]	余昌发, 程学林, 杨小虎 . 基于Kubernetes的分布式TensorFlow平台的设计与实现[J]. 计算机科学, 2018,45(S2): 527-531.
	YU C F , CHENG X L , YANG X H . Design and implementation of distributed TensorFlow platform based on kubernetes[J]. Computer Science, 2018,45(S2): 527-531.
[16]	李宏益, 唐娉, 单小军 ,等. 多源定量遥感产品并行处理系统设计及实现[J]. 计算机应用研究, 2016,33(11): 3334-3339.
	LI H Y , TANG P , SHAN X J ,et al. Parallel processing system design and implementation for multi-sensor quantitative remote sensing production[J]. Application Research of Computers, 2016,33(11): 3334-3339.
[17]	张杰, 郑柯, 唐娉 ,等. Docker容器化下的遥感算法程序集成方法[J]. 中国图象图形学报, 2019,24(10): 1813-1822.
	ZHANG J , ZHENG K , TANG P ,et al. Integration of remote sensing algorithm program using Docker container technology[J]. Journal of Image and Graphics, 2019,24(10): 1813-1822.
[18]	HAN J M , DING J , LI J ,et al. Align deep features for oriented object detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022,60: 1-11.
[19]	戴伟聪, 金龙旭, 李国宁 ,等. 遥感图像中飞机的改进YOLOv3实时检测算法[J]. 光电工程, 2018,45(12): 84-92.
	DAI W C , JIN L X , LI G N ,et al. Real-time airplane detection algorithm in remotesensing images based on improved YOLOv3[J]. Opto-Electronic Engineering, 2018,45(12): 84-92.
[20]	WANG G L , FAN B , XIANG S M ,et al. Aggregating rich hierarchical features for scene classification in remote sensing imagery[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017,10(9): 4104-4115.
[21]	SIMONYAN K , ZISSERMAN A . Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint,2014,arXiv:1409.1556.
[22]	苏健民, 杨岚心, 景维鹏 . 基于U-Net的高分辨率遥感图像语义分割方法[J]. 计算机工程与应用, 2019,55(7): 207-213.
	SU J M , YANG L X , JING W P . U-Net based semantic segmentation method for high resolution remote sensing image[J]. Computer Engineering and Applications, 2019,55(7): 207-213.

Metrics

Recommended 0

No Suggested Reading articles found!

对比项	传统深度学习	基于Kubernetes容器云平台的深度学习
GPU调度	手动调度	自动调度
数据存储	训练数据和模型文件难以保存	分布式存储GlusterFS
部署集成	困难，手动解决冲突	容器化集成部署

名称	数据类型	功能说明
Input_datadir	String	输入数据的挂载目录路径
Input_args	Array	输入参数列表
Output_dir	String	输出数据的存储路径
Output_weight	String	模型权重的保存路径
Phase_model	String	模型阶段(训练、推理)

名称	数据类型	功能说明
jobstate	String	记录容器当前运行情况
loss	Array	模型损失函数
nowstep	String	当前运行步骤
totalstep	String	最大运行步骤
data	Object	输出数据

IP地址	10.1.17.7	10.1.17.11	10.1.17.83
CPU	Inter Core i7-4790 CPU, 4 cores, 3.60 GHz	Intel Core Xeon E5-2620, 32 cores, 2.10 GHz	Intel Core Xeon E5-2620, 32 cores, 2.10 GHz
内存	24 GB RAM	126 GB RAM	126 GB RAM
硬盘空间	2 TB	16 TB	16 TB
GPU	1x NVIDIA GTX1080Ti	4x NVIDIA TITAN Xp	2x NVIDIA GTX2080Ti
操作系统	Ubuntu 18.04 LST	Ubuntu 16.04 LST	Ubuntu 20.04 LST
部署	Kubernetes 1.20, Docker 19.03, Dashboard	Kubernetes 1.20, Docker 19.03, Portainer 1.20	Kubernetes 1.20, Docker 19.03, Portainer 1.20

算法	概述	数据集	基础镜像
S2ANet	旋转框目标检测算法^[1]	DOTA-v1.0	mmdetecitonv1:s2anet
YOLOv3	水平框目标检测算法^[2]	DOTA-v1.0	tensorflow/tensorflow:1.12.0-gpu-py3
ResNet101	场景分类算法^[3]	UC Merced	pytorch/pytorch:1.6.0-cuda10.1-cudnn7-devel
UNet	地物分类算法^[4]	DSTL	tensorflow/tensorflow:1.10.0-gpu-py3
UNet-VGG16	变化检测算法^[5]	SpaceNet7	sn7_baseline_image

Integration of remote sensing intelligent processing algorithm using container cloud technology

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 20

References 22

Related Articles 15

Metrics

Recommended 0

[1]	Yimin DENG, Xulong ZHANG, Shijing SI, Jianzong WANG, Jing XIAO. Human avatars synthesis technologies: a survey [J]. Big Data Research, 2023, 9(3): 114-139.
[2]	Jingwen LI, Yawen LI. Research on algorithm and application risk and its governance [J]. Big Data Research, 2023, 9(3): 140-149.
[3]	Yayun HE, Junqing PENG, Jianzong WANG, Jing XIAO. Rhythm dancer: 3D dance generation by keymotion transition graph and pose-interpolation network [J]. Big Data Research, 2023, 9(1): 23-37.
[4]	Yang SHEN, Menglong YU. Metaverse and big data: data insight and value connection in spatio-temporal intelligence [J]. Big Data Research, 2023, 9(1): 103-110.
[5]	Yumeng CUI, Jingya WANG, Shangyi YAN, Zhizhong TAO. Automatic key information extraction of police records based on deep learning [J]. Big Data Research, 2022, 8(6): 127-142.
[6]	Zhitao ZHU, Shijing SI, Jianzong WANG, Jing XIAO. Survey on federated recommendation systems [J]. Big Data Research, 2022, 8(4): 105-132.
[7]	Jie WANG, Songyan ZHANG, Jiye LIANG. A semi-supervised deep learning algorithm combining consistency regularization and manifold regularization [J]. Big Data Research, 2022, 8(3): 103-114.
[8]	Kangting XU, Wei Song. A Chinese text sentiment analysis method combining language knowledge and deep learning [J]. Big Data Research, 2022, 8(3): 115-127.
[9]	Kai ZHANG, Yang CHE. Method of accelerating deep learning with optimized distributed cache in containers [J]. Big Data Research, 2021, 7(5): 150-163.
[10]	Jingxi WEN, Hufei YU, Jiang XIN, Yan TANG. Analysis of gender differences in the brain based on deep learning [J]. Big Data Research, 2021, 7(4): 130-140.
[11]	Xin PENG, Chi CHEN, Yun LIN. Context-based intelligent recommendation for code reuse [J]. Big Data Research, 2021, 7(1): 37-47.
[12]	Lihui WANG, Yongbin QIN. State of the art and future perspectives of the applications of deep learning in the medical image analysis [J]. Big Data Research, 2020, 6(6): 83-104.
[13]	Zhengxun XIA,Yifan YANG,Shengmei LUO,Dachao ZHAO,Yan ZHANG,Jianfei TANG. Application and exploration of automatic generation technology in artificial intelligence platform [J]. Big Data Research, 2020, 6(6): 0-.
[14]	Hufei YU, Jingxi WEN, Jiang XIN, Yan TANG. Study on domain adaptation of medical data based on generative adversarial network [J]. Big Data Research, 2020, 6(5): 45-54.
[15]	Ting SONG, Zhanwei CHEN, Haifeng YANG. Aspect sentiment analysis based on a hierarchical attention network [J]. Big Data Research, 2020, 6(5): 82-91.