Please wait a minute...
 
Remote Sensing for Land & Resources    2019, Vol. 31 Issue (1) : 271-276     DOI: 10.6046/gtzyyg.2019.01.35
|
Development and application of the geological processing service system based on message scheduling
Xueli ZHANG1, Na MA1, Yan YANG2, Dunjiang SONG3(), Jianping WANG4, Guo LIU5, Yongming ZHAO1
1.East China Mineral Exploration and Development Bureau, Nanjing 210007, China
2.Development Research Center of China Geological Survey, Beijing 100037, China
3.Institutes of Science and Development, CAS, Beijing 100037, China
4.Shandong Marine Resource and Environment Research Institute, Yantai 264006, China
5.National Geological Library of China, Beijing 100083, China
Download: PDF(3624 KB)   HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks    
Abstract  

This paper analyzes the current situation and existing problems of geological data processing services,and proposes a distributed geological service system based on message scheduling mechanism. The architecture is a new attempt of the geological service system,and it preliminarily solves the reuse problem of geological data services and processing services. Firstly,the concept of message mechanism and application model is introduced; secondly, geological processing service application architecture of message scheduling mechanism is designed and the geological algorithm library service package as well as geological data sharing service is realized,and the geological message processing process is described. Lastly,an online processing services flow is demonstrated. Practice has proved that the scheduling mechanism can greatly reuse geological data services and processing services so as to meet the rapid development of Internet application system to save algorithm re-encoding and service production, so it can be widely used in geological data processing services.

Keywords message queue      geological algorithm library      service reuse     
:  TP311  
Corresponding Authors: Dunjiang SONG     E-mail: songdj@casipm.ac.cn
Issue Date: 14 March 2019
Service
E-mail this article
E-mail Alert
RSS
Articles by authors
Xueli ZHANG
Na MA
Yan YANG
Dunjiang SONG
Jianping WANG
Guo LIU
Yongming ZHAO
Cite this article:   
Xueli ZHANG,Na MA,Yan YANG, et al. Development and application of the geological processing service system based on message scheduling[J]. Remote Sensing for Land & Resources, 2019, 31(1): 271-276.
URL:  
https://www.gtzyyg.com/EN/10.6046/gtzyyg.2019.01.35     OR     https://www.gtzyyg.com/EN/Y2019/V31/I1/271
Fig.1  Message queue invoke pattern
Fig.2  Architecture of geology service
名称 代号 类型
消息唯一认证码 Id 数值
用户编号 UserID 数值
地质处理服务类型 GeoServiceType 字符串
地质处理服务中文名称 ServiceName 字符串
地质处理服务英文名称 ServiceEnName 字符串
数据服务地址 DataAddress 字符串
地质处理服务参数 Param 数组
地质处理算法名称 AlgorithmName 字符串
地质处理算法标示码 AlgorithmID 数值
Tab.1  Parameter of geological message body
Fig.3  Classification design of geological processing algorithm
功能描述 开发工具
网站开发主平台 Play
业务数据库 PostGIS
内存数据库 Redis
消息调度服务器 RabbitMQ
负载均衡 Ngnix
地质云计算环境 Docker集群
WebGIS服务器 ArcGIS Server
Tab.2  Platform development tools
Fig.4  Flow of geological message in system
Fig.5  Design interface of on-line processing system
Fig.6  Result interface of on-line processing system
[1] Granell C, Díaz L, Gould M . Service-oriented applications for environmental models:Reusable geospatial services[J]. Environmental Modelling and Software, 2010,25(2):182-198.
doi: 10.1016/j.envsoft.2009.08.005 url: https://linkinghub.elsevier.com/retrieve/pii/S1364815209002047
[2] Best B D, Halpin P N, Fujioka E , et al. Geospatial web services within a scientific workflow:Predicting marine mammal habitats in a dynamic environment[J]. Ecological Informatics, 2007,2(3):210-223.
doi: 10.1016/j.ecoinf.2007.07.007 url: https://linkinghub.elsevier.com/retrieve/pii/S1574954107000477
[3] Feng M, Liu S G, Euliss Jr N H, et al. Prototyping an online wetland ecosystem services model using open model sharing standards[J]. Environmental Modelling and Software, 2011,26(4):458-468.
doi: 10.1016/j.envsoft.2010.10.008 url: https://linkinghub.elsevier.com/retrieve/pii/S1364815210002689
[4] Fitch P, Bai Q F. A standards based web service interface for hydrological models[C]// Cairns.18th World IMACS/MODSIM Congress.Australia: 2009.
[5] 王卷乐, 游松财, 谢传节 , 等. 面向Web的地学数据共享服务平台架构设计[J]. 地球信息科学, 2004,6(4):62-65.
doi: 10.3969/j.issn.1560-8999.2004.04.014 url: http://d.wanfangdata.com.cn/Periodical/dqxxkx200404014
[5] Wang J L, You S C, Xie C J , et al. Study on web-oriented geo-data sharing platform system structure[J]. Geo-Information Science, 2004,6(4):62-45.
[6] 苏国辉, 申延平, 孙记红 , 等. 全球油气地质信息共享系统[J]. 地球信息科学, 2012,14(2):217-222.
doi: 10.3724/SP.J.1047.2012.00217 url: http://www.cqvip.com/QK/86408A/201202/41596587.html
[6] Su G H, Shen Y P, Sun J H , et al. The global oil and gas geology database information sharing system based on ArcGIS Serve[J]. Journal Of Geo-Information Science, 2012,14(2):217-222.
[7] 马维峰, 王晓蕊, 高山 . 基于关系数据库和WebGIS的中国东部地球化学科学数据库[J]. 地球科学-中国地质大学学报, 2008,33(3):423-430.
doi: 10.3321/j.issn:1000-2383.2008.03.019 url: http://www.cnki.com.cn/Article/CJFDTotal-DQKX200803020.htm
[7] Ma W F, Wang X R, Gao S . Geochemistry science database system for East China based on relational database and WebGIS[J]. Earth Science—Journal of China University of Geosciences, 2008,33(3):432-430.
[8] 高振记, 谢华锋, 李志伟 , 等. 油气资源地质调查大数据架构与应用研究[J]. 地理信息世界, 2016,23(1):18-23.
url: http://d.wanfangdata.com.cn/Periodical/dlxxsj201601003
[8] Gao Z J, Xie H F, Li Z W , et al. Research on the architecture and application of the big data in oil and gas geological survey[J]. Geomatics World, 2016,23(1):18-23.
[9] 缪谨励, 屈红刚, 许哲 , 等. 地学大数据技术研究实验平台GeoBDA[J]. 地理信息世界, 2014,21(6):48-52.
doi: 10.3969/j.issn.1672-1586.2014.06.009 url: http://d.wanfangdata.com.cn/Periodical/dlxxsj201406009
[9] Miao J L, Qu H G, Xu Z , et al. The experimental platform of technical study of the big data of geoscience:GeoBDA[J]. Geomatics World, 2014,21(6):48-52.
[10] 谭永杰 . 地质大数据体系建设的总体框架研究[J]. 中国地质调查, 2016,3(3):1-6.
url: http://d.wanfangdata.com.cn/Periodical/zgdzdc201603001
[10] TAN Y J . Architecture investigation of the construction of geological big data system[J]. Geological Survey of China, 2016,3(3):1-6.
[11] 姜作勤, 马智民, 杨东来 , 等. 地质信息服务体系框架研究[J]. 中国地质, 2007,34(1):173-178.
doi: 10.3969/j.issn.1000-3657.2007.01.025 url: http://d.wanfangdata.com.cn/Periodical/zgdizhi200701025
[11] Jiang Z Q, Ma Z M, Yang D L , et al. Framework of the geological information service system[J]. Geology in China, 2007,34(1):173-178.
[12] 刘荣梅, 严光生, 夏庆霖 . 从第34届国际地质大会看地学信息技术发展趋势[J]. 地质通报, 2013,32(4):685-692.
doi: 10.3969/j.issn.1671-2552.2013.04.016 url: http://www.cnki.com.cn/Article/CJFDTotal-ZQYD201304017.htm
[12] Liu R M, Yan G S, Xia Q L . The progress and development trend of the geoscience information technology viewed from the abstracts submitted to the 34th IGC held in Brisbane,Australia[J]. Geological Bulletin of China, 2013,32(4):685-692.
[13] 胡磊, 乐鹏, 龚健雅 , 等. 异步地理信息网络处理服务方法研究[J]. 武汉大学学报(信息科学版), 2016,41(5):679-685.
doi: 10.13203/j.whugis20140413 url: http://www.cqvip.com/QK/92848A/201605/668725137.html
[13] Hu L, Le P, Gong J Y , et al. An approach to asynchronous geoprocessing service[J]. Geomatics and Information Science of Wuhan University, 2016,41(5):679-685.
[14] 刘熙, 胡志勇 . 基于Docker容器的Web集群设计与实现[J]. 电子设计工程, 2016,24(8):117-119.
doi: 10.3969/j.issn.1674-6236.2016.08.033 url: http://d.wanfangdata.com.cn/Periodical/dzsjgc201608033
[14] Liu X, Hu Z Y . Design and implementation of Web cluster based on Docker container[J]. Electronic Design Engineering, 2016,24(8):117-119.
[15] 刘思尧, 李强, 李斌 . 基于Docker技术的容器隔离性研究[J]. 软件, 2015,36(4):110-113.
doi: 10.3969/j.issn.1003-6970.2015.04.025 url: http://d.wanfangdata.com.cn/Periodical/ranj201504025
[15] Liu S R, Li Q, Li B . Research on isolation of container based on Docker technology[J]. Software, 2015,36(4):110-113.
[1] DIAO Mingguang, LIU Wenjing, LI Jing, LIU Fang, WANG Yanzuo. Dynamic change detection method of vector result data in mine remote sensing monitoring[J]. Remote Sensing for Land & Resources, 2020, 32(3): 240-246.
[2] Xinxin SUI, Suwen SUI. Design and implementation of remote sensing interpretation map database based on MapGIS and ArcGIS[J]. Remote Sensing for Land & Resources, 2018, 30(4): 218-224.
[3] Wenbing XIONG, Weihua MO, Meihua DING, Junhua WANG, Jianfei MO. Meteorological evaluation system of ecological quality based on open-source GIS technology[J]. Remote Sensing for Land & Resources, 2018, 30(2): 243-248.
[4] Liyan REN, Yingcheng LI, Yanli XUE, Xiaobo DING, Hao WU. Development and application of the UAV flying supervisory system based on Beidou technology[J]. Remote Sensing for Land & Resources, 2018, 30(2): 238-242.
[5] NI Jinsheng, LIU Xiang, YANG Jinlin, PAN Jian, SU Xiaoyu. Research on content integration for multi-dynamic plotting information[J]. REMOTE SENSING FOR LAND & RESOURCES, 2017, 29(1): 208-212.
[6] WU Xinqiang, ZHOU Ya, WANG Ruyi, ZHANG Huibing, QIN Xinguo. Conversion of data and symbol library from MapGIS to ArcGIS[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(4): 183-188.
[7] HAO Ming, ZHANG Jianlong, NIU Ruiqing, LIANG Hong. Construction of the geological surveying information grid node: A case study in Southwest China[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(4): 195-199.
[8] SUN Jihong, SU Guohui, YANG Chen, HE Shufeng. Method for construction of business-oriented marine geology data service platform[J]. REMOTE SENSING FOR LAND & RESOURCES, 2015, 27(2): 190-195.
[9] ZHOU Wei, HUANG Wei, WANG Yanzuo, LI Jingming, LIU Ruoxi. Tentative construction of satellite data management and service system for ZY-1 02C[J]. REMOTE SENSING FOR LAND & RESOURCES, 2014, 26(1): 179-185.
[10] JIA Chunyang, LI Weihua, LI Xiaochun. High-resolution remote sensing image segmentation based on weight adaptive fractal net evolution approach[J]. REMOTE SENSING FOR LAND & RESOURCES, 2013, 25(4): 22-25.
[11] ZHANG Mingyang, MA Weifeng, TANG Xiangdan, LI Xianwei. Automatic mapping of the results of 3D remote sensing interpretation of geological disasters[J]. REMOTE SENSING FOR LAND & RESOURCES, 2013, 25(2): 164-167.
[12] QIN Xuexiu, ZHANG Baogang. Application of road location technology in the planning road data management system of Beijing[J]. REMOTE SENSING FOR LAND & RESOURCES, 2013, 25(2): 180-184.
[13] SHI Yiqiang, WU Lina, WU Chenfeng. Design and implementation of a 3D visualization and early warning system for Radar data based on GIS[J]. REMOTE SENSING FOR LAND & RESOURCES, 2013, 25(1): 171-175.
[14] WANG Jian-Chao, GUO Da-Hai, ZHENG Xiong-Wei. THE DESIGN AND IMPLEMENTATION OF SOFTWARE AeroDG[J]. REMOTE SENSING FOR LAND & RESOURCES, 2007, 19(4): 28-32.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
京ICP备05055290号-2
Copyright © 2017 Remote Sensing for Natural Resources
Support by Beijing Magtech