In the high-resolution remote sensing image retrieval, it is difficult for hand-crafted features to describe the images accurately. Thus a method based on aggregating convolutional neural network(CNN) features is proposed to improve the feature representation. First, the parameters from CNN pre-trained on large-scale datasets are transferred for remote sensing images. Given input images with different sizes, the CNN features which represent local information are extracted. Then, average pooling with different pooling region sizes and bag of visual words (BoVW) are adopted to aggregate the CNN features. Pooling features and BoVW features are obtained accordingly. Finally, the above two aggregation features are utilized for remote sensing image retrieval. Experimental results demonstrate that the input image with reasonable size is capable of improving the feature representation. When the pooling region size is between 60% and 80% of the feature map, the vast majority of the results of pooling features are superior to those of the traditional average pooling method. The optimal average normalized modified retrieval rank values of pooling feature and BoVW feature are 27.31% and 21.51% lower than those of hand-crafted feature. Therefore, both the average pooling and BoVW can improve the remote sensing image retrieval performance efficiently.
Yun GE,Shunliang JIANG,Famao YE, et al. Aggregating CNN features for remote sensing image retrieval[J]. Remote Sensing for Land & Resources,
2019, 31(1): 49-57.
Zhu J L, Li S J, Wan D S , et al. Content-based remote sensing image retrieval based on feature selection and semi-supervised learning[J]. Journal of Image and Graphics, 2011,16(8):1474-1482.
[2]
Demir B, Bruzzone L . A novel active learning method in relevance feedback for content-based remote sensing image retrieval[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015,53(5):2323-2334.
doi: 10.1109/TGRS.2014.2358804
url: http://ieeexplore.ieee.org/document/6920022/
Babenko A, Slesarev A, Chigorin A, et al. Neural codes for image retrieval [C]//Proceedings of European Conference on Computer Vision.Springer, 2014: 584-599.
[8]
Ng J Y, Yang F, Davis L S. Exploiting local features from deep networks for image [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition workshops.IEEE, 2015: 53-61.
[9]
Babenko A, Lempitsky V. Aggregating deep convolutional features for image retrieval [C]//Proceedings of IEEE International Conference on Computer Vision.IEEE, 2015: 1269-1277.
Zhang H Q, Liu X Y, Yang S , et al. Retrieval of remote sensing images based on semisupervised deep learning[J].Journal of Remote Sensing, 21(3):406-414.
Zhou W X, Newsam S, Li C , et al. Learning low dimensional convolutional neural networks for high-resolution remote sensing image retrieval[J]. Remote Sensing, 2017,9(5):489.
doi: 10.3390/rs9050489
url: http://www.mdpi.com/2072-4292/9/5/489
[14]
Hu F, Tong X Y, Xia G S, et al. Delving into deep representations for remote sensing image retrieval [C]//Proceedings of IEEE International Conference on Signal Processing.IEEE, 2016: 198-203.
Szegedy C, Liu W, Jia Y Q, et al. Going deeper with convolutions [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.IEEE, 2015: 1-9.
[17]
Hu F, Xia G S, Hu J W , et al. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery[J]. Remote Sensing, 2015,7(11):14680-14707.
doi: 10.3390/rs71114680
url: http://www.mdpi.com/2072-4292/7/11/14680
[18]
Vedaldi A, Lenc K. MatConvNet:convolutional neural networks for MATLAB [C]//Proceedings of 23rd ACM International Conference on Multimedia.ACM, 2015: 689-692.
2019,
Vol. 31
), Changlong JIANG2, Ying CHEN2, Yiling TANG1
