Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor

doi:10.19682/j.cnki.1005-8885.2020.0048

The Journal of China Universities of Posts and Telecommunications ›› 2020, Vol. 27 ›› Issue (6): 87-100.doi: 10.19682/j.cnki.1005-8885.2020.0048

Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor

Shan Rui, Jiang Lin, Deng Junyong, Cui Pengfei, Zhang Yuting, Wu Haoyue, Xie Xiaoyan

Received:2019-06-24 Revised:2020-12-16 Online:2020-12-31 Published:2020-12-31
Contact: SHAN Rui E-mail:shanrui0112@163.com
Supported by:
Research on Self-reconfiguration Mechanism of Data Driven Light Core Array Processor;Performance-driven optical interconnect video array processor dynamic self-reconfiguration architecture;Key Technology of Programmable Dynamic Self-Reconfigurable 3D Array Chip Architecture;Research on Key Technologies of 3D Photoelectric Hybrid Network;Performance-Driven Programmable Self-Reconfigurable Graphics Processor Architecture;the Shaanxi Provincial Co-ordination Innovation Project of Science and Technology;the Shaanxi Provincial key R & D plan

Abstract

Abstract:

Object recognition in very high-resolution remote sensing images is a basic problem in the field of aerial and

satellite image analysis. With the development of sensor technology and aerospace remote sensing technology, the quality and quantity of remote sensing images are improved. Traditional recognition methods have a certain limitation in describing higher-level features, but object recognition method based on convolutional neural network (CNN) can not only deal with large scale images, but also train features automatically with high efficiency. It is mainly used on object recognition for remote sensing images. In this paper, an AlexNet CNN model is trained using 2 100 remote sensing images, and correction rate can reach 97.6% after 2 000 iterations. Then based on trained model, a parallel design of CNN for remote sensing images object recognition based on data-driven array processor (DDAP) is proposed. The consuming cycles are counted. Simultaneously, the proposed architecture is realized on Xilinx V6 development board, and synthesized based on SMIC 130 nm complementary metal oxid semiconductor (CMOS) technology. The experimental results show that the proposed architecture has a certain degree of parallelism to achieve the purpose of accelerating calculations.

Key words: convolutional neural networks, remote sensing images, object recognition, array processor, data-driven

CLC Number:

TP391

Shan Rui, Jiang Lin, Deng Junyong, Cui Pengfei, Zhang Yuting, Wu Haoyue, Xie Xiaoyan. Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor[J]. The Journal of China Universities of Posts and Telecommunications, 2020, 27(6): 87-100.

References

[1] Wang J, Luo C, Huang H Q, et al. Transferring pre-trained deep CNNs for remote scene classification with general features learned from linear PCA network.

Remote Sensing, 2017, 9(3): Article 225

[2]Cheng G, Yang C Y, Yao X W, et al. When deep learning meets metric learning: Remote sensing image scene classification via learning discriminative CNNs. IEEE Trans on Geoscience and Remote Sensing, 2018, 56(5): 2811-2821.

[3]Ding P, Zhang Y, Jia P, et al. A comparison: Different DCNN models for intelligent object detection in remote sensing images. Neural Processing Letters, 2019, 49(3): 1369-1379.

[4] Cheng G, Zhou P C, Han J W. Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images. IEEE Trans on Geoscience and Remote Sensing, 2016, 54(12): 7405-7415.

[5] Sun H, Sun X, Wang H Q, et al. Automatic target detection in high-resolution remote sensing images using spatial sparse coding bag-of-words model. IEEE Geoscience and Remote Sensing Letters, 2012, 9(1):109-113.

[6] Dalal N, Triggs B. Histograms of oriented gradients for human detection. Proceeding of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 2005, Jun 20-25, San Diego, CA, USA. Piscataway, NJ, USA: IEEE, 2005: 8p.

[7] Long Y, Gong Y P, Xiao Z F, et al. Accurate object localization in remote sensing images based on convolutional neural networks. IEEE Trans on Geoscience and Remote Sensing, 2017, 55(5): 2486-2498.

[8] Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS'12): Vol 1. Red Hook, NY, USA: Curran Associates Inc, 2012: 1097-1105.

[9] He S F, Lau R W H, Liu W X, et al. SuperCNN: A superpixelwise convolutional neural network for salient object detection. International Journal of Computer Vision, 2015, 115(3): 330-344.

[10] Bappy J H, Roy-Chowdhury A K. CNN based region proposals for efficient object detection. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP'16), 2016, Sept 25-28, Phoenix, AZ, USA. Piscataway, NJ, USA: IEEE, 2016: 3658-3662.

[11] Wang Y D, Deng W H. Self-restraint object recognition by model based CNN learning. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP'16), 2016, Sept 25-28, Phoenix, AZ, USA. Piscataway, NJ, USA: IEEE, 2016: 654-658.

[12]Alom M Z, Hasan M, Yakopcic C, et al. Improved inception-residual convolutional neural network for object recognition. Neural Computing and Applications, 2020, 32(1): 279-293.

[13] Zhang R Q, Yao J, Zhang K, et al. S-CNN ship detection from high-resolution remote sensing images. ISPRS--International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2016, XLI-B7: 423-430.

[14] Tajbakhsh N, Shin J Y, Gurudu S R, et al. Convolutional neural networks for medical image analysis: Fine tuning or full training?. IEEE Trans on Medical Imaging, 2016, 35(5): 1299.

[15]Lee J, Kim C, Kang S, et al. UNPU: A 50.6TOPS/W unified deep neural network accelerator with 1b-to-16b fully-variable weight bit-precision. Proceedings of the 2018 IEEE International Solid-State Circuits Conference (ISSCC'18), 2018, Feb 11-15, San Francisco, CA, USA. Piscataway, NJ, USA: IEEE, 2018: 3p.

[16] Temam O. A defect-tolerant accelerator for emerging high-performance applications. Proceedings of the 39th Annual International Symposium on Computer Architecture (ISCA'12), 2012, Jun 9-13, Portland, OR, USA. Piscataway, NJ, USA: IEEE, 2012: 356-367.

[17] Chen T S, Du Z D, Sun N H, et al. DianNao: A small-footprint high-throughput accelerator for ubiquitous machine-learning. ACM SIGPLAN Notices, 2014, 49(4): 269-284.

[18]Manatunga D, Kim H, Mukhopadhyay S. SP-CNN: A scalable and programmable CNN-based accelerator. IEEE Micro, 2015, 35(5): 42-50.

[19] Chen Y J, Luo T, Liu S L, et al. DaDianNao: A machine-learning supercomputer. Proceedings of the 47th Annual IEEE/ACM International Symposium on Microarchitecture, 2014, Dec 13-17, Cambridge, UK. Piscataway, NJ, USA: IEEE, 2015: 609-622.

[20] Luo T, Liu S L, Li L, et al. DaDianNao: A neural network supercomputer. IEEE Trans on Computers, 2017, 66(1): 73-88.

[21] Shin D, Lee J, Lee J, et al. DNPU: An energy-efficient deep-learning processor with heterogeneous multi-core architecture. IEEE Micro, 2018, 38(5): 85-93.

[22] Jouppi N P, Young C, Patil N, et al. In-datacenter performance analysis of a tensor processing unit. Proceedings of the ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA'17), 2017, Jun 24-28, Toronto, Canada. Piscataway, NJ, USA: IEEE, 2017.

[23] Lin B, Zhao Y M, Huang X M. A CNN accelerator on FPGA using depthwise separable convolution. IEEE Trans on Circuits and Systems II: Express Briefs, 2018, 65(10): 1415-1419.

[24] Ma Y F, Cao Y, Vrudhula S, et al. Optimizing the convolution operation to accelerate deep neural networks on FPGA. IEEE Trans on Very Large Scale Integration (VLSI) Systems, 2018: 26(7): 1354-1367.

[25] Chang J W , Kang K W , Kang S J . An energy-efficient FPGA-based deconvolutional neural networks accelerator for single image super-resolution. IEEE Trans on Circuits and Systems for Video Technology, 2020, 30(1): 281-295.

[26] https://github.com/BVLC/caffe/tree/master/models/bvlc_alexnet

[27] Russakovsky O, Deng J, Su H, et al. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 2015, 115(3): 211-252.

[28] Viitaniemi V, Laaksonen J. Spatial extensions to bag of visual words. Proceedings of the 8th ACM International Conference on Image and Video Retrieval (CIVR'09), 2009 Jul 8-10, Santorini Island, Greece. New York, NY, USA: ACM, 2009: 8p

[29] Shen Y M, Ferdman M, Milder P. Overcoming resource underutilization in spatial CNN accelerators. Proceedings of the 26th International Conference on Field Programmable Logic and Applications (FPL'16), 2016, Aug 29-Sept 2, Lausanne, Switzerland. Piscataway, NJ, USA: IEEE, 2016: 4p.

[30] Suda N, Chandra V, Dasika G, et al. Throughput-optimized OpenCL-based FPGA accelerator for large-scale convolutional neural networks. Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Array (FPGA'16), 2016, Feb 21-23, Monterey, CA, USA. New York, NY, USA: ACM, 2016: 16-25.

[31] Chen Y H, Krishna T, Emer J S, et al. Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks. IEEE Journal of Solid-State Circuits, 2017, 52(1): 127-138.

Metrics

Comments

Copyright © 2020 The Journal of China Universities of Posts and Telecommunications
　 Adress: P.O. Box 231,Beijing University of Posts and Telecommunications,10 Xi Tucheng Road,Beijing 100876,P.R.China　Post Code: 100081
Tel：86-010-62282493　Fax： 86-010-62283461　E-mail: jchupt@bupt.edu.cn
Support by: Beijing Magtech Co.Ltd

Parallel design of convolutional neural networks for remote sensing images object recognition based on data-driven array processor

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	Guo Xiangbo, Wang Jian, Huang Mengjie, Wang Minghui, Yang Jian, Yu Yongtao. Deep knowledge tracking algorithm based on forgetting law [J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 17-27.
[2]	Wang Xianlun, Wang Guangyu, Cui Yuxia. Facial expression recognition based on improved ResNet [J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 28-38.
[3]	Wu Hongxin, Lin Zhijian, Chen Pingping, Chen Feng. Joint partial computation offloading and resource allocation in MEC-enable networks [J]. The Journal of China Universities of Posts and Telecommunications, 2023, 30(1): 80-86.
[4]	Kong Chao, Ou Weihua, Gong Xiaofeng, Li Weian, Han Jie, Yao Yi, Xiong Jiahao. Face anti-spoofing based on multi-modal and multi-scale features fusion [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(6): 73-82.
[5]	Zhang Han Jing Yinji Zhao Yongli. FS-LSTM: sales forecasting in e-commerce on feature selection [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(5): 92-98.
[6]	Shi Jinjing, Wang Wenxuan, Xiao Zimeng, Mu Shuai, Li Qin. Quantum classifier with parameterized quantum circuit based on the isolated quantum system [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 21-31.
[7]	Liu Hailing, Zhang Jie, Qin Sujuan, Gao Fei. Quantum algorithm for soft margin support vector machine with hinge loss function [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 32-41.
[8]	Wang Jian, Qiao Kuoyuan, Yuan Yanlei, Liu Xiaole, Yang Jian. Adaptive learning path recommendation model for examination-oriented education [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 77-88.
[9]	Meng Wei, Wang Liting, Lu Meng. Summary of research on recommendation system based on serendipity [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(4): 89-105.
[10]	Jia Wei, Gong Chao. Precise and efficient Chinese license plate recognition in the real monitoring scene of intelligent transportation system [J]. The Journal of China Universities of Posts and Telecommunications, 2022, 29(3): 1-14.
[11]	Song Yue, Wu Chengmao, Tian Xiaoping, Song Qiuyu. Enhanced kernel-based fuzzy local information clustering integrating neighborhood membership [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(6): 65-81.
[12]	Xue Chenzi, Wei Yifei, Zhang Yong. Performance optimization for smart grid blockchain integrated with fog computing using DDQN [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(2): 68-78.
[13]	Guo Hairu, Meng Xueyao, Liu Yongli, Liu Shen. Improved HHO algorithm based on good point set and nonlinear convergence formula [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(2): 48-67.
[14]	Wu Chengmao, Cao Zhuo. Entropy-like distance driven fuzzy clustering with local information constraints for image segmentation [J]. The Journal of China Universities of Posts and Telecommunications, 2021, 28(1): 24-40.
[15]	Wang Zhaoying, Zhou Junhua, Liao Zhonghua, Zhai Xiang, Zhang Lianping. Semantic segmentation of track image based on deep neural network [J]. The Journal of China Universities of Posts and Telecommunications, 2020, 27(5): 23-33.