Journals & Publications

Journals Publications Papers


Deep Reinforcement Learning With Visual Attention for Vehicle Classification
Jan 11, 2018Author:
PrintText Size A A

Title: Deep Reinforcement Learning With Visual Attention for Vehicle Classification

 Authors: Zhao, DB; Chen, YR; Lv, L

 Author Full Names: Zhao, Dongbin; Chen, Yaran; Lv, Le

 Source: IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 9 (4):356-367; 10.1109/TCDS.2016.2614675 DEC 2017

 Language: English

 Abstract: Automatic vehicle classification is crucial to intelligent transportation system, especially for vehicle-tracking by police. Due to the complex lighting and image capture conditions, image-based vehicle classification in real-world environments is still a challenging task and the performance is far from being satisfactory. However, owing to the mechanism of visual attention, the human vision system shows remarkable capability compared with the computer vision system, especially in distinguishing nuances processing. Inspired by this mechanism, we propose a convolutional neural network (CNN) model of visual attention for image classification. A visual attention-based image processing module is used to highlight one part of an image and weaken the others, generating a focused image. Then the focused image is input into the CNN to be classified. According to the classification probability distribution, we compute the information entropy to guide a reinforcement learning agent to achieve a better policy for image classification to select the key parts of an image. Systematic experiments on a surveillance-nature dataset which contains images captured by surveillance cameras in the front view, demonstrate that the proposed model is more competitive than the large-scale CNN in vehicle classification tasks.

 ISSN: 2379-8920

 eISSN: 2379-8939

 IDS Number: FQ0TM

 Unique ID: WOS:000418069600006

*Click Here to View Full Record