Two-level Ensemble Deep Learning for Traffic Management using Multiple Vehicle Detection in UAV Images

International Journal of Smart Electrical Engineering

دوره 10، شماره 03، آذر 2021، صفحه 127-133   

نوع مقاله: Research Paper

شناسه دیجیتال (DOI): 10.30495/ijsee.2021.684014

نویسندگان

Zeinab Ghasemi Darehnaei¹؛ Seyed Mohammad Jalal Rastegar Fatemi^{* 2}؛ Seyed Mostafa Mirhassani³؛ Majid Fouladian¹

¹Department of Electrical Engineering, College of Engineering, Islamic Azad University Saveh Branch, Saveh, Iran

²Department of Electrical Engineering, College of Engineering, Saveh Branch, Islamic Azad University, Saveh, Iran

³Department of Electrical Engineering, Islamic Azad University Shahrood Branch, Shahrood, Iran

چکیده

Environmental monitoring via vehicle detecting using unmanned aerial vehicle (UAV) images is a challenging task, due to small-size, low-resolution, and large-scale variation of the objects. In this paper, a two-level ensemble deep learning (named 2EDL) based on Faster R-CNN (regional-based convolutional neural network) is introduced for multiple vehicle detection in UAV images. We use three CNN models (VGG16, ResNet50, and GoogLeNet) that have already pre-trained on huge auxiliary data as feature extraction tools, combined with five learning models (KNN, SVM, MLP, C4.5 Decision Tree, and Naïve Bayes), resulting 15 different base learners in two levels. The final class is obtained via a majority vote rule ensemble of these 15 models into five vehicle classes (car, van, truck, bus, trailer) or “no-vehicle”. Simulation results on the AU-AIR dataset of UAV images show the superiority of the proposed 2EDL technique against existing methods, in terms of the total accuracy, and FPR-FNR trade-off.

کلیدواژه‌ها

Deep transfer learning؛ ensemble learning؛ multiple object detection؛ unmanned aerial vehicles