A Practical Approach to the Analysis and Optimization of Neural Networks on Embedded Systems.

Publisher: MDPI Country of Publication: Switzerland NLM ID: 101204366 Publication Model: Electronic Cited Medium: Internet ISSN: 1424-8220 (Electronic) Linking ISSN: 14248220 NLM ISO Abbreviation: Sensors (Basel) Subsets: MEDLINE

Original Publication: Basel, Switzerland : MDPI, c2000-

Artificial Intelligence* ; Neural Networks, Computer*; Cloud Computing ; Algorithms ; Computers

The exponential increase in internet data poses several challenges to cloud systems and data centers, such as scalability, power overheads, network load, and data security. To overcome these limitations, research is focusing on the development of edge computing systems, i.e., based on a distributed computing model in which data processing occurs as close as possible to where the data are collected. Edge computing, indeed, mitigates the limitations of cloud computing, implementing artificial intelligence algorithms directly on the embedded devices enabling low latency responses without network overhead or high costs, and improving solution scalability. Today, the hardware improvements of the edge devices make them capable of performing, even if with some constraints, complex computations, such as those required by Deep Neural Networks. Nevertheless, to efficiently implement deep learning algorithms on devices with limited computing power, it is necessary to minimize the production time and to quickly identify, deploy, and, if necessary, optimize the best Neural Network solution. This study focuses on developing a universal method to identify and port the best Neural Network on an edge system, valid regardless of the device, Neural Network, and task typology. The method is based on three steps: a trade-off step to obtain the best Neural Network within different solutions under investigation; an optimization step to find the best configurations of parameters under different acceleration techniques; eventually, an explainability step using local interpretable model-agnostic explanations (LIME), which provides a global approach to quantify the goodness of the classifier decision criteria. We evaluated several MobileNets on the Fudan Shangai-Tech dataset to test the proposed approach.

IEEE Trans Syst Man Cybern B Cybern. 2010 Aug;40(4):1009-20. (PMID: 20363680)
IEEE Trans Pattern Anal Mach Intell. 2016 Oct;38(10):1943-55. (PMID: 26599615)
IEEE Trans Pattern Anal Mach Intell. 2017 Jun;39(6):1137-1149. (PMID: 27295650)

Keywords: Internet of Things; artificial intelligence; convolutional neural network; crowd counting; edge computing; embedded system; optimization method

Date Created: 20221027 Date Completed: 20221028 Latest Revision: 20221030

20231215

PMC9611103

10.3390/s22207807

36298158