S. Ahmadluei; K. Faez; B. Masoumi
Abstract
Deep convolutional neural networks (CNNs) have attained remarkable success in numerous visual recognition tasks. There are two challenges when adopting CNNs in real-world applications: a) Existing CNNs are computationally expensive and memory intensive, impeding their use in edge computing; b) there ...
Read More
Deep convolutional neural networks (CNNs) have attained remarkable success in numerous visual recognition tasks. There are two challenges when adopting CNNs in real-world applications: a) Existing CNNs are computationally expensive and memory intensive, impeding their use in edge computing; b) there is no standard methodology for designing the CNN architecture for the intended problem. Network pruning/compression has emerged as a research direction to address the first challenge, and it has proven to moderate CNN computational load successfully. For the second challenge, various evolutionary algorithms have been proposed thus far. The algorithm proposed in this paper can be viewed as a solution to both challenges. Instead of using constant predefined criteria to evaluate the filters of CNN layers, the proposed algorithm establishes evaluation criteria in online manner during network training based on the combination of each filter’s profit in its layer and the next layer. In addition, the novel method suggested that it inserts new filters into the CNN layers. The proposed algorithm is not simply a pruning strategy but determines the optimal number of filters. Training on multiple CNN architectures allows us to demonstrate the efficacy of our approach empirically. Compared to current pruning algorithms, our algorithm yields a network with a remarkable prune ratio and accuracy. Despite the relatively high computational cost of an epoch in the proposed algorithm in pruning, altogether it achieves the resultant network faster than other algorithms.
A. Alijamaat; A. Reza NikravanShalmani; P. Bayat
Abstract
Multiple Sclerosis (MS) is a disease that destructs the central nervous system cell protection, destroys sheaths of immune cells, and causes lesions. Examination and diagnosis of lesions by specialists is usually done manually on Magnetic Resonance Imaging (MRI) images of the brain. Factors such as small ...
Read More
Multiple Sclerosis (MS) is a disease that destructs the central nervous system cell protection, destroys sheaths of immune cells, and causes lesions. Examination and diagnosis of lesions by specialists is usually done manually on Magnetic Resonance Imaging (MRI) images of the brain. Factors such as small sizes of lesions, their dispersion in the brain, similarity of lesions to some other diseases, and their overlap can lead to the misdiagnosis. Automatic image detection methods as auxiliary tools can increase the diagnosis accuracy. To this end, traditional image processing methods and deep learning approaches have been used. Deep Convolutional Neural Network is a common method of deep learning to detect lesions in images. In this network, the convolution layer extracts the specificities; and the pooling layer decreases the specificity map size. The present research uses the wavelet-transform-based pooling. In addition to decomposing the input image and reducing its size, the wavelet transform highlights sharp changes in the image and better describes local specificities. Therefore, using this transform can improve the diagnosis. The proposed method is based on six convolutional layers, two layers of wavelet pooling, and a completely connected layer that had a better amount of accuracy than the studied methods. The accuracy of 98.92%, precision of 99.20%, and specificity of 98.33% are obtained by testing the image data of 38 patients and 20 healthy individuals.
