Image Analysis for MRI-Based Brain Tumor Classification Using Deep Learning

Krisna Nuresa Qodri(1*), Indah Soesanti(2), Hanung Adi Nugroho(3)

(1) Universitas Gadjah Mada
(2) Universitas Gadjah Mada
(3) Universitas Gadjah Mada
(*) Corresponding Author


Tumors are cells that grow abnormally and uncontrollably, whereas brain tumors are abnormally growing cells growing in or near the brain. It is estimated that 23,890 adults (13,590 males and 10,300 females) in the United States and 3,540 children under the age of 15 would be diagnosed with a brain tumor. Meanwhile, there are over 250 cases in Indonesia of patients afflicted with brain tumors, both adults and infants. The doctor or medical personnel usually conducted a radiological test that commonly performed using magnetic resonance image (MRI) to identify the brain tumor. From several studies, each researcher claims that the results of their proposed method can detect brain tumors with high accuracy; however, there are still flaws in their methods. This paper will discuss the classification of MRI-based brain tumors using deep learning and transfer learning. Transfer learning allows for various domains, functions, and distributions used in training and research. This research used a public dataset. The dataset comprises 253 images, divided into 98 tumor-free brain images and 155 tumor images. Residual Network (ResNet), Neural Architecture Search Network (NASNet), Xception, DenseNet, and Visual Geometry Group (VGG) are the techniques that will use in this paper. The results got to show that the ResNet50 model gets 96% for the accuracy, and VGG16 gets 96% for the accuracy. The results obtained indicate that transfer learning can handle medical images.


Tumor;Brain Tumors;Magnetic Resonance Image (MRI);Accuracy;Deep Learning;Transfer Learning;VGG16;ResNet50

Full Text:



C.F. Hotama P., H.A. Nugroho, and I. Soesanti, “Analisis Citra Otak pada Color-Task dan Word-Task dalam Stroop Task menggunakan Elektroencephanology (EEG),” Thesis, Universitas Gadjah Mada, Yogyakarta, Indonesia, 2014.

Cancer Support Community, “Understanding Brain Tumors,” in Frankly Speaking About Cancer: Brain Tumors, 2019, p. 7.

(2020) “Brain Tumor: Statistics,” [Online], year%2C an estimated 23%2C890,lifetime is less than 1%25, access date: 21-Dec-2020.

A.S. Febrianti, T.A. Sardjono, and A.F. Babgei, “Klasifikasi Tumor Otak pada Citra Magnetic Resonance Image dengan Menggunakan Metode Support Vector Machine,” J. Tek. ITS, Vol. 9, No. 1, pp. A118-A123, 2020.

P. Afshar, K.N. Plataniotis, and A. Mohammadi, “Capsule Networks for Brain Tumor Classification Based on MRI Images and Coarse Tumor Boundaries,” ICASSP 2019 - 2019 IEEE Int. Conf. on Acoustics, Speech and Signal Proc. (ICASSP), 2019, pp. 1368–1372.

N. Kumari and L. Gray, “Review of Brain Tumor Segmentation and Classification,” 2018 Int. Conf. Curr. Trends Towar. Converging Technol., 2018, pp. 1–6.

K. Fukushima, “Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position,” Biol. Cybern., Vol. 36, pp. 193–202, 1980.

D.H. Hubel and T.N. Wiesel, “Receptive Fields and Functional Architecture of Monkey Striate Cortex,” J. Physiol., Vol. 195, No. 1, pp. 215–243, 1968.

M. Mahmud, M.S. Kaiser, A. Hussain, and S. Vassanelli, “Applications of Deep Learning and Reinforcement Learning to Biological Data,” IEEE Trans. Neural Networks Learn. Syst., Vol. 29, No. 6, pp. 2063–2079, 2018.

S.J. Pan and Q. Yang, “A Survey on Transfer Learning,” IEEE Trans. Knowl. Data Eng., Vol. 22, No. 10, pp. 1345–1359, 2010.

R. Girshick, J. Donahue, S. Member, and T. Darrell, “Region-based Convolutional Networks for Accurate Object Detection and Segmentation,” IEEE Trans. Pattern Anal. Mach. Intell., Vol. 38, No. 1, pp. 142–158, 2015.

M. Everingham, S.M.A. Eslami, L. Van Gool, C.K.I. Williams, J. Winn, and A. Zisserman, “The PASCAL Visual Object Classes Challenge: A Retrospective,” Int. J. Comput. Vis., Vol. 111, No. 1, pp. 98–136, 2015.

M. Gurbină, M. Lascu, and D. Lascu, “Tumor Detection and Classification of MRI Brain Image Using Different Wavelet Transforms and Support Vector Machines,” 42nd International Conference on Telecommunications and Signal Processing (TSP), 2019, pp. 505–508.

R. Vinoth and C. Venkatesh, “Segmentation and Detection of Tumor in MRI images Using CNN and SVM Classification,” 2018 Conference on Emerging Devices and Smart Systems (ICEDSS), 2018, pp. 21–25.

S.K. Chandra, “Effective Algorithm For Benign Brain Tumor Detection Using Fractional Calculus,” TENCON 2018 - 2018 IEEE Region 10 Conference, 2018, pp. 2408–2413.

T.A. Jemimma and Y.J. Vetharaj, “Watershed Algorithm based DAPP Features for Brain Tumor Segmentation and Classification,” 2018 International Conference on Smart Systems and Inventive Technology (ICSSIT), 2018, pp. 155–158.

R. Ezhilarasi and P. Varalakshmi, “Tumor Detection in the Brain Using Faster R-CNN,” 2018 2nd International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud), 2018, pp. 388–392.

D. Divyamary, “Brain Tumor Detection from MRI Images Using Naive Classifier,” 6th International Conference on Advanced Computing and Communication Systems (ICACCS), 2020, pp. 620–622.

H.E.M. Abdalla and M.Y. Esmail, “Brain Tumor Detection by Using Artificial Neural Network,” 2018 International Conference on Computer, Control, Electrical, and Electronics Engineering (ICCCEEE), 2018, pp. 1–6.

M. Nasor and W. Obaid, “MRI Tumor Detection and Localization by Multiple Threshold Object Counting Technique,” 2018 International Conference on Computer and Applications (ICCA), 2018, pp. 158–161.

M.S. Majib and T.M.S. Sazzad, “A Framework to Detect Brain Tumor Cells Using MRI Images,” International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), 2020, pp. 1–5.

M. Siar and M. Teshnehlab, “Brain Tumor Detection Using Deep Neural Network and Machine Learning Algorithm,” 9th International Conference on Computer and Knowledge Engineering (ICCKE), 2019, pp. 363–368.

S. Hussein, P. Kandel, C.W. Bolan, M.B. Wallace, and U. Bagci, “Lung and Pancreatic Tumor Characterization in the Deep Learning Era: Novel Supervised and Unsupervised Learning Approaches,” IEEE Trans. Med. Imaging, Vol. 38, No. 8, pp. 1777–1787, 2019.

O. Bernard, A. Lalande, C. Zotti, et al., “Deep Learning Techniques for Automatic MRI Cardiac Multi-structures Segmentation and Diagnosis: Is the Problem Solved ?” IEEE Trans. Med. Imaging, Vol. 37, No. 11, pp. 2514–2525, 2018.

T.-E. Kam, H. Zhang, Z. Jiao, and D. Shen, “Deep Learning of Static and Dynamic Brain Functional Networks for Early MCI Detection,” IEEE Trans. Med. Imaging, Vol. 32, No. 2, pp. 478–487, 2020.

M. Tofighi, T. Guo, J.K.P. Vanamala, and V. Monga, “Prior Information Guided Regularized Deep Learning for Cell Nucleus Detection,” IEEE Trans. Med. Imaging, Vol. 38, No. 9, pp. 2047–2058, 2019.

J. Djhonson (2020) “Brain MRI Images for Brain Tumor Detection,” [Online],, access date: 13-Dec-2020.

S. Aggarwal and N. Chugh, “Signal Processing Techniques for Motor Imagery Brain Computer Interface: A Review,” Array, Vol. 1–2, pp. 1-12, 2019.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770–778.

V. Nair and G.E. Hinton, “Rectified Linear Units Improve Restricted Boltzmann Machines,” 27th International Conference on Machine Learning (ICML-10), 2010, pp. 807–814.

O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A.C. Berg, and L. Fei-Fei, “ImageNet Large Scale Visual Recognition Challenge,” Int. J. Comput. Vis., Vol. 115, pp. 211–252, 2015.

T.-Y. Lin, M. Maire,S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C.L. Zitnick, “Microsoft COCO: Common Objects in Context,” European Conference on Computer Vision, 2014, pp. 740–755.

F. Chollet, “Xception: Deep Learning with Depthwise Separable Convolutions,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 1800–1807.

J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-fei, “ImageNet: A Large-Scale Hierarchical Image Database,” 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 248–255.

C. Szegedy, S. Ioffe, V. Vanhoucke, and A. Alemi, “Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning,” Thirty-First AAAI Conference on Artificial Intelligence (AAAI'17), 2017, pp. 4278–4284.

B. Zoph, G. Brain, and J. Shlens, “Learning Transferable Architectures for Scalable Image Recognition,” IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018, pp. 8697–8710.

K. Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” International Conference on Learning Representations, 2015, pp. 1–14.

K. Radhika, K. Devika, T. Aswathi, P. Sreevidya, V. Sowmya, and K.P. Soman, “Performance Analysis of NASNet on Unconstrained Ear Recognition,” in Nature Inspired Computing for Data Science, M. Rout, J. K. Rout, and H. Das, Eds., New York, USA: Springer International Publishing, 2020, pp. 57–82.

G. Huang, Z. Liu, L. Van Der Maaten, and K.Q. Weinberger, “Densely Connected Convolutional Networks,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2261–2269.

T. Kohonen, “Self-organized Formation of Topologically Correct Feature Maps,” Adv. Comput. Neurosci. Control Inf. Theory Biol. Syst., Vol. 43, No. 1, pp. 59–69, 1982.

J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, “How Transferable are Features in Deep Neural Networks?” Proc. 27th International Conference on Neural Information Processing Systems, 2014, Vol. 2, pp. 3320–3328.

A. Sharif, R. Hossein, A. Josephine, and S. Stefan, “CNN Features Off-the-Shelf: An Astounding Baseline for Recognition,” IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2014, pp. 512–519.

B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva, “Learning Deep Features for Scene Recognition using Places Database,” Advances in Neural Information Processing Systems 27 (NIPS 2014), 2014, pp. 487–495.


Article Metrics

Abstract views : 2874 | views : 2675


  • There are currently no refbacks.

Copyright (c) 2021 IJITEE (International Journal of Information Technology and Electrical Engineering)

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

ISSN  : 2550-0554 (online)

Contact :

Department of Electrical engineering and Information Technology, Faculty of Engineering
Universitas Gadjah Mada

Jl. Grafika No 2 Kampus UGM Yogyakarta

+62 (274) 552305

Email :