MSc Thesis Defense - Sumaiya Deen Muhammad

An Ensemble Deep Learning Approach for Enhanced Classification: A Case Study on Pituitary Tumors

MSc Thesis Defense by: Sumaiya Deen Muhammad

Date: Thursday, 09 May 2024

Time: 12:30 pm

Location: Dillon Hall Room 265

Abstract: The Segment Anything Model (SAM) by Meta AI Research, trained on an extensive

collection of over 1 billion masks, has gained significant attention for its exceptional

ability to segment “anything” in “any scene”. SAM integrates a sophisticated image encoder, prompt encoder, and lightweight mask decoder, enabling flexible prompting and rapid mask generation in segmentation tasks. This segmentation model excels in granular, component-level segmentation, enriching our understanding of pixel semantics, critical for local feature learning. On a different note, the challenge of classifying small-scale objects persists, especially in sectors like medical imaging and remote sensing where objects of interest typically represent a small fraction of the entire image. In this study, we investigate the potential applications of SAM in the classification of small objects despite its primary design as a segmentation model. We introduce an ensemble deep learning methodology that leverages SAM within our custom dataset, specifically targeting the classification of tiny objects. Through comparative analysis between segmented data (processed by SAM) and non-segmented data (original data), our findings indicate a performance improvement in favor of the segmented data, underscoring the efficacy of our proposed approach.

Thesis Committee:

Internal Reader: Dr. Boubakeur Boufama

External Reader: Dr. Esam Abdel-Raheem

Advisor: Dr. Ziad Kobti

Chair: TBD