This study examined the applicability of internal school supervision and its effects on the quality of education in Ilemela district in Mwanza region. Specifically, the study aimed at identifying the models applied in internal school supervision in Ilemela district. Additionally the study assessed the effects of the models on education quality improvement in Ilemela district. Lastly, the study explored the strategies to be adopted to improve the quality of education. A mixed method research design was employed. Data was collected through questionnaires and unstructured interviews which involved 96 respondents from thirteen schools. The findings indicated that Ilemela district employs different models of supervision such as onsite school supervision, classical model, central and control model of supervision. Among these models the onsite school supervision model was identified as the most suitable and reliable model of school supervision in Ilemela district. School site supervision was identified as a model which can facilitate teachers’ efficiency and accountability as well as contributing to reduction of truancy and indiscipline cases among teachers. Based on these findings, the study recommends heads of schools to be given mandate as overall in charge of school supervision to the maintain the quality of education.