This study was carried out to assess Teachers’ Perception of Ministry of Education Inspection on Improving Students’ Academic Performance in Public Secondary Schools in Urban District in Zanzibar. The study was guided by three objectives. To explore the teachers’ perception on school inspection activity, to explore the challenges that the inspectors face in the whole process of inspection and to determine the degree of implementation of inspection reports and its influence on students’ academic performance in secondary schools. The study adopted qualitative approach and used descriptive case study design. The research used sample size of 55 respondents; who were purposefully selected. The findings revealed that, school inspection is not effective in improving academic performance due to irregularity in the inspection practices. It was also found that where inspection was done recommendations given to schools were not effective. In addition the findings indicated that, school inspectors were facing multiple challenges that hinder the work. The challenges include; lack of the authority to punish teachers who fail to adhere to the way they should teach, transport problems, limited number of inspectors as compared to the number of schools and poor budget, from the findings the study recommends that school inspection should be revisited urgently, so that they can come up with new techniques of making it more effective as a means to improve the education quality in Zanzibar.