Full text can be accessed at http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=4755742&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D4755742Today in many organizations in the public sector, the use of IT has become crucial in sustaining and extending the organizations' strategies and objectives. This pervasive use of technology has caused a critical dependency on IT that calls for specific focus on the IT Governance. This paper discusses the current state of IT Governance practices in five public sector organizations from a developing country, like is Tanzania. The results of this research approach are looking into the IT Governance mechanisms in place in terms of structures, processes and relational mechanisms. Moreover the paper includes a discussion on the problems and consequences inherent to inhibitors of effective IT Governance for a further improvement of the public service delivery in this environment.