An Inspector General shall be appointed for the territories subject to each [Provincial Government], and shall exercise, subject to the orders of the [Provincial Government], the general control and superintendence of all prisons situated in the territories under such Government. ...