Government officials are living in "ivory towers totally removed from the hell the victims have gone through day after day, year after year", Sir Alan tells Sky News.