The chairman of the Portman Group is to step down after four years in the post.