Finance director to move to Whitehall