The former defence secretary is seen as a safe pair of hands - and is now in charge of the government's finances.