There is a sizeable group of Lib Dem MPs who openly question whether the party's problem is with its leader, while others support his stance.