The new prime minister has begun to set out key policies - starting with a vow to end rough sleeping.