Human rights groups say some 5,000 returnees could face violence, persecution and forced conscription.