Most of the visa revocations stemmed from law-enforcement encounters involving criminal activity, the department said.