Torrential rains and flooding have damaged 129 houses and forced the evacuation of nearly 3,500 people, officials say.