Just to ease your mind a little bit, in my state it is a requirement that poll workers are evenly divided between the two major parties. In a town with a large # of minor party registered voters, poll workers from them also may qualify to be a poll worker.