It's rather easy to get your villager on the swing:
1) Tap on the chosen tribezman using a long tap lifting him into the air.
2) Drag the villager to the swing keeping him in the air until the arrow icon shows up.
3) Release the villager to let him swing!