Should be able to see the totems just walking/sneaking on the outside walls of a village.
But yes Usually those towers are easier.