I think all villages with the huge bonfire have at least 1 totem in a pedestal.
I also found my 4th totem in the floor level of a big tower with a chest on the top.
There's a small stone area with a staircase that leads to an exposed chests, nothing there.
There's the Stonehenge with 3 of those big goblins, but no totem inside the central chest.