You have to be within about a workbench's radius of the animals for them to tame. If you get too close and they see you they will attack the pen and the taming will stop until they are no longer aware of you.

My barn is right across from my garden so I farm while they tame.

Edit - it takes about a game day and 1/2 for animals to tame.