In all the worlds I have played I don't think I ever found the ID stone before I found the altar... maybe once?

You don't need to find the ID stone at all, so it isn't game breaking if you can't find it.

Altars are huge though.

Overall in terms of difficulty to find I still think Mountians wins as the altar is small and ID stones are rare.