Layers are not difficult for me. You have the luxury of takes, so if you feel like, say, you did not take in the fact that your aunt is across the way in one take, you do it again and try to add that piece.
In the end, I think you really only get as far as you're allowed to get.

