Exactly. They don't just turn up suddenly one afternoon with a camera crew, these locations are chosen well ahead of time and have probably been scouted online with e-mail/phone communications, then visited several times by various producers and people involved with the show to set up a schedule, do the lighting, decide what's going to be ordered and how it'll be filmed, etc. I wouldn't worry about it too much, OP.