Crosstracking is indeed a thing. Obviously it has its limits, since the other devices have to communicate back. It should be easy enough to see all devices that are on the same network though.

IoT is a popular attack vector. So proper precautions should be made. Perhaps only give them access to your guest wi-fi. Perhaps a separate network entirely.