I placed all my devices on the main network

My question I connect all home devices on my main network and not the lot network, my question is, do I need to remove the cameras and other small devices and place them on the lot network? Or it dont matter..? Do yall think this cause some devices to disconnect randomly...