usb: misc: lvs: fix race condition in disconnect handling