fsl/usb: Resolve PHY_CLK_VLD instability issue for ULPI phy