exynos9610: USB: Fix potential racing by wall time change