Alright this is funny but I got it fixed by a total coincidence.
I was about to play some games using my Steam controller which I use with the original dongle. When I turned the SC on it connected to the dongle but system didn’t see any controller connected nor I was able to use it.
So I checked the journalctl log and found this
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/64, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/64, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/64, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/64, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/8, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/8, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/8, error -110
feb 04 14:52:04 DESKTOP-GarudaOS kernel: usb 5-2.3: device descriptor read/8, error -110
After re-seating the dongle in USB port, and PC reboot. I am back booting the system under 5s and as well the controller works.
Kinds mind boggling why a USB device would case this, but what ever 