I try to show you with my rules.
In your system there should be a rule “Network Interface and Switch Port Discovery”.
To ignore the “vusb” Interfaces on the ESX you need to make a rule what only discovers the “other” interfaces. In my case the normal ESX ports have all the start of the name “vmnic”.
What is now important is the following. These ESX hosts should not match to another rule in this rule set. If it is so then you “vusb” is found again.
In my case a have an exclude in my generic rule for the ESX host.
If i remove this exclude then all unwanted interfaces are found on the ESX.