You can use the interface discovery rule. There you have the option “Match interface alias” or “Match interface description”. For ESX it should be description i think.
With a proper scheme for interface descriptions it should be possible only to get the wanted interfaces with this rule.