In your ruleset for the vsphere special agent, you have probably missed to pin it to only the vcenter host.