ipsec: pfkey should ignore events when no listeners