Stop swiped away notifications from coming back?

I often swipe away notifications. But it's pointless because they are goddamed determined that I'm gonna look at them. The disappear for a while, only to come back. Only way to get rid of them is to tap the item and go to the app, at which point it will finally stop harassing me.

Is there a setting somewhere I can change this? I've looked but can't find anything. Obviously I'm referring to notifications from apps that i want to notify me, otherwise I'd just turn them off altogether.

Thanks