[Flounder]

In my little corncob pipe, do I need to worry about cleaning the bowl out before switching tobaccos?

I have read something talking about aromatics possibly ruining good Virginia tobaccos if you don't clean your bowl between packing them, but I have what I believe to be aromatics as they are scented tobaccos, but they say they are made from Virginia tobacco, that confuses me.