If I put my finished brisket in the broiler a couple of minutes to crisp it up, will that take away from any of the smoked flavor or add any "oven" flavor?

if possible I prefer a crispy outside.

Nope, should be fine, just don't overdo it or you'll have crispy crusties not good brisket.