I think, given the small about of wood that is used that it's not going to impact. The idea is to prevent creosote from building up.
Now, that being said, if you're going to jam as much wood in there and TRY to get more smoke flavor, then it's something to experiment.
My suggestion, as always, is to try it and let your taste buds be the guide, and of course, drop back in and let us know how it goes.