I've used both and frankly can't tell the difference. Now, when you are referring too "hardwood" I am assuming that you mean what we call a wild cherry that can grow to great heights and it's fruit is not much bigger than a cherry pit.
If you are using the real fruit-bearing cherry wood, make sure it's not been doused with chemicals.