Thanks everyone, and thanks to the folks at CookShack. They answered my email with advice that it was probably the thermostat, so I ordered a new one and just installed it today and will be giving the smoker another try this weekend.
Looking forward to actually getting this thing working