You will probably get more lower branches if you keep it pruned. You could end up with a killer tree in 2-4 years. I think it would defintely be worth the time and effort.