I don't live in H'burg but not too far away. If you are willing to pedal H'burg has some world class trails over in the George Washington National Forest. I know several of the good trails have shuttling access via fire-road.
Well, there is the Massanutten race about 10 minutes from Harrisonburg, although thats only a once per year gig - but who knows, maybe they will follow Brice's lead and expand the riding opportunities.
However, there are some great "XC" trails near Massanutten, which would be perfect for a burly All Enduro Trail rig.
Definitely a beautiful area, and not too far from Charlottesville.
Charlottesville and Waynesboro are also in consideration. Maybe even more so than H'burg. What I'm after is someplace I can build/ride decent FR/DH stuff during the week, close enough to hit up after work.
Harrisonburg is one of the few places that I wouldn't mind moving to. There is an unbelievable amount of quality trails in every direction from town. To take advantage of it you need to pedal, but its totally worth it.
I don't live there but I work up there a lot so I have been riding a bunch up there. The trails in GW are great as long as you don't mind pedaling up. The people I work with for the most part like it but they say it's little small even with JMU being there.