I did a bunch of road touring on a Fargo 2 (
https://lh4.googleusercontent.com/-M2JBpF89Dfw/T8PrxA_UeTI/AAAAAAAAVfo/XJ2FSreC9e8/s800/IMG_0418.JPG). It was a great bike. I have nothing bad to say about the frame. My foremost complaints is that, in the smallest frame size, it doesn't fit two water bottles; I can carry only one 27oz water bottle. This complaint is easily mitigable. The Fargo carries the Salsa front and rear racks perfectly. The panniers in those pics are loaded with about two cases of wine plus all of my loaded touring gear. The frame handles all of that quite well through descents and hard corners. Fenders are a touch awkward, but not problematic. In descents, I was able to corner so sharply, I dragged both front panniers. Were it not for the panniers, I think there was more cornering angle available.
With a set of Panaracer Pasela tires, you can handle quite a bit of road conditions, including fire roads. Pea gravel is out unless you have a wider tire. I highly suggest the frame.
Bugaboos might be:
handlebars
crankset
seatpost (Thudbuster on the Fargo 2)
brakes (BB7 are great, but now there are TRP hydraulics)
small triangle on the small frames