As to holidays. Memorial Day long weekend weekend is May 29-31 so you should be good coming up to Richmond. But keep in mind that Memorial Day weekend is the seen as the unofficial start of the summer season, at least here in the east. Depending on where you find yourself that weekend, places may be crowded. And you very well may experience significantly heavier traffic, especially in areas with popular recreation destinations.
I remember coming down the east coast and finding myself in Mass. during Labor Day weekend--the unofficial end of summer. I was lucky to find a hotel room that Sunday in a nowhere town. (The nearby campground was booked solid.) The next day I did get a camp site and just sat down that day to wait for the heavy Monday going home traffic to run its course.
You might want to consider reservations and taking a day or two off during Memorial Day weekend. Research or ask the locals if there is a nearby town that is having a parade and/or celebration that weekend. It could be fun.