We've been to Gettysburg a few times; while I think I would always enjoy going there, my wife doesn't.....

Fortunately, I have family that lives fairly close by in Maryland.
I've done the horseback ride thing in the past....kinda cool, but don't expect to be doin' any cavalry charges or anything like that; you aren't going to go faster than a walk. Still, you get a different perspective, and IIRC you will go just north of little round top/devil's den, right by the barn where General Sickles was wounded (you can still see cannon ball holes in the barn), through the peach orchard, to where Pickett's charge started, and then back again.
One of my special places is Fort Michilmackinac, at the straits between the U.P and L.P. in Michigan. Started as a trading center by the French in the 1600's, it was later built into a fort. After the F&I war, the fort became a possesion of the English, and was later lost to Pontiac's forces during Pontiac's rebellion in 1763. The British later moved the fort to a nearby island (Mackinaw Island), but the history there can't be stamped out.
I was a boy of 10 when I first saw it, and try to get back as often as I can. As a kid, I was more into history and science (yes, I was a nerd) than baseball and sports, and fell in love with the place.