The park contains a waterpark, batting cages and a miniature golf course. The batting cages include nine baseball and softball cages. Upton’s Hill played a locally important role during the Civil War, as the Union Army command used the site as its headquarters. A large masonry fort was constructed opposite the road, at the hill’s topmost point. This fort was originally called Fort Upton but was later renamed Fort Ramsay.