Chistopher Timmons is charged with carrying a deadly weapon. A Capitol Police spokeswoman says additional charges may be filed.
The 27-year-old Timmons was detained after he stopped to ask a police officer directions and the officer saw a rifle case in the car.
Police say the search of the Jeep Cherokee turned up a rifle, a grenade, a pistol, ammunition, magazines with ammunition in them and several other "items of concern."