Capitol is on the Little Missouri River, where it crosses the state line into South Dakota. The first post office was established in 1891 with Bernt Anderson as postmaster.
Capitol is located in southeastern area of Montana, right on the South Dakota border.