When the Civil War began in 1861, Kentucky remained in the Union What is unique about Kentucky in regards to other states in the Union? Kentucky.