On this context, "free" referred not not to staying a slave but largely to not staying in jail or jail for committing a crime. Even right now, plenty of people incarcerated for crimes are not able to vote. Prior to the fifteenth Modification to your constitution in 1870, black men could no