Eastern Pennsylvania State Penitentiary

https://www.easternstate.org/

https://en.m.wikipedia.org/wiki/Eastern_State_Penitentiary

The link above states that Eastern Pennsylvania State Penitentiary was once the most expensive and famous prison in the world.   Al Capone and a few other notorious criminals spent some time there.  Check out the excellent virtual tour of the prison on their site.

According to smithsonianmag, the penitentiary opened in 1829 and was a "technological marvel" with central heat, flush-able toilets and shower baths in each cell.

I am going to quote directly from the Smithsonian site about the first prisoner, Charles Williams:

"Charles Williams, a farmer sentenced to two years for theft, would be inmate number one. On October 23, 1829, Williams was escorted into the new prison with an eyeless hood placed over his head. This was done to secure his anonymity and eventual integration into society upon release, as no one would recognize his face from the prison. But it also served another purpose: to ensure that there would be no chance at escape, as Williams would never see the prison beyond his private cell. Communication with guards was done through a small feeding hole. The inmates lived in complete isolation, with a Bible their only possession, and chores like shoe-making and weaving to occupy their time."  (Source: https://www.smithsonianmag.com/history/eastern-state-penitentiary-a-prison-with-a-past-14274660/)

Supposedly Charles Dickens visited the prison in 1842 (smithsonianmag.com) and wasn't impressed with the solitary confinement.  In 1913, due to population growth and a change of philosophy, prisoners started sharing cells and more group activities were permitted.

James Stark Hay's (my gg-grandfather) experience there was more than likely like Charles Williams-meaning he spent a year in solitary confinement for theft (larceny.)

Source: https://www.easternstate.org