In Texas, one part or the other in a phone call must know the call is being recorded. In some states, that still is not enough, both parties "must" know (recall the Lewinsky tapes).
In Florida there is a big sign on the phone telling a caller that all conversations are being recorded.
I do believe the jail landlines have somewhat different status than a random phone connection.