In some instances (North Carolina for instance) there are local restrictions on Jails etc. Keep in mind that the FAA does allow for "Sensitive Infrastructure" etc in the regulations. A Jail/Prison is one such "Sensitive Infrastructure".
In North Carolina:
USE OF AN UNMANNED AIRCRAFT SYSTEM NEAR A CONFINEMENT OR CORRECTIONAL FACILITY PROHIBITED ((§ 15A-300.3)
It is illegal to operate a UAS in North Carolina near a prison. This includes local confinement facilities, and state and federal correctional facilities. The restricted distance is 500 feet horizontally or 250 feet vertically from the prison. The horizontal distance extends outward from the furthest exterior building walls, perimeter fences, and permanent fixed perimeter, or from another boundary clearly marked with posted notices.
There are exceptions to the UAS flight restrictions around prisons if you:
• Are a law enforcement officer operating in accordance to G.S. 15A-300.1(c).
• Are a emergency management agency responding to an emergency.
• Have obtained written permission from the official in charge of the facility.