Throughout its history, this building has been a Military Academy for Cadets (1819-1826), a Charity House, a supply warehouse for the army and a Military Hospital (during the Civil War). Since 1946 it is the Museum of Fine Arts.