Five hundred tons of stone were quarried from a nearby hillside to build the fireplace