The elk from nearby Rocky Mountain National Park were always on the grounds