Think-tank meeting on “Evaluating the Outcomes of Heritage Science”

Demonstrating benefit is a high priority in many fields, especially where ever-decreasing funding rests on foundations of “economy, efficiency and effectiveness”. The issue was highlighted during the ICCROM Forum 2013 on Conservation Science. This meeting called for data gathering to evidence the outcomes of heritage conservation science and strategies to strengthen  benefit delivery mechanisms. As a first step, ICCROM organized a think tank meeting, gathering  participants with backgrounds in heritage science, social sciences and cultural heritage statistics. This interdisciplinary dialogue provided insight on methods used in other fields to evaluate needs and outcomes, and explored the feasibility of applying those methods in a structured way to heritage science.

Recommendations

Descriptive Statistics

Descriptive statistics are needed to better understand the scale and health of the sector through mapping its current capacity, reach and diversity.  As a preliminary step, it is recommended to focus on developing the criteria for such statistics.

 

Evaluation Practices

A review of current evaluation practices should be undertaken to assess the type of evaluation studies; levels and dimensions for focus; research methodologies employed; types of data collected, etc. A key focus should be identifying commonalities and using these to create a common set of terminologies relevant to the field, along with a guidance framework for evaluation (watchpoint: needs are contextually bound).

 

Case studies (data mining – testing)

A pilot study should be undertaken to test and review the evaluation framework using case studies drawn from heritage conservation science research (e.g. in preventive conservation). At the same time, research should be undertaken to identify organizations that generate large data sets relevant to the cultural heritage sector and to explore epidemiological and data mining techniques for data collection and analysis.

 

Indicators

The findings of the pilot study should be used to clarify the mission and vision of heritage conservation science. In addition, the findings should be used to steer the development of metrics and indicators to communicate the impact of heritage conservation science and demonstrate relevance to policy makers and funding institutions. A goal would be to develop a tool that could be readily used by  ICCROM Member States.