Evaluation Versus Research

Purpose and Intention

The fundamental difference between evaluation and research lies in the purpose and motivation behind the work. The goal behind research is to contribute to a body of knowledge and theory in a field. An intellectual question and the opportunity to contribute to a broader understanding of a subject or body of study often motivates researchers. In contrast, the focus of evaluation, as a form of applied research, is to judge merit or quality as [Page 630]determined by the interests of various stakeholders, such as funding agencies. As a result, evaluators often view the work that is being conducted with a different lens and a broader perspective than that of researchers. These evaluators may work internally within the organization or be commissioned externally under a contract.

It should be noted that the emphasis on “producing generalizable knowledge” is a critical criterion for determining whether a proposed study requires institutional review board or human subjects review approval. Typically, plans to publish results in an abstract, poster, conference presentation, or journal article demonstrate an intention to contribute to “generalizable knowledge.”

Although evaluation often involves interactions with living individuals, human subjects review may not be necessary if the evaluation activities are part of the normal educational activities within a course and individually identifiable information is not being collected or shared beyond the specific context. For example, if the purpose of the data collection is primarily to improve upon the teaching activities and techniques for a particular course or program, then this is not considered human subjects research. However, the distinguishing characteristic of research is based on the intention to advance knowledge and not whether findings are actually published or not. Irrespective of the institutional review board approval, it is generally a good practice in evaluation to err on the side of following the guidelines of informed consent and ensuring that all participants understand the instructional purpose of the tasks or activities.

Methods and Analysis Approaches

As articulated in their respective definitions, while the questions that guide and drive evaluation and research are different, both employ similar methods, theories, and analysis approaches to achieve results and ensure reliable and valid outcomes. In designing rigorous studies to address a particular question, quantitative, qualitative, or mixed methods from a range of disciplines and professions may be employed. Although researchers typically have formal training in these areas, evaluators tend to be more diverse in their knowledge and skills. One approach to measuring the quality of the research design is through the peer review process. In contrast, the credibility and usefulness of evaluation findings do not rely solely on the results themselves but require a broader understanding of context and the ability to integrate and synthesize across multiple perspectives, data sets, and circumstances.

...