A shared terminology for implementation research impact: Global Impact Analytics Framework (GIAF) Glossary

Background

Over the past two decades, the growing number of theories, models and frameworks developed in implementation research has generated a significant problem of terminological variability. Evidence shows that implementation research has reached a point in time, when the absence of a common vocabulary and a related taxonomy is hampering the advancement of comparative research in impact analysis, particularly in the “process” or throughput phase. The Glossary of terms is part of the Global Impact Analytics Framework (GIAF) Toolkit.

Aim

This paper details the development of the GIAF Glossary for disambiguation of implementation research terms related to the process of impact analysis, and to document the development and adoption of agreed definitions within the GIAF Taxonomy (15 domains and 82 sub-domains) and Checklists.

Methods

We followed an ontoterminology approach and the Technology Readiness Level adapted to implementation sciences. The iterative and multiple steps involved a scoping review of the terminology and definitions in theories, models and frameworks related to the process domains of implementation research, followed by the development of an inventory of terms, assessment of the definitions for ambiguity and vagueness to develop the Alpha version. The GIAF Glossary was developed concurrently with the development of the GIAF Taxonomy and a Beta version created. Subsequently, an international expert panel (n = 32) critiqued, refined the Beta version and final definitions reached through consensus. Further testing of its usability in the real world occurred over 10 years across 35 project evaluations.

Results

The final comprehensive GIAF Glossary has n = 189 terms. Of these 72% of the definitions were developed during this study, 12% were adopted verbatim from a published source and 16% adapted from a published source. The completed GIAF Glossary is in Supplement 3.

Conclusions

This study demonstrated that numerous existing definitions of terms used in research, evaluation and impact analysis of implementation processes are ambiguous or vague. We demonstrate the combined use of two important methodologies, that of ontoterminology and the Technology Readiness Level-IS. We introduce the GIAF Glossary, developed as part of the GIAF Toolkit which also includes the GIAF Taxonomy, Checklists and Ladders/Scales. The GIAF Glossary provides clear and consensus-based definitions that support consistent communication and understanding across international contexts for impact analysis and implementation research broadly. To our knowledge the GIAF Glossary is the most comprehensive Glossary for the impact analysis of implementation research and science.