Title

Identifying and Understanding the Contributions of Research: An Umbrella Review

1

Location

Armory Room

Start Time

1-10-2016 10:30 AM

End Time

1-10-2016 12:00 PM

Session Type

Research Paper

Abstract

Title: Identifying and Understanding the Contributions of Research: An Umbrella Review

Statement of purpose: The evaluation of research impact is an important aspect of the research enterprise as researchers become more dependent on funding, and funding bodies seek to identify value for their investment. As a growing field, a degree of focus has been generated to ensure relevance and impact of research in Occupation Science (OS). OS continues to be a transformative science providing knowledge that has potential for social and policy change in relation to occupational inequities. However, there is a clear need to identify how research findings are being used and whether these findings result in meaningful health and well-being outcomes. The purpose of this umbrella review - a systematic overview of review articles - was to identify the approaches that have been used to understand the impact(s) of health research and to identify ways that research impacts have been defined and measured in order to provide recommendations for Occupational Scientists.

Description of methods: Umbrella reviews are conducted to provide an overall examination of the research on a particular topic through identifying consistencies and discrepancies in the results of published systematic reviews (Aromataris et al., 2015). Databases were searched for meta-analysis or other reviews focused on the assessment of research impact, or a description of methodology for evaluating impact. A quality assessment was conducted by two independent reviewers based on the critical appraisal checklist suggested by the Joanna Briggs Institute (Aromataris et al., 2014). Data were charted in relation to the research questions. Discussion sections of the reviews were subject to directed coding to summarize findings across reviews.

Report of results: Twelve reviews met the inclusion criteria. We found that exploratory methods such as case reviews and semi-structured interviews are most effective in providing meaningful insights into research impact. However, there is no “best” method to evaluate research impact; therefore, the method chosen should be reflective of the method best suited to the intention of the evaluation.

Implications related to occupational science: Occupational scientists may tailor the concept of research impact from the Research Excellence Framework (Penfield et al., 2013); research impact is the effect on, change or benefit of OS research, to the economy, society, culture, public policy or services, health and wellbeing, the environment or quality of life, or occupational justice. Several key recommendations are presented, including the need for the involvement of stakeholders in measuring research impact, and the need for flexible methods for evaluating research impact that include different types of impacts such as societal impact or the impact of research on behaviour.

Key words: Impact Assessment, Research Impact, Knowledge Translation

Objectives for discussion:

*Discuss the facilitators and the barriers to knowledge translation in occupational science.

*Dialogue about the formation of partnerships or collaborations between researchers and stakeholders and the benefits of these collaborations.

*Discuss the implications of these findings relevant to the field of occupational science. How does considering research impact advance the field?

References

Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015). Summarizing systematic reviews: Methodological development, conduct and reporting of an umbrella review approach. International Journal of Evidence-Based Healthcare, 13(3), 132.

Aromataris, E., Fernandez, R., Godfrey, C., Holly, C., Kahlil, H., & Tungpunkom, P. (2014). Methodology for JBI umbrella reviews. In Joanna Briggs Institute reviewer’s manual 2014. The Joanna Briggs Institute, Adelaide. http://joannabriggs.org/assets/docs/sumari/ReviewersManual-Methodology-JBI_Umbrella%20Reviews-2014.pdf

Penfield, T., Baker, M. J., Scoble, R., & Wykes, M. C. (2013). Assessment, evaluations, and definitions of research impact: A review. Research Evaluation, rvt021

This document is currently not available here.

Share

COinS
 
Oct 1st, 10:30 AM Oct 1st, 12:00 PM

Identifying and Understanding the Contributions of Research: An Umbrella Review

Armory Room

Title: Identifying and Understanding the Contributions of Research: An Umbrella Review

Statement of purpose: The evaluation of research impact is an important aspect of the research enterprise as researchers become more dependent on funding, and funding bodies seek to identify value for their investment. As a growing field, a degree of focus has been generated to ensure relevance and impact of research in Occupation Science (OS). OS continues to be a transformative science providing knowledge that has potential for social and policy change in relation to occupational inequities. However, there is a clear need to identify how research findings are being used and whether these findings result in meaningful health and well-being outcomes. The purpose of this umbrella review - a systematic overview of review articles - was to identify the approaches that have been used to understand the impact(s) of health research and to identify ways that research impacts have been defined and measured in order to provide recommendations for Occupational Scientists.

Description of methods: Umbrella reviews are conducted to provide an overall examination of the research on a particular topic through identifying consistencies and discrepancies in the results of published systematic reviews (Aromataris et al., 2015). Databases were searched for meta-analysis or other reviews focused on the assessment of research impact, or a description of methodology for evaluating impact. A quality assessment was conducted by two independent reviewers based on the critical appraisal checklist suggested by the Joanna Briggs Institute (Aromataris et al., 2014). Data were charted in relation to the research questions. Discussion sections of the reviews were subject to directed coding to summarize findings across reviews.

Report of results: Twelve reviews met the inclusion criteria. We found that exploratory methods such as case reviews and semi-structured interviews are most effective in providing meaningful insights into research impact. However, there is no “best” method to evaluate research impact; therefore, the method chosen should be reflective of the method best suited to the intention of the evaluation.

Implications related to occupational science: Occupational scientists may tailor the concept of research impact from the Research Excellence Framework (Penfield et al., 2013); research impact is the effect on, change or benefit of OS research, to the economy, society, culture, public policy or services, health and wellbeing, the environment or quality of life, or occupational justice. Several key recommendations are presented, including the need for the involvement of stakeholders in measuring research impact, and the need for flexible methods for evaluating research impact that include different types of impacts such as societal impact or the impact of research on behaviour.

Key words: Impact Assessment, Research Impact, Knowledge Translation

Objectives for discussion:

*Discuss the facilitators and the barriers to knowledge translation in occupational science.

*Dialogue about the formation of partnerships or collaborations between researchers and stakeholders and the benefits of these collaborations.

*Discuss the implications of these findings relevant to the field of occupational science. How does considering research impact advance the field?