• Community participation[MeSH]
• Patient participation[MeSH]
• Stakeholder participation[MeSH]

• Clinical trial[ptyp]
• Comment[ptyp]
• Comparative study[ptyp]
• Editorial[ptyp]
• Evaluation studies[ptyp]
• Letter[ptyp]
• Meta-analysis[ptyp]
• Observational study[ptyp]
• Pragmatic clinical trial[ptyp]
• Randomized controlled trial[ptyp]
• Systematic[sb]

• Citizen science[MeSH]
• Comparative effectiveness research[MeSH]

• Caregiver(s)
• Clinician(s)
• Community(ies)
• Consumer(s)
• Employer(s)
• Insurance
• Lay
• Partner(s)
• Patient(s)
• Payer
• Pharmaceutical
• Policy makers
• Provider(s)
• Public Stakeholder(s)

• Collaboration
• Collaborative
• Engage
• Engaged
• Engagement
• Engages
• Engaging
• Input
• Involvement
• Participation
• Partner(s)
• Partnered
• Partnership

• Clinical control(led) trial
• Clinical trial
• Comparative study
• Observational study
• Pragmatic clinical trial
• Pragmatic trial
• Randomized clinical trial
• RCT
• Randomized control(led) trial

• CER
• Collaborative research
• Community-academic partnership
• Community-engaged research
• Comparative effectiveness research
• Comparative effectiveness trial
• Engagement method*
• Participatory action
• Patient and public involvement
• Research

• Conceptual framework
• Conceptual model
• NOT preference*
• Practical framework
• Practical model
• Public Involvement Impact Assessment Framework

Inclusion Criteria

• In English

Exclusion Criteria

• Not a peer-reviewed article
• Not about health research (e.g., agricultural health, occupational health, environmental health)
• Evaluates or describes engagement in health care rather than engagement in research
• Evaluates or describes patient preference on health care

Inclusion Criteria

• In English
• Describes engagement in health research (e.g., in planning, conducting, or disseminating research; NOT limited exclusively to comparative effectiveness research [CER])
• Includes information relevant to at least one of the five engagement topics: (1) examples of engagement in health research studies; (2) detailed descriptions of engagement in health research studies; (3) evidence for engagement; (4) editorials or commentaries; and (5) models or frameworks

Exclusion Criteria

• Not a peer-reviewed article
• Not about health research (e.g., agricultural, occupational health, environmental health)
• Evaluates or describes engagement in health care rather than engagement in research
• Evaluates or describes patient preference on health care
• For engagement topics 1 and 2 only: No description of the effects of engagement in research (i.e., only describes anticipated engagement or only mentions the engagement of partners without describing how learnings from partners were incorporated, changes were made as result of engagement, or some other perceived impact of engagement)
• Patients/stakeholders involved only in delivering or administering the intervention; no other forms of patient/stakeholder engagement described

Clinicians

Providers of health care in a clinical setting, including physicians, nurses, physician assistants, rehabilitative professionals, pharmacists, mental healthcare providers, complementary and alternative healthcare providers, and members or representatives of professional societies that serve clinicians

Family physician in direct patient care in a small group practice, hospital floor nurse, psychologist in private practice, dentist, member of the American Medical Association or the American Nurses Association

Patients

Persons with current or past experience of illness or injury, persons at risk for a condition or who consume healthcare services, or members or representatives of advocacy organizations that represent patients

Person with type 1 diabetes, cancer survivor, person whose leg was amputated after a traumatic injury, person with bipolar disorder, patient council leader for a national heart disease advocacy organization, patient engagement specialist for a state-based newborn health coalition, executive director of a stroke patient advocacy foundation who also has personal experience with strokes

Caregivers

Family members or other unpaid persons who provide care to patients, or members or representatives of advocacy organizations that represent caregivers

Spouse of a patient receiving home hospice care for advanced amyotrophic lateral sclerosis (ALS), representative from the National Alliance for Caregiving

Hospitals/health Systems

Organizations where care is delivered, including public and private hospitals and health systems, urgent care centers, retail health clinics, and community health centers, as well as organizations that represent these facilities

Clinic administrator of a multispecialty physician practice, chief operating officer of a health system

Industry

Companies that design, invest in, or manufacture diagnostics, devices, pharmaceuticals, electronic records systems, and mobile apps, as well as organizations that represent the life sciences industry

Chief medical officer of a device manufacturer, representative from a pharmaceutical company, The American Medical Informatics Association

Purchasers

Companies that purchase health benefits for employees and their dependents, including individual businesses as well as local, state, regional, and national business groups; coalitions that represent businesses; and health coalitions

Owner of a family-run business; staff of a state chamber of commerce; health benefits manager of a large, ERISA-covered employer

Payers

Companies that function as financial intermediaries in the health system, including private insurers, public insurers, and organizations that represent insurers, such as America’s Health Insurance Plans

Chief medical officer of a health insurance cooperative; claims adjuster at a large insurer; policy analyst at an insurance trade association; insurers BlueCross BlueShield, Medicaid, and Medicare

Training institutions

Institutions that deliver health professional education, including public and private universities and colleges, individuals affiliated with the delivery or administration of health professional educations, and trade or professional associations that represent these institutions, organizations, and individuals

Dean of a nursing school, director of a residency program, manager of a continuing medical education provider

Policy makers

Persons who help craft public policy at any level of government, including federal, state, and local government officials; representatives of federal, state, and local units of government; and representatives from organizations that represent policy makers

State Medicaid director, representative of the Office of the National Coordinator for Health IT, policy analyst at the National Association of County and City Health Officials, National Conference of State Legislatures, National Association of Counties

Other

Other groups not covered by the categories above, such as community organizers, faith-based leaders, subject matter experts, or researchers who are not part of the primary research team

Community organizer for Planned Parenthood, faith leader for a place of worship, subject matter expert on patient engagement who is not affiliated with the research team

Research topic and agenda

Identifying, refining, and/or prioritizing topics and populations to study

Providing insight about the concerns and priorities of the patient population or stakeholder groups

Research questions and aims

Developing and/or refining the research questions and aims of the study

Reframing aims of the research study to highlight health issues within certain communities 

Study comparators and content

Selecting, designing, and/or refining interventions to be tested in the study

Altering the delivery mode of the intervention to be more aceptable to patients

Study outcomes

Selecting and/or refining study outcomes and deciding how to measure them

Selecting endpoints that are important to patients and other stakeholders 

Study design

Contributing to a specific plan or protocol for conducting the study, including which inclusion criteria should be used to select participants or helping select which methods will be used to conduct the research

Suggesting to use a study design that takes patients’ preferences into account instead of using randomization, in order to better appeal to the study population

Participant recruitment and retention

Refining approaches and/or materials for finding patients who are eligible to participate in the study, enrolling them into the study, and/or making it easier for them to participate and remain in the study

Rewording the consent form to include clearer descriptions of study activities

Data collection

Developing and/or refining approaches and methods to best collect data from study subjects

Improving the timing of data collection to better align with clinic flow

Results review and analysis

Analyzing collected data or reviewing study results to help interpret and explain research findings

Assisting with the transcription and coding of qualitative data, and/or interpreting preliminary findings

Translation

Applying study results to real-world practice, health condition management, policy, or future research

Contributing to the development of clinical practice guidelines

Dissemination

Planning, creating, and/or presenting materials that share information about the study or the results of the study

Suggesting the best means of returning results and other study findings to study participants, and/or giving presentations at conferences to spread results to a wider audience