-
www.ahrq.gov/sites/default/files/2025-03/isbell-boudreaux-report.pdf
January 01, 2025 - After changes based on pilot testing, we collected data for Study 4, which required
participants to … We spent considerably more time than expected creating,
iteratively testing, and modifying cases. … providers reported “going the extra mile”
for patients and providing additional consultations and testing … comprehensive multi-method approach may facilitate the discovery of key findings,
which may allow for faster testing … Cognitive
interventions to reduce diagnostic error: a narrative review.
-
www.ahrq.gov/sites/default/files/wysiwyg/sops/sops-program-brief-2024.pdf
January 01, 2024 - Focus
on effective diagnostic processes, including
time availability, testing and referrals, and
provider … Survey Development Process
SOPS surveys and supplemental item sets undergo
a rigorous development and testing … With
additional input from the TEP, revise the
items and conduct cognitive testing again.
-
www.ahrq.gov/sites/default/files/wysiwyg/pqmp/measures/outcomes/chipra-140-acknowledgments.pdf
June 02, 2025 - of the Massachusetts Child Health Quality Coalition
We thank the participants in our focus groups, cognitive … interviews, and field tests and all the
others who contributed to the development and testing of the
-
www.ahrq.gov/sites/default/files/wysiwyg/cahps/news-and-events/events/webinars/cahps-what-you-should_know-shaller-webinar.pdf
June 02, 2025 - Surveys: What You Should Know
• Surveys focus on what patients want/need to
know
Focus groups
Cognitive … and ongoing
Advisory panels
Public comment periods
Feedback after surveys are released
Field testing
-
www.ahrq.gov/diagnostic-safety/resources/issue-briefs/dxsafety-cognitive-load-references.html
May 01, 2024 - Diagnostic Errors
Fundamental Concepts for Understanding Cognitive Load
Interplay Between Cognitive … Cognitive load in internal medicine: what every clinical teacher should know about cognitive load theory … A few thoughts on cognitive overload. … Comparing diagnostic performance and the utility of clinical vignette-based assessment under testing … Measuring cognitive load. In: Plass JL, Brünken R, Moreno R, eds. Cognitive Load Theory .
-
www.ahrq.gov/sites/default/files/wysiwyg/pqmp/measures/outcomes/chipra-140-fullreport.pdf
November 02, 2017 - testing.
6.B. … Reporting measure labels were modified based on cognitive testing results to ensure their
understandability … Cognitive testing revealed that parents instead prefer to see each of the aspects
of communication reported … Results from cognitive interviews
and end-user testing indicate that Child HCAHPS is easily understandable … Role of cognitive testing in the development of the CAHPS
Hospital Survey.
-
www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance/home/about/about-cahps-home-health-care-survey-rev.pdf
September 01, 2017 - Cognitive testing. … The team completed multiple rounds of cognitive testing and revised the
questionnaire in light of their
-
www.ahrq.gov/sites/default/files/wysiwyg/cahps/news-and-events/events/webinars/cahps-ch-hospital-webcast-122223-martino.pdf
January 01, 2023 - In the Development of the
Child HCAHPS Narrative Item Set
• Drafting of an initial protocol
• Pilot testing … negative
feedback, (c) actionability of information, (d) match between narrative and interview content
• Cognitive … testing in English and Spanish
• Field testing (Quigley et al., 2023)
o Administered by mail in English
-
www.ahrq.gov/sites/default/files/wysiwyg/sops/events/webinar/2-SOPS_101_Webcast_2020-Gray.pdf
January 01, 2020 - since 2001
• Develops survey measures that are validated and use
best methods for development and testing … Assist in identifying processes and sources of error in diagnosis
• Workplace Safety—2021
► Conducting cognitive … testing for hospitals, nursing homes, ambulatory
surgery centers, and … medical offices
► Pilot testing to be done in hospitals only in 2021—sites needed
14
How are SOPS
-
www.ahrq.gov/sites/default/files/publications/files/confidreportguide_0.pdf
March 01, 2016 - Technique #1: Cognitive testing
Cognitive testing is conducted through one-on-one, in-person meetings … See Text Box 4 for sample questions that cognitive testing can
answer.
Text Box 4. … Illustrative questions that can be answered with cognitive testing
Do physicians respond positively … Cognitive testing can be used
throughout the development process. … Testing a report before release, be it via cognitive or semistructured interviews or focus groups,
-
www.ahrq.gov/sites/default/files/wysiwyg/sops/events/webinar/sops101-3-gray-2018.pdf
January 01, 2018 - big differences in scores between HSOPS 1.0
and 2.0
– Decided to continue further development and cognitive … testing
• Will conduct another pilot test and bridge study in
20-25 hospitals in 2018
• Expect to
-
www.ahrq.gov/sites/default/files/wysiwyg/sops/surveys/Translation-Guidelines-SOPS-090222.pdf
September 02, 2022 - Cognitive testing
involves using an indepth, semistructured interview to gather insight into the sources … Cognitive Interviewing Methods
Cognitive interviews may be conducted in person or by telephone or video … Cognitive Interview Administration
Administering a cognitive interview involves the activities outlined … (preferably experienced) cognitive interviewers … Interviewing
Cognitive Interviewing Methods
Cognitive Interview Administration
APPENDIX C
Option
-
www.ahrq.gov/sites/default/files/wysiwyg/CHIPRA_15-P002-EF-revised.pdf
March 01, 2015 - ● Field testing showed that caregivers of children with medical complexity are willing to complete … and survey development process by using the
RAND-UCLA Modified Delphi Method17 (described below) and cognitive … conceptual framework, extensive literature reviews, a
modified Delphi panel for indicator selection, cognitive … interviews, and multi-modal field testing in two States. … retained by the Delphi panel were operationalized into survey items that were included in structured
cognitive
-
www.ahrq.gov/sites/default/files/2025-07/weinger3-report.pdf
January 01, 2025 - Pilot testing and finalization: Scenarios development proceeded in an iterative fashion, A multidisciplinary … At each study site, after scenario familiarization and
pilot testing, the Scenario Development Team … All simulations and the cognitive interviews were video recorded. … Cognitive Interview data capture and analysis. … Clinical Decision Making – Initial Analysis of Cognitive Interview Data.
-
www.ahrq.gov/diagnostic-safety/resources/issue-briefs/distributed-cognition-er-nurses4.html
August 01, 2022 - or history to clinicians for many reasons (e.g., low health literacy, mistrust, language barriers, cognitive … Such tools reduce a clinician’s cognitive load.
-
www.ahrq.gov/sites/default/files/2024-05/berry2-report.pdf
January 01, 2024 - made real-life testing infeasible. … The results of the simulator testing
showed a strong correlation between checklist use and better team … Our group was deeply involved in the design, testing, and spread of the WHO Surgical Safety Checklist … Cognitive Errors and Cognitive Aids in Anesthesiology. In A.
S. o. … Crisis checklists for the operating room: development and pilot testing.
-
www.ahrq.gov/patient-safety/settings/long-term-care/resource/hcbs/report/apiiii.html
June 01, 2010 - Centeredness/Autonomy, Equity, Access, and Quality of Life
Populations: Elders with physical or cognitive … States Currently Using: Texas
Psychometric Testing: Psychometric testing of both consumer tools. … Providers, Timeliness
Populations: Adults with acquired brain injuries, elders with physical and cognitive … Limited cognitive testing of consumer survey tool. … Psychometric Testing: Original NCI items subjected to psychometric testing; State specific measures
-
www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patient-safety-resources/resources/advances-in-patient-safety-2/vol2/Advances-Fitzgerald_108.pdf
January 01, 2007 - Medical Care
Cognitive errors during emergency care are a significant contributor to patient harm. … litigation brought against emergency physicians arises from delayed or
missed diagnoses.2 Traditionally, cognitive … demonstrated that formal trauma patient algorithms encourage
consistency, reduce error rates, prevent cognitive … of the time.10 An important reason for preventable
adverse events in clinical care was found to be cognitive … The importance of cognitive errors in
diagnosis and strategies to minimize them.
-
www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patient-safety-resources/resources/advances-in-patient-safety/vol2/Nemeth.pdf
July 07, 2002 - Cognitive Artifacts’ Implications for Health Care Information Technology: Revealing How Practitioners … Twelve case
Cognitive Artifacts
283
Figure 2. … Cognitive Artifacts
287
Resource availability and flexibility. … The future of cognitive artifacts and technical work
As described above, cognitive artifacts are physical … Cognitive artifacts. Article on the MIT
COGNET Web site, 2002. pp. 126–7.
-
www.ahrq.gov/patient-safety/reports/hotline/design2.html
May 01, 2016 - We used a series of cognitive interviews to refine the questions and revised the draft form in response … Cognitive interviews are a form of pre-testing in which the investigator asks a sample of likely respondents … The cognitive interviews took place in February and March 2012. … We also refined question content in response to the cognitive interviews. … Regression testing was performed along with functional testing to ensure that any changes made or “bugs