-
www.ahrq.gov/talkingquality/resources/cognitive/index.html
September 01, 2019 - Why Is Cognitive Testing of a Quality Report Useful? … How Is Cognitive Testing Conducted for a Quality Report? … Knowing When To Stop Testing
Cognitive testing is an iterative process. … It is often necessary to conduct usability testing in addition to cognitive testing, as a report that … Recommended Reading on Cognitive Testing
Hoy EW, Kenney E, Talavera AC.
-
www.ahrq.gov/ncepcr/tools/confid-report/three-strategies.html
February 01, 2016 - Technique #1: Cognitive testing
Cognitive testing is conducted through one-on-one, in-person meetings … See Text Box 4 for sample questions that cognitive testing can answer.
Text Box 4. … Illustrative questions that can be answered with cognitive testing
Do physicians respond … Cognitive testing can be used throughout the development process. … Testing a report before release, be it via cognitive or semistructured interviews or focus groups, has
-
www.ahrq.gov/cahps/surveys-guidance/ich/develop-ich-survey/index.html
June 01, 2019 - , including a review of existing surveys, a scientific assessment of potential items, public input, cognitive … testing, and field testing, which includes psychometric analyses of the performance of items and their … Cognitive Testing
In early spring of 2004, the instrument underwent an initial round of cognitive testing … The team used the cognitive testing findings along with the public comments AHRQ received as the basis … A second round of cognitive testing was conducted in May and June of 2004.
-
www.ahrq.gov/talkingquality/translate/compare/explain.html
March 01, 2016 - However, evidence from cognitive testing of the Agency for Healthcare Research and Quality (AHRQ) Quality … QI_Reporting/Model_Report_Composite.pdf
The developers of a model report for the AHRQ Quality Indicators did cognitive … testing of a data display that included a note regarding averages right underneath the bar graph. … example above shows how that can be done with two simple sentences which have been subjected to rigorous cognitive … The approach shown on this page was adopted for the cognitive testing of the AHRQ Quality Indicator Model
-
www.ahrq.gov/diagnostic-safety/resources/issue-briefs/dxsafety-cognitive-load5.html
May 01, 2024 - Load
Interplay Between Cognitive Load and Diagnostic Accuracy
Measures of Cognitive Load
A Future … Human factors engineers and system usability testing can create technology that decreases clinician cognitive … closely with frontline clinicians during the development of new technology to ensure adequate system testing … Major technology changes (e.g., EHR updates) should undergo system usability and cognitive load testing … and germane cognitive processing.
-
www.ahrq.gov/cahps/surveys-guidance/cg/about/Develop-CG-Surveys.html
May 01, 2022 - Cognitive testing. … In the spring of 2005, the CAHPS team conducted cognitive interviews in Massachusetts and California … Field testing. … Cognitive testing of items that refer to "your provider" rather than "your doctor". … While the CAHPS team has conducted testing of the wording, further testing, including field testing,
-
www.ahrq.gov/cahps/surveys-guidance/hp/about/Development-CAHPS-HP-Survey.html
May 01, 2022 - feedback from industry experts, reports from sponsors, vendors, and other users, and evidence from cognitive … testing and focus groups. … Cognitive testing. … testing of the Health Plan Survey with consumers. … Field testing.
-
www.ahrq.gov/cahps/surveys-guidance/nh/resident/Development-Resident-Surveys.html
April 01, 2018 - Cognitive testing of survey questions. … The next step in the development process was cognitive testing of the draft questionnaires with nursing … Cognitive testing is a way to ensure that residents can understand and answer the questions as intended … Field testing. … testing.
-
www.ahrq.gov/cahps/surveys-guidance/item-sets/PCMH/Development-PCMH-Survey.html
November 01, 2020 - Cognitive testing (English and Spanish). … In August 2010, the CAHPS team conducted cognitive testing of draft questionnaires that incorporated … The testing was done with both adults and children in English and Spanish. … A second round of cognitive testing was completed in the spring of 2011. … The team revised the draft questionnaires based on the findings from the cognitive interviews.
-
www.ahrq.gov/patient-safety/settings/long-term-care/resource/hcbs/report/apiii.html
June 01, 2010 - Cognitive testing.
Field testing.
TEP/other advisory.
Consensus development process. … Cognitive Testing (Y/N).
Cognitive Testing Results.
Field Testing.
Field Testing Results. … Other Psychometric Testing.
Other testing. … : Development included focus group, cognitive testing, and field testing; further testing planned … a Technical Expert Panel, several rounds of cognitive testing, and field testing in Massachusetts and
-
www.ahrq.gov/cahps/surveys-guidance/hospital/about/dev_child_hp_survey.html
April 01, 2020 - Cognitive testing . … The team conducted 109 in-depth cognitive interviews in Boston, Los Angeles, Miami, and St. … Pilot testing . … Field testing . … End-user testing.
-
www.ahrq.gov/cahps/surveys-guidance/develop-outpatient-mental-health-surveys.html
August 01, 2024 - Based on that information, the team revised the survey and conducted additional rounds of cognitive testing … Inc (Chicago, IL) to conduct cognitive interviews in Spanish. … Using findings from the focus groups and cognitive interviews, several iterations of the survey were … Field testing. … Due to logistical challenges related to finding partners for field testing, the team conducted multiple
-
digital.ahrq.gov/ahrq-funded-projects/understanding-primary-care-teamwork-context-implications-health-information
January 01, 2023 - We lack digital healthcare tools that provide cognitive support to primary care clinicians. … To identify the cognitive work requirements as part of the first aim, the research team used a cognitive … The second aim of testing EHR designs required in-person and online design sessions among primary care … End-user testing was performed for clinician feedback to determine an appropriate EHR design to facilitate … Positive results and feedback from the Tandem EHR end-user testing suggests that such technical support
-
www.ahrq.gov/cahps/surveys-guidance/item-sets/HIT/Development-HIT-Item-Set.html
July 01, 2022 - Those priorities determined which items were selected for cognitive testing.
Site interviews. … Cognitive testing. … After two rounds of cognitive testing, the team incorporated the findings into an item set that was used … for field testing. … Field testing.
-
www.ahrq.gov/talkingquality/explain/index.html
June 01, 2019 - Testing Is Essential
While this section offers many suggestions about how to explain quality information … The most appropriate method to use is cognitive interviewing, in which you spend 60 to 90 minutes going … You can also use cognitive testing to explore alternative ways of talking about a particular issue, to … Finally, use testing to make sure that your language and message do not offend your consumer audience … Learn more about The Purpose and Process of Cognitive Testing .
-
www.ahrq.gov/talkingquality/plan/needs-and-testing/index.html
May 01, 2019 - What Testing Can Tell You
At its best, testing at the developmental stage (sometimes referred to as … The Basics of the Audience Testing Process
Define Your Objectives
Before you initiate testing with … The most effective way to do this is a technique called cognitive interviewing, where you probe a small … Some testing is almost always better than none at all. … Learn more about The Purpose and Process of Cognitive Testing .
-
psnet.ahrq.gov/issue/cognitive-errors-diagnosis-instantiation-classification-and-consequences
June 21, 2016 - Cognitive errors in diagnosis: instantiation, classification, and consequences. … as well as context for development of cognitive biases. … The authors conclude that cognitive errors lead to serious morbidity. … Cognitive errors in diagnosis: instantiation, classification, and consequences. … November 30, 2012
View More
Related Resources
Testing and improving
-
www.ahrq.gov/cahps/surveys-guidance/item-sets/elicitation/child-hospital-narratives/development.html
December 01, 2023 - Pilot testing of the draft items . … testing. … Cognitive testing. … To ensure that respondents understand and interpret the items as intended, the team conducted cognitive … This testing was completed in late summer of 2022.
-
www.ahrq.gov/cahps/surveys-guidance/nh/family/development-family-member-survey.html
April 01, 2019 - questionnaires and items received in response to that notice, the team prepared a draft instrument for testing … Cognitive testing of survey questions. … In 2005 and 2006, the items in this instrument went through two rounds of cognitive testing with people … Field testing.
-
digital.ahrq.gov/sites/default/files/docs/citation/r01hs022505-wetterneck-final-report-2020.pdf
January 01, 2020 - We made further prototype changes to end user feedback from testing
sessions. … mtgs, paper/PPT
designs, software programming
User testing (45 hours)
Analysis of user testing … time (three pages were completed after user testing). … Pilot testing of scripts was completed. … new designs
underwent subsequent testing in future sessions.