Results

Total Results: 28 records

Showing results for "cognitive testing".

1. PC CDS Planning, Implementation, and Reporting User Guide (pdf file)
   cdsic.ahrq.gov/sites/default/files/2024-09/Final_MO%20PC%20CDS%20User%20Guide%20(1)_0_0.pdf
   January 01, 2024 - , technical acceptability testing, and initial usability testing. … report if they conducted activities related to assessing usability of the designed tool, including cognitive … • Results of cognitive task load assessments. … • Approaches used to conduct PC CDS prototype testing (number of testing rounds, testing participants … Working minds: A practitioner's guide to cognitive task analysis.

2. PC CDS Planning, Implementation, and Reporting Checklist (pdf file)
   cdsic.ahrq.gov/sites/default/files/2024-09/Final_MO%20PC%20CDS%20Planning%20and%20Reporting%20Tool_0.pdf
   January 01, 2024 - Results of cognitive task load assessments. … Patient-Centered Activities Patient participation in PC CDS co-design and cognitive task load assessments … used to conduct PC CDS prototype testing (number of testing rounds, testing participants, social … acceptability testing, etc.). … Patient-Centered Activities Patient involvement in prototype testing and social acceptability testing

3. Scaling, Measurement, and Dissemination of CDS Workgroup: PC CDS Planning, Implementation, and Reporting Checklist (pdf file)
   cdsic.ahrq.gov/sites/default/files/2023-08/Checklist_SMD%20Planning%20Implementation%20Reporting_508fillable.pdf
   January 01, 2023 - Results of cognitive task load assessments. … Patient participation in PC CDS co-design and cognitive task load assessments. … Approaches used to conduct PC CDS prototype testing, the number of rounds of testing performed, who … Patient involvement in prototype testing and social acceptability testing. … Address the Patient-Centered Implementation Activities "Patient participation in PC CDS co-design and cognitive

4. PAIGE Chatbot For Patient-Clinician Communication: (pdf file)
   cdsic.ahrq.gov/sites/default/files/2024-09/PAIGE%20Assessment%20Report_Public%20Version.pdf
   January 01, 2024 - o PAIGE reduced the cognitive burden on patients to know what information and symptoms to provide to … o While PAIGE reduced cognitive burden, it may not reduce time to communicate with clinicians. … insight into the specific features of AI-based chatbots that will enable them to save time and reduce cognitive … More Patient Testing. … said, one clinician reported that PAIGE has the potential in the meantime to decrease clinicians’ cognitive

5. Implementation, Adoption, and Scaling Workgroup: Landscape Assessment on the Use of Artificial Intelligence To Scale PC CDS (pdf file)
   cdsic.ahrq.gov/sites/default/files/2024-07/Final%20IAS_AI%20Landscape%20Assessment%206.24.24%20(003).pdf
   January 01, 2024 - One organization is conducting pilot testing of ambient documentation with over 100 providers, targeting … For example, developers can conduct user experience and human factors testing with patients during the … in the following area: • Approaches for expanding involvement of patients in the development and testing … processes and decision making, research is needed in the following areas: • Identification and testing … With continued testing and evaluation of AI-based PC CDS, along with sufficient regulatory guardrails

6. CDSiC Innovation Center: Quarterly Report (pdf file)
   cdsic.ahrq.gov/sites/default/files/2023-06/InnovationCenterQ12023ProgressReportDraft.pdf
   January 01, 2023 - Data visualization techniques can lead to a more effective decision-making process by reducing cognitive … and availability, the design of visualizations, level of user experience and expertise, individual cognitive … This testing was done according to Nielson’s 10 usability heuristics: 1) Visibility of system status … After completing heuristic testing, the team presented a demonstration of the prototypes to AHRQ and … The team will ultimately develop a report describing the findings from the testing.

7. Scaling, Measurement, and Dissemination of CDS Workgroup: PC CDS Planning, Implementation, and Reporting User Guide (pdf file)
   cdsic.ahrq.gov/sites/default/files/2023-08/User%20Guide_SMD%20Planning_%20Implementation_%20Reporting_508.pdf
   January 01, 2023 - about the tool to address in future implementation plans.29,38 Additionally, implementers may conduct cognitive … patients.42 Implementers should describe the extent to which patients participated in co-design and cognitive … formative evaluations in simulated settings with comparisons to business-as-usual, end-user cognitive … Implementers should conduct activities related to assessing usability of the designed tool, including cognitive … Working minds: A practitioner's guide to cognitive task analysis. Mit Press; 2006 Jul 7.

8. PC CDS Performance Measurement Inventory (xls file)
   cdsic.ahrq.gov/sites/default/files/2023-09/SMD%20PC%20CDS%20Performance%20Measurement%20Inventory_FINAL_9.19.23.xlsx
   January 01, 2023 - Use Clinician workflow integration Cognitive workload/cognitive burden of tool (objective) Objective … A Review of Measuring the Cognitive Workload of Electronic Health Records. … Use Clinician workflow integration Cognitive workload/cognitive burden of tool (subjective) The amount … A Review of Measuring the Cognitive Workload of Electronic Health Records. … Video recording of end user testing/use 3.

9. Exploring How Artificial Intelligence (AI) Can Enhance Patient-Centered Clinical Decision Support | CDSiC
   cdsic.ahrq.gov/cdsic/AI-viewpoint
   February 25, 2025 - Testing AI-supported PC CDS in the real world. … development and support of PC CDS; complementing direct or immediate clinician interaction; supporting cognitive … Testing AI-supported PC CDS in the Real World Few studies have explored the deployment and use of PC … Additionally, further usability testing with patients with limited digital and/or health literacy is … Currently, the CDSiC is conducting real-world testing of the Quartz app in a healthcare system to assess

10. Trust & Patient-Centeredness Workgroup: An Introductory Handbook for Patient Engagement Throughout the Patient-Centered Clinical Decision Support Lifecycle (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-10/TPC%20Pat%20Engage%20Handbook%20Final.pdf
    January 01, 2023 - • Patient Pilot Testing. … Usability Testing Essentials: Ready, Set… Test! Elsevier Inc. 2011. … Qualitative Usability Testing: Study Guide. Accessed July 31, 2023. … A new app for at-home cognitive training: description and pilot testing on patients with multiple sclerosis … Development and initial cognitive testing of the Digital Equity Screening Tool (DEST): Community participatory

11. CDSiC Innovation Center Quarterly Report (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-05/InnovationCenterQ4ProgressReportFinalForDTPFINAL.pdf
    January 01, 2023 - Data visualization techniques can lead to a more effective decision-making process by reducing cognitive … and availability, the design of visualizations, level of user experience and expertise, individual cognitive … The team then conducted a first round of heuristic usability testing according to Nielson’s 10 usability

12. CDSiC Innovation Center: Quarterly Report (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-08/Innovation%20Center%20Q2%202023%20Progress%20Report.pdf
    January 01, 2023 - Data visualization techniques can lead to a more effective decision-making process by reducing cognitive … and availability, the design of visualizations, level of user experience and expertise, individual cognitive … In April, the team developed a report describing the findings from the Q2 think-aloud testing and a … In Q2 of 2023, the team completed the usability testing of the clinician and patient app prototypes.

13. Measurement and Outcomes Workgroup: Inventory of Patient Preference Measurement Tools for PC CDS Report (pdf file)
    cdsic.ahrq.gov/sites/default/files/2025-03/Final_MO_Patient%20Preference%20Report_6.7.24.pdf
    January 01, 2025 - Cognitive interviewing Structural validity Assesses whether scores of a scale adequately reflect … preferences and a second elicits communication preferences for more information about the validity testing … While some of the instruments included in the Inventory mention conducting cognitive testing, most of … e.g., screening tests, genetic tests, follow up) • Return of results (e.g., receipt of genetic testing … Characteristics PROMIS PROMIS-Preference Summary score (calculated from the following PROMIS domains: cognitive

14. MO Patient Preference Inventory (xls file)
    cdsic.ahrq.gov/sites/default/files/2025-03/Copy%20of%20Final_MO_Patient%20Preference%20Inventory_6.7.24_508.xlsx
    January 01, 2025 - of the outcomes as either most or least important (kappa .28-1.0) Yes Face validity assessed using cognitive … Oncology No N/A No N/A Patient preferences developed through qualitative interviews and focus groups; cognitive … testing performed.

15. Scaling, Measurement, and Dissemination Workgroup: (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-09/SMD%20PC%20CDS%20Performance%20Measurement%20Inventory%20User%20Guide_FINAL_9.19.23.pdf
    January 01, 2023 - information seeking,32 and impact on workflows such as changes in consultation time.46 Measures of cognitive … Measuring Cognitive Workload. … Measure constructs to assess alert fatigue were alert appropriateness,47 cognitive overload,50 think … EHR data: Time interval between appearance of the alert and completion of the selected actions Cognitive … analysis” [Mesh] OR Randomized controlled Trials as Topic OR “Program Evaluation” [Mesh] OR “user testing

16. Scaling, Measurement, and Dissemination of CDS Workgroup: Approaches to Measuring Patient-Centered CDS Workflow and Lifeflow Impact Executive Summary (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-08/Exec%20Sum_SMD%20Workflow%20Measurement%20Approaches%20Report%20to%20AHRQ%208.9.23_508.pdf
    January 01, 2023 - Mental workload The cognitive load or burden associated with using the PC CDS tool or changes in user-rated … cognitive load/burden when completing a workflow task or activity as a result of using the PC CDS tool … Measures Cognitive Workload: Clinician cognitive workload is not measured with high validity across … Related concepts of alert fatigue and desensitization can be used as proxy measures of cognitive workload … A review of measuring the cognitive workload of electronic health records.

17. Trust and Patient-Centeredness Workgroup: Patient and Caregiver Perspectives on Generative Artificial Intelligence in Patient-Centered Clinical Decision Support (pdf file)
    cdsic.ahrq.gov/sites/default/files/2024-07/OY1_FINAL%20TPC%20Patient%20Perspectives%20Generative%20AI.pdf
    January 01, 2024 - ensure understanding of the terms and concepts described in the guide, we conducted three virtual cognitive … generative AI-based PC CDS tools on trust and patient–provider relationships, especially post-pilot testing … To refine the discussion guide, we conducted three 60-minute virtual cognitive debriefings with patient … During the cognitive debriefing sessions, we prompted participants to respond to each discussion guide … Cognitive debriefing participants also provided feedback on a background document on PC CDS and AI that

18. Scaling, Measurement, and Dissemination of CDS Workgroup: Approaches to Measuring Patient-Centered CDS Workflow and Lifeflow Impact (pdf file)
    cdsic.ahrq.gov/sites/default/files/2023-08/SMD%20Workflow%20Measurement%20Approaches%20Report_to%20AHRQ%208.9.23_508.pdf
    January 01, 2023 - cognitive load/burden when completing a workflow task or activity as a result of using the PC CDS tool … Measures Cognitive Workload: Clinician cognitive workload is not measured with high validity across … Related concepts of alert fatigue and desensitization can be used as proxy measures of cognitive workload … Cognitive Informatics for Biomedicine. 2015;:111–40. 24 Davis FD, Bagozzi RP, Warshaw PR. … A review of measuring the cognitive workload of electronic health records.

19. Implementation, Adoption, and Scaling Workgroup: Exploring Challenges and Opportunities for Patient Engagement, Implementation, Adoption, and Scaling Through PC CDS Case Studies (pdf file)
    cdsic.ahrq.gov/sites/default/files/2024-09/Final%20IAS%20PC%20CDS%20Case%20Studies%20Report_2.pdf
    January 01, 2024 - Insufficient Functionality in EHR Testing Environments. … environment, which limited their ability to fully conduct integration testing. … For one project, this review took the form of cognitive psychology experts who could elicit user feedback … Enhance Infrastructure for PC CDS Integration Testing. … ASTHMAXcel PRO patient satisfaction and usability field testing.

20. CDSiC Stakeholder Center Progress Report (pdf file)
    cdsic.ahrq.gov/sites/default/files/2024-07/CDSiC%20Stakeholder%20Center%20Quarterly%20Report%20Q2%202024_7.18.24.pdf
    January 01, 2024 - direct/immediate clinician interaction, 4) facilitate sharing and replication of PC CDS, and 5) support cognitive … First, the Workgroup completed three usability testing sessions with external experts to further refine