AHRQ Search | Home Page

Implementation, Adoption, and Scaling Workgroup: Landscape Assessment on the Use of Artificial Intelligence To Scale PC CDS (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-07/Final%20IAS_AI%20Landscape%20Assessment%206.24.24%20(003).pdf

January 01, 2024 - clinicians should review all information gathered between visits by AI chatbots for completeness and accuracy … Clinicians should always doublecheck and review AI-generated recommendations for accuracy and relevance … 100 providers, targeting users who are less technologically savvy to improve their efficiency and accuracy … Clinicians should always doublecheck and review AI-generated recommendations for accuracy and relevance … AI-generated clinical summaries require more than accuracy. JAMA.

Scaling, Measurement, and Dissemination of CDS Workgroup: PC CDS Planning, Implementation, and Reporting Checklist (pdf file)

cdsic.ahrq.gov/sites/default/files/2023-08/Checklist_SMD%20Planning%20Implementation%20Reporting_508fillable.pdf

January 01, 2023 - Report on the Accuracy, Availability, and Validation of Data used Within the PC CDS Task Addressed … Approaches used to improve or validate PC CDS accuracy. … delivered to the patient at the right time, in the right format: ": Was the task "Report on the Accuracy … and Validation of Data used Within the PC CDS" addressed: Off Who Addressed the task "Report on the Accuracy … Within the PC CDS": Describe How You Will (or Did) Address the Implementation Task "Report on the Accuracy

Patient Preferences Are Essential to Bringing the Patient Into Focus (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-09/CDSiC%20Infographic%202024_508_0.pdf

January 01, 2024 - patient preferences around access and use of personal health data and enhances the relevance and accuracy

Trust & Patient-Centeredness Workgroup: Improving the Source Credibility of Patient-Centered Clinical Decision Support Tools (pdf file)

cdsic.ahrq.gov/sites/default/files/2023-08/Final%20TPC%20P3_Source%20Credibility%20to%20AHRQ%208.2.23_508c%20Version.pdf

January 01, 2023 - PC CDS Source Credibility Attributes • Accuracy • Consistency • Objectivity • Reliability • … Glossary of PC CDS Source Credibility Attributes Attribute Relevance to PC CDS Accuracy In PC CDS … Accuracy refers to the quality or scientific validity, correctness, or completeness of information. … Diagnostic accuracy measures. … Measures of Diagnostic Accuracy: Basic Definitions.

PC CDS Performance Measurement Inventory (xls file)

cdsic.ahrq.gov/sites/default/files/2023-09/SMD%20PC%20CDS%20Performance%20Measurement%20Inventory_FINAL_9.19.23.xlsx

January 01, 2023 - Design Information quality Alert accuracy Alert sensitivity (e.g., sensitivity of correct diagnosis) … Design Information quality Alert accuracy Alert specificity (e.g., specificity of recommended care) … Design Information quality Alert accuracy Number of false positive alerts Alerts Outcome Summative System … Design Information quality Alert accuracy Positive predictive value Alerts Outcome Summative System … Quantitative Assessed by comparing the accuracy of clinician's recorded preventive care metrics that

Scaling, Measurement, and Dissemination Workgroup: (pdf file)

cdsic.ahrq.gov/sites/default/files/2023-09/SMD%20PC%20CDS%20Performance%20Measurement%20Inventory%20User%20Guide_FINAL_9.19.23.pdf

January 01, 2023 - The measures included in the Inventory related to software performance include data retrieval accuracy … laboratory data, pharmacy system data) needed as an input for the decision support logic,15 and the accuracy … logic.18 Researchers commonly use measures of alert sensitivity and specificity to assess clinical accuracy … Researchers also reported measuring alert currency and the accuracy of the studied decision support … Measuring Algorithm Accuracy.

Trust and Patient-Centeredness Workgroup: Improving the Source Credibility of Patient-Centered Clinical Decision Support Tools | CDSiC

cdsic.ahrq.gov/cdsic/source-credibility

July 01, 2023 - of attributes salient for PC CDS and thus most likely to impact source credibility, including: Accuracy

CDSiC Innovation Center: Quarterly Report (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-07/Innovation%20Center%20Q2%202024%20Progress%20Report.pdf

January 01, 2024 - The aim is to improve accuracy and efficiency in patient- clinician communication by using a chatbot … the interactions from the patient interviews and asked clinicians to rate the appropriateness and accuracy

PAIGE Chatbot For Patient-Clinician Communication: (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-09/PAIGE%20Assessment%20Report_Public%20Version.pdf

January 01, 2024 - clinicians to independently rate their agreement regarding the appropriateness, completeness, utility, accuracy … clinicians to independently rate their agreement regarding the appropriateness, completeness, utility, accuracy … They noted that this would enable family members or caregivers to review the summary for accuracy, which … clinicians were asked to rate their agreement with statements about the appropriateness, completeness, accuracy … On average, clinicians agreed most with the statement about accuracy, i.e., that the PAIGE summaries

PC CDS Planning, Implementation, and Reporting Checklist (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-09/Final_MO%20PC%20CDS%20Planning%20and%20Reporting%20Tool_0.pdf

January 01, 2024 - Report on the Accuracy, Availability, and Validation of Data Used within the PC CDS Task Addressed … Approaches used to improve or validate accuracy.

CDSiC Innovation Center: Quarterly Report (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-09/Innovation%20Center%20Q3%202024%20Progress%20Report.pdf

January 01, 2024 - The aim is to improve the accuracy and efficiency of patient-clinician communication by using a chatbot … that describes findings from patient interviews and clinician surveys on the utility, relevance, and accuracy

Trust and Patient-Centeredness Workgroup: Action Plan to Collect and Use Social Determinants of Health Data in Patient-Centered Clinical Decision Support (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-09/AHRQ%20Final%20TPC%20SDOH%20Action%20Plan.pdf

January 01, 2024 - ................................................................ 24 3.1 Mitigate Bias and Improve Accuracy … two overarching considerations that impact efforts in this area. 3.1 Mitigate Bias and Improve Accuracy … such as large language models (generative artificial intelligence) have the potential to limit the accuracy … Therefore, proactive approaches to mitigate bias and promote accuracy of algorithms employed by PC CDS … Additional Considerations 3.1 Mitigate Bias and Improve Accuracy of Artificial Intelligence Algorithms

OY2 Innovation Center Operational Framework (pdf file)

cdsic.ahrq.gov/sites/default/files/2024-12/OY2%20Innovation%20Center%20Operational%20Framework_508.pdf