-
effectivehealthcare.ahrq.gov/sites/default/files/grading.ppt
January 01, 2013 - Scoring
Reviewers in the Evidence-based Practice Centers (EPCs) should take specific steps to ensure reliability … The third step is to develop an explicit procedure for ensuring a high degree of interrater reliability … In addition, EPC reviewers should assess the resulting interrater reliability for each domain. … Although EPC reviewers generally will not include the details of the reliability assessment in their … By documenting this information, EPC reviewers will be able to increase knowledge about the reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/cer-269-respectful-maternity-care-summary.pdf
January 01, 2024 - Executive Summary_Comparative Effectiveness Review No. 269: Respectful Maternity Care
Comparative Effectiveness Review
Number 269
Respectful Maternity Care
Dissemination and Implementation of Perinatal Safety Culture
To Improve Equitable Maternal Healthcare Delivery and Outcomes
Executive Summary
…
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/machine-learning-tools-appendix-c.xlsx
January 01, 2024 - from 200 until predictions are generated N 3 median (range) 0.9 0.82-0.93 0.95
: proportion missed = reliability … 1- reliability 0.72 1 Our screening approach saved time and may be suitable
-
effectivehealthcare.ahrq.gov/sites/default/files/cer-225-substance-abuse-adolescents-comments.pdf
May 21, 2020 - Affiliation
Section Comment Response
American
Psychological
Association (APA)
Methods Was inter-rater reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-guidance-grading-strength_methods.pdf
July 01, 2009 - Key Procedures
EPCs should also take specific steps to ensure reliability and transparency within their … The third step is to develop an explicit procedure for ensuring a high degree of inter-rater
reliability … In
addition, EPCs should assess the resulting inter-rater reliability for each domain. … Although EPCs
generally will not include the details of the reliability assessment in their CERs, they … By documenting this information, EPCs will be able to increase
knowledge about the reliability of the
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/mental-health-app-protocol-updated.pdf
January 01, 2018 - assessment, availability of
scientific evidence to support the intervention delivered by the app; reliability … Interrater
reliability between the two reviewers will be assessed and any discrepancies in the
application … Interrater reliability
between the two
reviewers will be
assessed and any
discrepancies in the
application
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/ankyloglossia_disposition-comments.pdf
May 04, 2015 - Also, what was
the reliability between reviewers for whether an article
should be retained? … More importantly, what was the
reliability for the quality assessment? … Page 26, Line 47: There is no reliability or validity when
parents report speech scores. … These tools also have been shown to have good
inter-rater reliability. … By the way, none of the
classification schemata have been tested for validity and
reliability.
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/TND_0332_07-29-2010.pdf
January 01, 2010 - What is the analytic validity (sensitivity, specificity, reproducibility, reliability) of tests
designed
-
effectivehealthcare.ahrq.gov/sites/default/files/wysiwyg/data-repository-reviews-charter-140305.pdf
June 01, 2012 - − SRDR can foster collaboration, transparency, and reliability
among
research groups
who contribute
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-guidance-harms_methods.pdf
November 01, 2008 - describes loss to followup.
45
When uncontrolled
studies do not meet these criteria, determining the reliability … The subsequent list
10
of quality criteria specific to harms was tested for reliability and face … them were subsequently proved to be
―clearly‖ correct.
66
However, the methods used to determine reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/methodsguide_chou_assessing_harms_when_comparing.pdf
November 01, 2008 - describes loss to followup.
45
When uncontrolled
studies do not meet these criteria, determining the reliability … The subsequent list
10
of quality criteria specific to harms was tested for reliability and face … them were subsequently proved to be
―clearly‖ correct.
66
However, the methods used to determine reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/cer-254-rural-telehealth-app-e.xlsx
January 01, 2021 - E1. ROB. RCTs
Table E-1. Risk of bias assessment: randomized controlled trials
Author, Year Randomization Adequate? Allocation Concealment Adequate? Eligibility Criteria Specified? Groups Similar or Controlled for Important Baseline Differences? Participants Analyzed in Groups Originally Assigned? Attrition Low and/…
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/bipolar-disorder-treatment_research-protocol.pdf
June 23, 2014 - diagnostic process assessment tool incorporates information on what diagnostic tools the
studies used, the reliability … (self-report, scales with lower validity,
reliability); not equivalent across
groups
Uncertain Could … symptoms
MINI, SADS-not
modified to meet
DSM-IV
SCID, SADS-
modified to meet
DSM-IV
Process
Reliability … and diagnosis (e.g.,
2nd rater reviews
taped interviews)
Consensus, no details Consensus with
reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/methods-report-machine-learning-screening.pdf
November 01, 2019 - 2019
ii
Key Messages
Purpose of project
For title and abstract screening, we explored the reliability … Key messages
• The reliability of the tools to automatically eliminate irrelevant records was highly … Evidence of their
reliability and usability may improve their acceptance within the SR community. … many freely), reviewers would benefit from understanding the
similarities and differences in their reliability … predictions may be leveraged by
review teams to optimize time savings while maintaining acceptable reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/updating-criteria-qdr-protocol.pdf
September 06, 2023 - are many
important issues to consider, including data availability and quality, the validity and
reliability … We
will also capture any information pertaining to required feasibility, reliability, and
validity
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/registries-guide_executive.pdf
April 01, 2007 - their importance for the integrity of
the registry and for the analysis of primary outcomes,
their reliability … is
an overview of key components of the design,
execution, and analysis of a registry that promote
reliability … additional
practices that have the potential to enhance scientific
rigor, and thus the validity and reliability … from validated
measures for patient-reported results or clinical rating scales—enhance accuracy and reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/pdf/rapid-reviews-end-user_white-paper.pdf
April 01, 2016 - To ensure reliability
of the coding structure, all themes and subthemes were reviewed with the larger … This places the responsibility for the reliability and
validity of the product in the hand of the producers
-
effectivehealthcare.ahrq.gov/sites/default/files/johnson_-ahrq-mcda-presentation.pdf
August 27, 2012 - Good validity and reliability for relatively simple trade-off
problems.
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/pqmp-protocol.pdf
April 01, 2014 - What is known about the reliability, validity, usability, and feasibility of screening and
followup … will look for studies that report on the following outcomes of interest: quality
measures and the reliability … outcomes or decreased disparities by race/ethnicity,
insurance type, or socioeconomic status; metrics for reliability
-
effectivehealthcare.ahrq.gov/sites/default/files/related_files/cer-207-ptsd-disposition-comments.pdf
May 17, 2018 - N/A
Peer Reviewer 2 Methods Yes, certainly its test-retest reliability in the population
sampled, … and reliability is among your criteria (although it
is not clear that this is test-retest reliability … , not, for
example Cronbach's alpha which is often erroneously
called "reliability"). … We did not include Cronbach’s alpha as a measure of
reliability. … Reliability and a priori naming of the
outcome
Peer Reviewer 3
Discussion
The discussion