This website is for US healthcare professionals

close-icon

Log In to Bolder Science

or

Don't have an account? Sign Up

close-icon

Please enter your email address.

You will receive a link to create a new password via email.

Log In

close-icon

Create an Account

or
  • 8 characters minimum
  • First character may not be a number
  • Last character may not be a number
close-icon

Welcome and thank you for creating an account!

At Bolder Science, we want your clinical trial search experience to be the best it can be. Complete the following prompts to easily find the trials you are interested in and see trials recruiting near you. You can adjust these selections in your dashboard after creating your account.

Condition Categories

Condition categories are pulled directly from ClinicalTrials.gov. Choose 1 or more condition categories that you are interested in:

Clinical Trials of Interest

When I’m looking for information on clinical trials, I usually am interested in...

Set a default location

Do Script Concordance Tests Correlate With Family Medicine Standardized Tests and Failing Rotation Grades?

  • Clinicaltrials.gov identifier

    NCT03938610

  • Recruitment Status

    Recruiting

  • First Posted

    May 6, 2019

  • Last update posted

    July 23, 2020

Study Description

Brief summary:

Delayed or poor identification and remediation of clinical reasoning difficulties can lead to clinician underperformance and can ultimately compromise patient care. To date, no research has been done to see if SCTs correlate with current grading standards (ITE, ABFM certification exam score, ACGME milestones, or failing clinical rotation grades) in Family Medicine Residents. If investigators can identify that an SCT correlates with current standardized testing of Family medicine residents, it could be possible to identify struggling learners prior to poor scores on the ITE, ACGME milestones, or clinical rotations. If a learner does poorly on an SCT early in the academic year the learner can begin a remediation plan to improve their deficits before receiving a failing grade, poor ITE or ACGME milestone scores.

  • Condition or Disease:Knowledge, Attitudes, Practice
  • Intervention/Treatment:
  • Phase: N/A

Detailed Description

This study is a longitudinal observation study. A panel of experts (numbering 15-20) consisting of Family Medicine attendings who have been out of residency greater than 3 years will complete the SCT. They will be provided an Informational Consent. Their willingness to be a panel member is their implied consent to be part of the research study. The basic idea behind SCT is to compare residents' performance with a group of persons who are representatives of the profession (or the specialty) to which they wish to belong. Therefore, panels are made up of physicians with good overall clinical experience in the field rather than experts from narrow parts of the field. Panel composition also depends on the assessment goal. This study will determine if a Script Concordance Test (SCT) correlates with Family Medicine In Training Exam (ITE) scores, American Board of Family Medicine (ABFM) certification exam scores, Accreditation Council for Graduate Medical Education (ACGME) medical knowledge and patient care milestones, and failing family medicine inpatient clinical rotation grades. The SCT will be given to PGY1, 2, and 3 residents each year during the Residents three year residency, in June or July.

Study Design

  • Study Type: Observational
  • Estimated Enrollment: 130 participants
  • Observational Model: Cohort
  • Time Perspective: Prospective
  • Official Title: Do Script Concordance Tests Correlate With Family Medicine Standardized Tests and Failing Rotation Grades?
  • Actual Study Start Date: June 2019
  • Estimated Primary Completion Date: June 2024
  • Estimated Study Completion Date: June 2024

Outcome Measures

  • Primary Outcome Measures: 1. SCT scores compared to ITE scores [ Time Frame: year 1 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 2. SCT scores compared to ITE scores [ Time Frame: year 2 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 3. SCT scores compared to ITE scores [ Time Frame: year 3 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 4. SCT scores compared to ABFM scores [ Time Frame: year 1 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 5. SCT scores compared to ABFM scores [ Time Frame: year 2 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 6. SCT scores compared to ABFM scores [ Time Frame: year 3 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 7. SCT scores compared to family medicine rotation grades [ Time Frame: year 1 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 8. SCT scores compared to family medicine rotation grades [ Time Frame: year 2 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 9. SCT scores compared to family medicine rotation grades [ Time Frame: year 3 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 10. SCT scores compared to ACGME milestones. [ Time Frame: year 1 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 11. SCT scores compared to ACGME milestones. [ Time Frame: year 2 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 12. SCT scores compared to ACGME milestones. [ Time Frame: year 3 ]
    SCT scores, ranging from 0 to 100 percent, are longitudinal and will be recorded for all PGY1, 2, and 3 subjects enrolled in the study each year of their residency in June or July.
  • 13. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones. [ Time Frame: year 1 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 14. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones. [ Time Frame: year 2 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 15. Binomial SCT classification derived from each interval SCT scores compared to ACGME milestones. [ Time Frame: year 3 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 16. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades. [ Time Frame: year 1 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 17. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades. [ Time Frame: year 2 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 18. Binomial SCT classification derived from each interval SCT scores compared to family medicine rotation grades. [ Time Frame: year 3 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 19. Binomial SCT classification derived from each interval SCT scores compared to ITE [ Time Frame: year 1 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 20. Binomial SCT classification derived from each interval SCT scores compared to ITE [ Time Frame: year 2 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 21. Binomial SCT classification derived from each interval SCT scores compared to ITE [ Time Frame: year 3 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 22. Binomial SCT classification derived from each interval SCT scores compared to ABFM [ Time Frame: year 1 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 23. Binomial SCT classification derived from each interval SCT scores compared to ABFM [ Time Frame: year 2 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".
  • 24. Binomial SCT classification derived from each interval SCT scores compared to ABFM [ Time Frame: year 3 ]
    A "fail" classification is defined as an SCT score 1 SD below the respective PGY mean. All other SCT scores will be classified as "pass".

Eligibility Criteria

  • Ages Eligible for Study: (Child, Adult, Older Adult)
  • Sexes Eligible for Study: All
  • Accepts Healthy Volunteers: No
  • Sampling Method: Non-Probability Sample
  • Study Population: Family medicine residents at 99MDG

Criteria

**Patients must be able to get care at Nellis Air Force Base (a military installation) in
order to participate in this study**

Inclusion Criteria:

--Family Medicine resident at 99MDG

Exclusion Criteria:

-- N/A

Contacts and Locations

Contacts

Contact: Jill M Clark, MBA 7026533298 Jill.M.Clark15.ctr@mail.mil

Locations

United States, Nevada
Mike O'Callaghan Military Medical Center
Las Vegas

Sponsors and Collaborators

Pamela Hughes

Investigators

Study Director: Paul F Crawford, MD US Air Force

More Information