Stopping Rules

Stopping rules determine when a computer adaptive test (CAT) stops administering items to a respondent.

Types of Stopping Rules

 

CATs can utilize multiple rules to determine when a CAT should stop. These include:

  • Minimum number of items to be administered
  • Maximum number of items to be administered
  • Standard error below a specific threshold
  • Standard error change
  • Endorse extreme responses to first item(s)

PROMIS CAT Stopping Rules

 

Adult1:

  • Minimum number of items administered = 4
  • Stop when one of these occurs:
    • 12 items are administered OR
    • The standard error is below a threshold (0.3 on the theta metric or 3.0 on the T-score metric)

1The following Adult CAT administers a maximum number of 10 items:

  • PROMIS Item Bank v2.0 – Pain Behavior

 

 Adult “Recommended” CATs:

  • Minimum number of items administered = 4
  • Stop when one of these occurs:
    • 8 items are administered OR
    • The standard error is below 0.3 on the theta metric (3.0 on the T-score metric) OR
    • The standard error changes by less than 0.01 on the theta metric (0.1 on the T-score metric)

 

Adult “Screen-to-CAT”:

  • If the response to the first item is the “healthiest” response, then stop.
  • If the response to the first item is NOT the “healthiest” response, proceed with the “Recommended” CAT stopping rules.

 

Pediatric2 (age 8-17) and Parent Proxy2 (ages 5-17):

  • Minimum number of items administered = 5
  • Stop when one of these occurs:
    • 12 items are administered OR
    • The standard error is below a threshold (0.4 on the theta metric or 4.0 on the T-score metric)

2The following Pediatric and Parent Proxy CATs administer a minimum number of 4 items:

  • PROMIS Pediatric Bank v1.0 – Family Relationships
  • PROMIS Parent Proxy Bank v1.0 – Family Relationships
  • PROMIS Pediatric Bank v1.0 – Cognitive Function (also uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Parent Proxy Bank v1.0 – Pediatric Stigma (also stops when 8 items are administered and uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Parent Proxy Bank v1.0 – Pediatric Stigma – Skin (also stops when 8 items are administered and uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Parent Proxy Bank v1.1 – Cognitive Function (also uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Pediatric Bank v1.1 – Pediatric Stigma (also stops when 8 items are administered and uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Pediatric Bank v1.1 – Pediatric Stigma – Skin (also stops when 8 items are administered and uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Pediatric Bank v2.0 – Pain Quality (also uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Pediatric Bank v1.0 – Sleep-Related Impairment (also uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)
  • PROMIS Parent Proxy Bank v1.0 – Sleep-Related Impairment (also uses standard error < 0.3 on the theta metric or 3.0 on the T-score metric)

 

Pediatric (age 8-17) and Parent Proxy (ages 5-17) “Recommended” CATs:

  • Minimum number of items administered = 5
  • Stop when one of these occurs:
    • 12 items are administered OR
    • The standard error is below a threshold (0.4 on the theta metric or 4.0 on the T-score metric) OR
    • The standard error changes by less than 0.01 on the theta metric (0.1 on the T-score metric)

 

Pediatric (age 8-17) and Parent Proxy (ages 5-17) “Screen-to-CAT”:

  • If the response to the first two items are both the “healthiest” responses, then stop.
  • If the responses to the first two items are both NOT the “healthiest” responses, proceed with the “recommended” CAT stopping rules.

 

Early Childhood Parent-Report (ages 1-5):

  • Minimum number of items administered = 4
  • Stop when one of these occurs:
    • 8 items are administered OR
    • The standard error is below a threshold (0.4 on the theta metric or 4.0 on the T-score metric)

Neuro-QoL2 CAT Stopping Rules 

 

Adult and Pediatric (age 8-17):

  • Minimum number of items administered = 4
  • Stop when one of these occurs:
    • 12 items are administered OR
    • The standard error is below a threshold (0.3 on the theta metric or 3.0 on the T-score metric) 

2The Neuro-QoL Pediatric Bank v1.0 – Stigma CAT administers a maximum of 8 items

ASCQ-Me CAT Stopping Rules

 

Emotional Impact:

  • Minimum number of items administered = 3
  • Stop when one of these occurs:
    • 20 items are administered OR
    • The standard error is below a threshold (0.2 on the theta metric or 2.0 on the T-score metric)

 

Pain Impact:

  • Minimum number of items administered = 3
  • Stop when one of these occurs:
    • 13 items are administered OR
    • The standard error is below a threshold (0.2 on the theta metric or 2.0 on the T-score metric)

 

Sleep Impact:

  • Minimum number of items administered = 3
  • Stop when one of these occurs:
    • 12 items are administered OR
    • The standard error is below a threshold (0.2 on the theta metric or 2.0 on the T-score metric)

 

Social Functioning Impact:

  • Minimum number of items administered = 3
  • Stop when one of these occurs:
    • 17 items are administered OR
    • The standard error is below a threshold (0.2 on the theta metric or 2.0 on the T-score metric)

 

Stiffness Impact:

  • Minimum number of items administered = 3
  • Stop when one of these occurs:
    • 15 items are administered OR
    • The standard error is below a threshold (0.2 on the theta metric or 2.0 on the T-score metric)

 

Last updated on 9/6/2024