Developmental-Behavioral Screening and Surveillance

Additional recommended knowledge

Weighing the right way

How to quickly check pipettes?

Don't let static charges disrupt your weighing accuracy

Background

Early detection of children with developmental-behavioral delays and disabilities is essential to making sure that those with difficulties receive the benefits of early intervention. Early intervention can prevent school failure, reduce the need for expensive special education services, is associated with graduating from high school, avoiding teen pregnancy and violent crime, becoming employed when an adult, etc. Recent research from Head Start showed that for every $1 spent on early intervention, society as a whole saves $17.00. In the US, early intervention is guaranteed under the Individuals with Disabilities Education Act (IDEA) beginning at birth.

Because almost all children receive health care, primary care providers (e.g., nurses, family medicine physicians, and pediatricians) are charged by their various professional societies, by the Centers for Medicare and Medicaid Services, the Centers for Disease Control, and by IDEA to search for difficulties and make needed referrals. So what are the methods used to detect children with difficulties and how effective are they?

Developmental-Behavioral Screening

Screening tools are brief measures designed to sort those who probably have problems from those who do not. Screens are meant to be used on the asymptomatic and are not necessary when problems are obvious. Screens do not lead to a diagnosis but rather to a probability of a problem. The kind of problem that may exist is generally not defined by a screening test. The screens used in primary care are generally broad-band in nature, meaning that they tap a range of developmental domains, typically expressive and receptive language, fine and gross motor skills, self-help, social-emotional, and for older children pre-academic and academic skills. In contrast, narrow-band screens focus only on a single condition such mental health problems, and may parse via factor scores, the probability, for example of depression and anxiety, versus attention deficits, versus disorders of conduct. Typically, broad-band screens are used first and may be the only type of measure used to make referrals in primary care, referrals which are then followed up by in—depth or diagnostic testing and often with narrow-band screens used along side them.

Screening measures require careful construction, research, and a high level of proof. High quality screens are ones that have been standardized (meaning administered in exactly the same way every time) on a large current (meaning in the last decade) nationally representative sample. Screens must be shown to be reliable (meaning that two different examiners get virtually the same results, and that measuring the same child over a short period of time, e.g., two weeks, returns nearly the same result). Screens must have proven validity, meaning that they are given along side lengthier measures and found to have a strong relationship (usually via correlations). Validity studies should also view which problems are detected (e.g., movement disorders, language impairment, autism spectrum disorder, learning disabilities).

But the acid test of a quality screen, and what sets apart the psychometry of screens from any other type of test, is proof of accuracy. This means that test developers must show proof of sensitivity, i.e., the percentage of children with problems detected, and specificity, meaning the percentage of children without problems who are identified usually with passing or negative test results. The standards for sensitivity and specificity are 70% to 80% at any single administration. While this may seem low, development is a moving target and repeated screening is needed to identify all in need. This also means that even quality screens make errors but, one study of four different screens showed that over-referrals (meaning children who fail screens but who are not found to be eligible for services upon more in-depth testing) are children with psychosocial risk factors and below average performance. This is helpful information for marshalling non-special education services, such as Head Start, after-school tutoring, Boys and Girls Clubs, parent training, etc. See The American Academy of Pediatrics’ Section on Developmental and Behavioral Pediatrics website for a description of quality measures and links to publishers. Screens are expensive to produce, translate, support, etc. and so all developmental screens are copyrighted products that much be purchased from publishers. However, most are inexpensive to deliver with time and material costs between $1.00 - $4.00 per visit.

Developmental-Behavioral Surveillance

Surveillance is the longitudinal process of getting “the big picture” of children’s lives and intervening in potential problems preferably before they develop. Surveillance includes eliciting and addressing parents’ concerns, and monitoring and addressing psychosocial risk factors that may deter development (e.g., limited parental education, more than 3 children in the home, single parenting, poverty, parental depression or other mental health problems, problematic parenting style such as not talking much with children, reading to them, etc.).

Surveillance involves the periodic use of broad-band developmental-behavioral screens but typically other kinds of measures are also deployed (preferably with quality tools enjoying psychometric support). Surveillance measures include tools eliciting and addressing parents’ concerns, measures of psychosocial risk, parenting style, autism spectrum disorder, mental health, etc. Some available measures offer both surveillance and screening via longitudinal tracking forms for monitoring issues and progress. A combination of surveillance and screening is recommended by the American Academy of Pediatrics in their July 2006 policy statemen.

So Do Developmental Surveillance and Screening Work?

Studies on the effectiveness of early detection show that when quality screening tests are used routinely, early detection and early intervention enrollment rates rise to meet prevalence figures identified by the Centers for Disease Control (e.g., see The National Library of Medicine for supporting studies and an example of an effective initiative conducted by The Center for Health Care Strategies. But, in the absence of quality measurement, only about 1/4th of eligible children ages 0 – 3 years of age are detected and enrolled in early intervention. So why are detection rates typically so low:

Challenges to Early Detection in Primary Care

There are 8 major reasons why children with difficulties are not identified in primary care:

• The tendency to use informal milestones checklists. These lack criteria and items are not well- defined. For example, age-specific encounter forms typically used at well-child visits, may include an item such as “knows colors”. What does that mean? Must the child name colors? If so, how many? Does he or she have to point to colors when named? Or does he or she simply need to match them? The difference in skill levels required for each of these tasks ranges from about age 2 ½ to age 4 ½. Further, informal checklists lack psychometric scrutiny so we don’t have proof that asking about color knowledge is even a good predictor of developmental delays. In contrast quality screening tools use questions proven to predict developmental status and because such measures are standardized, the same task is presented the same way every time along with clear criteria for performance.
• Over-reliance on clinical observation without supporting measurement. Clinical judgment is helpful (e.g., for identifying pallor, clamminess, fussiness and other symptoms of illness) but development and developmental problems are usually far too subtle to simply observe. Most children with difficulties are not dysmorphic and so lack any visible physical differences from other children. Most walk and talk but how well they do these things requires careful measurement. We do not put a hand to a forehead to detect a fever. We measure. Development and behavior require measurement with quality instruments if we are to detect delays and disabilities
• Failing to measure at each well-visit. Development develops and developmental problems do to. A child may be normally developing at 9 months but will she be at 18 months if she is not using words? Or at 24 months if not combining words. We can’t predict outcomes very well (except when problems are severe). Repeated measurement and measurement with quality tools is essential.
• Difficulties communicating with families. Many parents don’t raise concerns about their children. Those with limited education often do not know that primary care providers are interested in development and behavior, child-rearing, etc. Many informal questions to parents do not work well. For example, “Do you have worries about your child’s development?” What is wrong with that question. The word “worries” is too strong and only about 50% of parents know what “development” means. Only about 2% of families will answer, even while the prevalence of problems in the 0 – 21 year age range is 16% - 18% (www.cdc.gov). In contrast, quality tools use questions proven to work and are far more likely to detect difficulties.
• Limited awareness of referral resources. Many children, even if administered a good screening tool, and found to have problematic results, are not referred? Why? Many primary care providers are unaware of referral resources in their communities. Why? Early interventionists have not consistently informed providers of their services. They many not respond like the ideal sub-specialist (e.g., calling back, informing about results, engaging in collaborative decision making about treatment, etc.). See www.DBPeds.org for links to referral resources.
• Failure to use a quality screening instrument. Unfortunately, the most famous and well known of screens, the Denver-II, lacks psychometric support. It under-identifies by about 50% or vastly over-refers depending on how questionable scores are handled. That it is also a hands-on measure taking longer to give than the usual 15 – 20 minute well-visit, means that most professionals use only selected items, and may thus further degrade what little accuracy there is. More accurate options and ones more workable for primary care in that they can be completed by parents in waiting or exam rooms, include Parents' Evaluation of Developmental Status (PEDS), Ages and Stages Questionnaire (ASQ) and PEDS:Developmental Milestones (PEDS:DM) with PEDS and the PEDS:DM offering compliance with the tenants of both surveillance and screening. Practices with nurse practitions or developmental specialists, and early intervention intake services may have the time to administer accurate but lengthier measures that elicit skills directly from children (e.g., Brigance Screens, Bayley Infant Neurodevelopmental Screener (BINS), or Battelle Developmental Inventory Screening Test (BDIST).
• Failing to monitor referral rates. Many providers are unaware of the prevalence of disabilities and delays and get little feedback when they’ve failed to identify a child with difficulties. Families often leave the practice or stop showing up for well-visits. So, there is an acute need to consider the prevalence of difficulties in light of personal referral rates: Overall about 1 in 6 children between 0 and 21 will need special assistance: about 4% of children 0 – 2, 8% of children 0 – 3, 12% of children 0 – 4, and 16% of children 0 – 8.
• Constraints of time and money. Many health care providers feel there is little time for screening during busy well visits. Generally this complaint reflects lack of awareness of screening measures that can be completed in waiting rooms (e.g., paper-pencil tools that families can self-administer independently, thus saving providers substantive time). Reimbursement for early detection has been notoriously poor. However in 2005 the Centers for Medicare and Medicaid Services enabled providers to add the -25 modifier to their preventive service code and to bill separately from the well-visit for 96110 (the developmental-behavioral screening code). Nationally, reimbursement now averages about $10. Some states have handled this mandate differently (e.g., North Carolina providers higher reimbursement for well care but does not allow screening to be unbundled from the well-visit for separate billing). Typically private payers honor Medicaid mandates and follow suit with billing and coding although this has not always occurred. The American Academy of Pediatrics has a Coding Hotline and advocates with private payers to provide reimbursement for screening.

Conclusion

The challenges of early detection in primary care are surmountable. But health care providers need to be better engaged by the early childhood community, trained in the use of tools that are accurate and effective in primary care, and reimbursed appropriately for their time. A number of model initiatives demonstrate that challenges of early detection are not insurmountable. Early detection initiatives that have encouraged greater contact between early childhood programs and primary care providers have greatly increased the likelihood of referral (see www.dbpeds.org for information on programs such as First Signs, ABCD, Pride, etc.)