The National Study of Outcome Measurement
The National
Study of Outcome Measurement in Public Child Welfare Services
was
funded by the Illinois Department of Children and Family Services (DCFS).
It was conducted in coordination with the American Humane
Association's Children's Division (AHA) and the Child Welfare
League of America's (CWLA) Managed Care Institute to describe the
current state of outcome measurement in child welfare, identify
successful outcome measurement strategies, and understand barriers to
success. The information collected includes:
-
Agency characteristics
-
Agency outcome measurement
initiatives
-
Administrative data agencies use to measure outcomes
-
Clinical or functional measures agencies use to measure
outcomes
-
Agency management
information system capacity
-
Indicators that agencies use
to assess program success
-
Examples of innovative
outcome measurement systems
-
Barriers to successful
outcome measurement system implementation
-
Future outcome measurement
plans
Study
Method
Public child welfare agencies in 50 states, the District of
Columbia, and 14 localities were invited to participate in the study.
Localities with the largest child population in county/city
administered states were identified using 1990 U.S. Census data.
Agency staff who knew the most about their agency's experience in
outcome reporting were first identified using contact information from
AHA Outcomes Roundtable participant lists and the 1997-1998
APWA Public Welfare Directory. Through subsequent telephone
interviews with agency staff, Center researchers were usually referred
to agency data analysts or departments of quality assurance. Larger
agencies often contained outcome reporting divisions.
The study instrument was developed in
coordination with the CWLA Managed Care Institute, AHA, and DCFS'
Office of the Research Director. Several response categories for
measures were developed from 1997
CWLA Managed Care Survey results
(See Links). The survey was piloted in two
states before national administration.
Response
Rate
Thirty-five states and nine localities
participated in the study by completing the survey or returning
documents related to their outcome measurement plans. Both states and
localities participated in seven states. The responses from the
participating states and localities represent 83% of the nation's
children age 0-17 (U.S. Census, 1990). Respondents were given the
option of reporting publicly on their agency's outcome measurement
activities. Some agencies chose to maintain confidentiality. Therefore
all data is presented in the aggregate.
Participating
States
The 32 states that returned questionnaires are
listed below.
States in
the National Survey of Outcome Measures in Public Child Welfare
|
Alaska
Alabama
Arkansas
Arizona
Connecticut
Delaware
Florida
Georgia
|
Iowa
Idaho
Illinois
Indiana
Kentucky
Louisiana
Massachusetts
Maryland
|
Maine
Minnesota
Missouri
Mississippi
Montana
North Carolina
New Hampshire
New Jersey
|
Ohio
Oregon
Rhode Island
Tennessee
Texas
Utah
Virginia
Wyoming
|
Results
Results
of the National
Survey can be found in:
-
Recommended,
Mandated and State Implemented Measures
-
State
Administrative Data Measures
-
Measuring
Child and Family Functioning
|