Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff...
-
Upload
amber-carroll -
Category
Documents
-
view
216 -
download
0
Transcript of Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff...
![Page 1: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/1.jpg)
Summary ReportEvaluation of the CYSA/TANF
Program in California
Doug CalderwoodEdwin KitzesCliff Howard
Stoycho Ivanoff
PADM 522 Presentation – November 20th, 2012
![Page 2: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/2.jpg)
Evaluation of Federal Assistance• Chief Probation Officers of California sponsored an
evaluation of the implementation and impact of California Youth Services Act (CYSA) distribution of federal assistance administered the Temporary Assistance for Needy Families (TANF) to California county probation departments (CPDs).
• 3 year Evaluation conducted by the RAND corporation.
Howard
![Page 3: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/3.jpg)
Four Goals of Evaluation• provide timely feedback to Chief
Probation Officers of California on CYSA/TANF implementation,
• document how county probation departments (CPDs) have used CYSA/TANF funds
• assess impact of local interventions, and • draw lessons for improving overall
program design and operation
Howard
![Page 4: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/4.jpg)
Evaluation Sought Answers to 5 Questions
1. What programs were implemented?2. What CYSA/TANF services were provided?3. What CYSA/TANF services and programs were
being provided in the juvenile halls and camps/ranches?
4. What was the impact of CYSA/TANF at the individual and system level?
5. What was the CYSA/TANF funding environment and what were county claiming experiences?
Howard
![Page 5: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/5.jpg)
Probation Departments Administered at the County Level – 58 Counties
Howard
![Page 6: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/6.jpg)
California County Probation Department Funding
State and Federal Funds
Howard
![Page 7: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/7.jpg)
California funding for Probation Facilities
• California county probation departments (CDPs) started receiving federal funds under Title IV-A-EA of the Social Security Act in July 1993 to reimburse institutional costs for juvenile camps and ranches and many child welfare services.
• Ended on December 31, 1995 with the passage of Personal Responsibility and Work Opportunity Reconciliation Act (PRWORA) (a.k.a. welfare reform act)
Howard
![Page 8: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/8.jpg)
California County Probation Departments State and Federal Funding
Howard
![Page 9: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/9.jpg)
Sequence of federal assistanceTitle IV-A-EA to TANF
Title IV-A-Emergency Assistance Jul 1993 -Dec 1995PRWORA TANF July 1997
Howard
![Page 10: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/10.jpg)
TANF Replaces Title IV-A-EA Funding• PRWORA instituted Temporary Assistance to
Needy Families (TANF) which became effective July 1, 1997
• TANF is a block grant to states to target needy families – it replaced previous welfare programs
• TANF for California County Probation Departments was around $168M annually during the time of this study.
• CPDs went for 18 months w/o Title IV-A-EA federal assistance
Howard
![Page 11: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/11.jpg)
Intent of CYSA• Provide a continuum of family-focused, case-
specific services in a community-based setting that addresses the full spectrum of child and family needs, including services provided in county-operated residential care facilities
• Programs were to focus more on prevention/intervention when possible
Howard
![Page 12: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/12.jpg)
Goals of CYSA• Legislation had 3 main goals– Keep probation youths from further crime– Help probation and at-risk youths to develop skills to
avoid dependence on public assistance– Help achieve 4 overarching federal TANF goals
• Provide assistance to families so youths may be cared for in their homes
• Reduce dependence of needy parents on government benefits by promoting job preparation, work and marriage
• Encourage formation/maintenance of two-parent families• Prevent/reduce incidence of out-of-wedlock pregnancies
Howard
![Page 13: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/13.jpg)
CYSA Program Planning Procedure• Establish local planning council to advise the county Chief
Probation Officer including agencies– County departments of health, mental health, probation, child
protective services and education– Local school districts– City/county law enforcement agencies– Community organizations that serve at-risk youth– One or more youth who are at-risk– Parents of family of at-risk youth
• Chief Probation Officer prepares the written plan• County Board of Supervisors must approve the CYSA/TANF
programs Howard
![Page 14: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/14.jpg)
5 Key Principles CYSA/TANF• be oriented toward principles of personal
responsibility and self-reliance• use available community resources to the
extent possible• be based on case plans that consider
family concerns, priorities, and resources• be family-focused• address identified immediate needs, as
well as underlying risk factors contributing to problems that are more pervasive and recurrent in nature
Howard
![Page 15: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/15.jpg)
CYSA/TANF Goals pursued by providing a spectrum of 23 authorized services
CYSA/TANF Services Areas Emergency shelter Parent peer support
After-care servicesFamily crisis intervention Parenting skills
Anger management Family mentoring Pre-vocational trainingAvailability of community services Gang intervention Respite careCase management Home detention Sex/health educationCounseling, monitoring, and treatment
Individual, family, group counseling
Social responsibility training
Drug/alcohol education Life skills counseling
Therapeutic day treatment
Educational advocacyMental health assessment
Transportation to needed services
Howard
![Page 16: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/16.jpg)
Spectrum of Juvenile Cases5 categories from least to most serious
• At risk youth – failing academically, poverty, disabled, disadvantaged, certain ethnic minorities
• WIC * 601 – accused of status offense (an offense that’s not applicable to adult)
• WIC * 602 – accused of misdemeanor or felony• Wardship – under court supervision, placed at
home or at a relative’s house on probation • Custody – under court supervision, sentenced
from 0-12 months in juvenile camp or ranch* WIC - California Welfare and Institutions Code
Howard
![Page 17: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/17.jpg)
Change Model from Chen
Intervention Determinants Outcome23 authorized service categories such as: • After-care services• Anger management• Availability of community
services• Case management• Counseling, monitoring,
and treatment• Drug/alcohol education• Educational advocacy• Emergency shelter• Family crisis intervention• Family mentoring• Gang intervention• Home detention
Function of Juvenile Case - Includes things like:• Home/shelter conditions• Family/home conditions• Exposure to:o Drugs/alcoholo Gang violenceo Physical vulnerabilitieso Verbal abuse• Coping abilities• Decision making abilities• Access to harm others• Academic success level• Food availability
Function of Case –Goals include:• Recovery from
transgression• Avoid repeat offense• Live at home• Not dependent on
public assistance• Develop Job skills• Stable 2-parent families• Avoid out-of-wedlock
pregnancies• Protect community• Academic success
Howard
![Page 18: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/18.jpg)
Review of Evaluation Scope,Program Goals, Authorized Services
• CYSA has 6 goals• California has 58 counties• Legislation authorizes 23 service categories• Juvenile cases span at least 5 broad categories of
seriousness (at-risk youth to detention facilities)• Service centers include multiple government and
community facilities and organizations • CYSA/TANF funding is combined with several
other county, state, and federal sourcesHow do you evaluate this?
Howard
![Page 19: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/19.jpg)
Four Components of Evaluation• statewide implementation surveys fielded to
all 58 counties (Years 1 and 3)• an 11-county process study (Years 1 and 2)• an outcomes/impact analysis (Years 1 and 2)• a funding/claim submission analysis (Year 3)
5 questions to be addressed by evaluation1. What programs were implemented?2. What CYSA/TANF services were provided?3. What CYSA/TANF services and programs were being provided in the
juvenile halls and camps/ranches?4. What was the impact of CYSA/TANF at the individual and system level?5. What was the CYSA/TANF funding environment and what were county
claiming experiences?Howard
![Page 20: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/20.jpg)
Data Collected in the Evaluation• Programs implemented under CYSA/TANF (Cliff)• CYSA/TANF services provided (Edwin)• CYSA/TANF services provided in the juvenile
halls and camps/ranches (Edwin)• The impact of CYSA/TANF at the individual and
system levels (Doug)• The CYSA/TANF funding environment and
experiences (Doug)• Summary, Conclusions, and Observations
(Stoycho)Howard
![Page 21: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/21.jpg)
Distribution of Program Funds Along the Continuum of Options
Programs ImplementedHoward
custody
multiplemultiple
custody
![Page 22: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/22.jpg)
Distribution of Program Funds Along Target Population
601 truan
ts
601 runaway
adults
Programs ImplementedHoward
602s
![Page 23: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/23.jpg)
Percent of Counties with Programs That Target Youths and Families Along the Continuum of Options (N=55)
Programs ImplementedHoward
![Page 24: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/24.jpg)
Key Programs in 6 Various Counties
Juvenile assessment centerFamily services program
Personal/social responsibility Juvenile Hall programCamps servicesVoucher program
Medium-level custody programJuvenile Hall Youth Center ServicesBoot camp program
Youth and family resources centersJuvenile Hall unitDiversion program for at-risk youths
Multiagency comprehensive community-based programAftercareDrug Court
Prevention network
Programs Implemented
County B
County E
County D
County G
County C
County F
Howard
![Page 25: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/25.jpg)
Services Areas Categorized into Four Groupings
Formal Treatment Life Skills DevelopmentCounseling, monitoring, treatmentIndividual, family counselingDrug/alcohol educationMental health assessmentTherapeutic day treatmentMental health assessmentFamily crisis intervention
Family mentoringAnger managementLife skills counselingSex/health educationGang interventionParenting skillsEducational advocacy
Coordination OtherAvailability of community servicesCase managementTransportation to needed service
Home detentionAfter-care servicesEmergency shelter
Howard
![Page 26: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/26.jpg)
Types of CYSA/TANF Services Outsourced (N=24)
Programs Implemented Howard
![Page 27: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/27.jpg)
Number of Youths and Families Served in 44 Reporting Counties (June 2002) (N=44)
HowardPrograms Implemented
![Page 28: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/28.jpg)
CYSA/TANF Mediating Variables• Implemented during a time when juvenile
programs were being overhauled• Comprehensive integrated planning was
encouraged• Multiagency planning bodies existed already• Needs assessments had already been done• Built on existing CPD relations with service
providers
Programs ImplementedHoward
![Page 29: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/29.jpg)
CYSA/TANF Program Moderators
• Difficulty to implement multiservice delivery model
• Turf concerns, philosophical differences, conflicts between service agencies
• Procedures for claiming funds time consuming• CYSA implementation guides were vague• Difficult to evaluate qualifications of some service
providers• Difficult to write performance-based contracts• Staff shortages in early yearsPrograms Implemented
Howard
![Page 30: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/30.jpg)
CYSA/TANF Services Provided
Edwin Kitzes
Services ProvidedKitzes
![Page 31: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/31.jpg)
From the Chen Reading• Assessment-Oriented Process Evaluation• Primary for External Stakeholders to
evaluate how well a program is being implemented
• Evaluate three main program purposes:1) Meeting Accountability Needs2) Meeting Program Improvement Needs3) Provide Interpreting Outcome
Evaluation
![Page 32: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/32.jpg)
Services Areas Categorized into Four Groupings
Formal Treatment Life Skills DevelopmentCounseling, monitoring, treatmentIndividual, family counselingDrug/alcohol educationMental health assessmentTherapeutic day treatmentMental health assessmentFamily crisis intervention
Family mentoringAnger managementLife skills counselingSex/health educationGang interventionParenting skillsEducational advocacy
Coordination OtherAvailability of community servicesCase managementTransportation to needed service
Home detentionAfter-care servicesEmergency shelter
Howard
![Page 33: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/33.jpg)
Services ProvidedHow was the data gathered?
• Year 1 Survey – before/after – all programs
• Year 3 Survey – Counties primary programs/services provided
• 58-Counties• Compare pre- and post-CYNA/TANF• Compare different size counties, big vs.
small• ‘Real Change’ vs. adjustments of claims
Services ProvidedKitzes
![Page 34: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/34.jpg)
58 Counties in California
Howard
![Page 35: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/35.jpg)
Formal Treatment Services
46 Counties 12 Counties
Before | After
Services ProvidedKitzes
![Page 36: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/36.jpg)
Coordination Services
Services ProvidedKitzes
![Page 37: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/37.jpg)
Life Skills Development
Services ProvidedKitzes
![Page 38: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/38.jpg)
Other Services
Services ProvidedKitzes
![Page 39: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/39.jpg)
Services ProvidedSummary
• Majority of funds used to ‘Enhance existing services’
• Larger counties were more likely to enhance service vs. smaller counties which used funds to add new services.
Kitzes
![Page 40: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/40.jpg)
Services ProvidedYear 3
Services ProvidedKitzes
![Page 41: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/41.jpg)
Services Provided
Services ProvidedKitzes
![Page 42: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/42.jpg)
Types of CYSA/TANF Services Outsourced (N=24)
Programs Implemented Howard
![Page 43: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/43.jpg)
Spectrum of Juvenile Cases6 categories from least to most serious
• At risk youth – failing academically, poverty, disabled, disadvantaged, certain ethnic minorities
• WIC * 601 – accused of status offense (an offense that’s not applicable to adult)
• WIC * 602 – accused of misdemeanor for felony• WIC* 777 – accused of probation violation• Wardship – under court supervision, placed at home or
at a relative’s house on probation • Custody – under court supervision, sentenced from 0-12
months in juvenile camp or ranch* WIC - California Welfare and Institutions Code
Howard
![Page 44: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/44.jpg)
Services Provided
Services ProvidedKitzes
![Page 45: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/45.jpg)
Services ProvidedYear 3 Summary
• 11 of the 23 services were provided in more than 75% of the counties.
• There was “real change” made in the delivery of the services due to CYSA/TANF funds - virtually unanimous in all counties.
• Majority of funds used to ‘Enhance existing services’
• Larger counties were more likely to enhance service vs. smaller counties which used funds to add new services.
Kitzes
![Page 46: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/46.jpg)
CYSA/TANF Services Provided inJuvenile Halls and Camps/Ranches
Services in halls/campsKitzes
![Page 47: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/47.jpg)
Juvenile Hall, Orange County
Juvenile Hall, San Deigo County
http://www.youtube.com/watch?v=QTI2u3bmKFQ
Juvenile Halls and Camps/Ranches
http://www.youtube.com/watch?v=gyaO634JWpU
![Page 48: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/48.jpg)
Services ProvidedHow was the data gathered?
• Year 2 Survey – In-depth survey of 11 Counties
• Purpose: gather general information: to gather information on services provided in Halls/Camps/Ranches
• And results of CYSA/TANF funds‘Real Change’ vs. adjustments of claims
• Compare pre- and post-CYNA/TANFServices Provided
Kitzes
![Page 49: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/49.jpg)
Services provided in the juvenile halls and camps/ranches
Services in halls/campsKitzes
1,50026
![Page 50: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/50.jpg)
Services provided in the juvenile halls and camps/ranches
Services in halls/campsKitzes
![Page 51: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/51.jpg)
KitzesServices in halls/camps
Services provided in the juvenile halls and camps/ranches
![Page 52: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/52.jpg)
Services ProvidedYear 2 Summary Halls
• Relative short stays in juvenile halls; often occupied at daily capacity.
• Claiming strategies were driven to maximize Federal revenues received.
• There was “real change” made in the delivery of the services due to CYSA/TANF funds.
• Formal treatment, Life Skills Development, but few Coordination and Other Services
• Majority of funds used to ‘Enhance existing services’
Kitzes
![Page 53: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/53.jpg)
Services ProvidedYear 2 Summary Camps/Ranch
• Mirrored Juvenile Hall results with the exception of more services provided
• AGAIN, • Claiming strategies were driven to maximize
Federal revenues received.• There was “real change” made in the delivery
of the services due to CYSA/TANF funds.
Kitzes
![Page 54: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/54.jpg)
CYSA/TANF
Doug Calderwood
Individual and Systemic Impact
Funding Environment and Experiences
![Page 55: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/55.jpg)
CYSA/TANF Systemic and Individual Impact
• System Evaluation– Year 1 and 3 surveys– Chiefs’ assessments– Evaluation Team’s
assessment
• Individual Evaluation– Four County Programs’
outcomes
Calderwood
![Page 56: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/56.jpg)
The Multi-Goal, Theory-Driven Approach to Evaluation
Huey T. Chen & Peter H. Rossi• In one field after another, evaluation
researchers find that the programs in place or contemplated have few or no effects of the sort intended by their designers.
(1980, p. 106)
Calderwood
![Page 57: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/57.jpg)
“…[S]tatements of program goals tend to be vague and/or stated in terms that do not lend themselves easily to precise measurement. …[I]n practice one is able to define only a few measurable, specific outcome variables (goals) …typically quite narrow compared to the original social problem that the social program aims to alleviate.”
(Chen & Rossi, 1980, p. 109)
Calderwood
![Page 58: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/58.jpg)
“Clearly the problems with the conventional paradigm are not to be remedied by using rigorous research designs since there would be even less chance of finding effects using more powerful designs.”
(Chen & Rossi, 1980, p. 109)
Calderwood
![Page 59: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/59.jpg)
System—Year 1 and 3 Surveys
• “CYSA Legislation hoped to achieve specific outcomes” (Turner, Davis, Steinberg & Fain, p. 51)– Effects on juvenile justice services (Table 5.1)– Moderate to large impact (2.9 to 3.9 out of 5)
• “CYSA Legislation’s goal was to…avoid dependency…and reduce…future criminal activity” (Turner et. al., p. 52)– Effects on target population (Table 5.2)– Positive to extremely positive impact (3.4/5 to 4.6/5)
Calderwood
![Page 60: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/60.jpg)
System—Chief’s Assessment• Separate survey of Chiefs in year 3 included
two questions:– Additional activities enabled?• Addition and enhancement of specific services• Base funding for custody programs• Expansion of range of services
– Impact if funding went away?• Services would be cut
Calderwood
![Page 61: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/61.jpg)
System—Evaluation Team
• CYSA/TANF:– Filled an important funding gap– Supported a shift from suppression,
enforcement and monitoring to rehabilitation and therapy
– Increased system-wide collaboration and planning
– Enabled viability of probation in county level children’s programs
Calderwood
![Page 62: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/62.jpg)
Individual—Four County Programs
• Research criteria for selection– Distinct CYSA/TANF Programs – Comparison group available– Identifiable CYSA/TANF clients– County collects client characteristics, services
delivered and outcomes• Inclusivity selection criteria– Counties: Northern/Southern and Large/Small– Programs: Field/Institutional
Calderwood
![Page 63: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/63.jpg)
County K: Adult TANF Caseload Program
• TANF-eligible parolees received added family services
• Case load limits excluded some eligible—the control group
• TANF and control had equal risks, TANF had more strengths (housing, family stability and food)
• TANF had fewer probation violations, more technical violations
Calderwood
![Page 64: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/64.jpg)
County F:Juvenile Assessment Center Program
• Assessment, case planning and follow-up– 2,437 youths served from 2/98 to 5/02
• Historical control group – 787 youths from ’97
• Recidivism was less for program participants at 6, 12 and 18 months
• Time before first subsequent referral was also longer
Calderwood
![Page 65: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/65.jpg)
County H:Placement Readiness Recidivism Program
• Youth with mental illness in custody got weekly independent therapy, theme groups and daily recreation
• 200 youths participated from 6/99 to 3/02• Historical control group of 200 youths who
would have been eligible• Participants has lower recidivism but worse
behavior while in custody
Calderwood
![Page 66: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/66.jpg)
County D:Youth and Family Resource Centers
• Day-reporting and treatment centers for “8%” youth—a profile of a small proportion accounting for 50% of repeat offenses
• Control group met profile but were not assigned
• Results showed little difference for those in the program
Calderwood
![Page 67: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/67.jpg)
CYSA/TANFFunding Environment and Experiences
• Probation Funding Environment
• Claiming Strategies
• Leveraging Strategies
• Fiscal Pressures
Calderwood
![Page 68: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/68.jpg)
California County Probation Departments State and Federal Funding
Howard
![Page 69: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/69.jpg)
Funding Environment
• CPD funding is about 10% CYSA/TANF (more in small counties)
• Title IV-E funds can’t be used in custody settings, so TANF is more heavily claimed there.
• This is part of the difficulty evaluating “pure” CYSA/TANF programs
Calderwood
![Page 70: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/70.jpg)
Funding Environment
• About 1/3 of counties experienced fiscal pressure—withholding or re-appropriation of CYSA/TANF funds
• Chiefs of CPDs felt CYSA/TANF funding was extremely important overall
• CYSA/TANF money replaced lost Title IV-A-EA funds
Calderwood
![Page 71: Summary Report Evaluation of the CYSA/TANF Program in California Doug Calderwood Edwin Kitzes Cliff Howard Stoycho Ivanoff PADM 522 Presentation – November.](https://reader037.fdocuments.net/reader037/viewer/2022110208/56649dd25503460f94ac7f43/html5/thumbnails/71.jpg)
CYSA/TANF Program Complications
• 23 services in four broad categories• 58 counties setting up programs• CYSA seeks to bridge TANF and Juvenile Justice• TANF funding often used to cover programs
defunded when Title IV-A-EA went away• It is unlikely that local programs have clear
program theories• Programs have little traditionally measurable
effectCalderwood