• Percent of first-time offenders referred to civil citation o Percent whose offenses involved drugs
• Percent whose offenses involved alcohol
• Percent whose offenses involved non-violent crimes
• Percent of first-time offenders eligible for program not referred to civil citation
• Percent of those referred who successfully entered program (retention rates)
• Percent who paid assessed program fees
• Percent who successfully completed the program
• Percent of offenders assessed for needs and strengths
• Percent of cases where needs/strengths were matched to interventions
• Percent assigned to and successfully complete sanctioned courses (drugs/alcohol, petty theft, gambling, behavioral issues, retail theft, and/or conflict resolution/anger management)
• Percent satisfaction with sanctioned courses (assessed by provider at end of course)
• Percent with improved knowledge following course completion (assessed by provider prior to beginning course and immediately following course completion)
• Percent assigned to and successfully complete counseling
• Percent assigned to and successfully complete apology letter
• Percent assigned to random urinalysis and successfully complete sanctioned requirements
• Offender community service hours sanctioned and completed
• Number and type of referrals to community services sites
• Impact on disproportionate minority contact as measured by race and ethnicity of program participants served
• Offender satisfaction following program completion (assessed by provider at exit interview)
• Offender demographics including name, social security number, date of birth, gender, race, ethnicity, charge(s), citation number, date of citation, referring agency, whether firearm involved, whether alcohol involved, whether drugs involved, whether sexual offending involved, whether gang involvement, and educational/employment information as available.

The Justice Research Center will coordinate with the provider to obtain necessary data extracts from the www.FloridaCivilCitationNetwork.com and will coordinate with the city, county and/or FDLE to obtain CBIS data extracts. Data will be merged, cleaned and analyzed to produce the output measures referenced above, including calculating provider satisfaction ratings and pre/post change in knowledge following course completion. A formal process evaluation report will be prepared and submitted within 60 days of the conclusion of the first 12 month period of the pilot.

The intent of the evaluation is to compare recidivism outcomes of civil citation participants to those of like offenders who did not receive a civil citation and received standard case processing. The evaluation will include the following tasks:

• Obtain civil citation served pool from DISC Village monthly and confirm that the file contains adequate identifier information for all participants; perform monthly data verification in collaboration with DISC Village
• Obtain civil citation case logs from DISC Village monthly or extract case log information from DISC Village information system or electronic databases
• Notify DISC Village staff of potential identifier errors or omissions and request changes or supplemental information as necessary
• Determine comparison group from pool of eligible offenders as identified in CBIS
• Examine comparison cohort and civil citation cohort data for any obvious errors or inconsistencies
• Compute client demographics, presenting offense profiles, and where available, risk factors, prior to the services/program placement on Adult Civil Citation and comparison cohorts
• Determine completions and other exit statuses and lengths of service
• Calculate rate of offenses that occurred during services (ODS) on both cohorts, as data permit
• Calculate subsequent arrests, felony arrests, convictions, felony convictions, probation and prison placements on both cohorts, as data permit.
• Review extracts for errors and rerun variables/calculations, if necessary
• Conduct propensity score matching (PSM) prior to estimating treatment effects of adult civil citation intervention
• Conduct multivariate, multi-level analyses to estimate/examine treatment effects of adult civil citation intervention relative to subsequent offending outcomes
• Produce completed cohort extracts, result tables and corresponding text for research report
• Complete draft version of report and review for necessary edits
• Revision process and discussions with DISC Village toward final report preparation and submission
• Address final revisions and prepare final outcome evaluation report for submission

The final outcome evaluation report will be prepared and submitted within 180 days of the conclusion of the second 12 month period of the pilot program.

In an effort to document costs avoided or saved as a result of the Civil Citation Program, a cost analysis will be performed. The analysis will involve:

• Obtain documentation of law enforcement, court, and jail costs associated with processing like offenders (first-time non-violent misdemeanants) through the system
• Document case processing patterns to adjust for variations in likelihood to be processed by law enforcement, courts and corrections
• Document total per diem costs for Civil Citation Program
• Calculate savings/costs avoided by implementing the Civil Citation Program compared to standard case processing, adjusting for differences in recidivism effectiveness between the alternatives
• Prepare a cost analysis report documenting the findings of the study

The cost analysis will be conducted during the final 12month period of the evaluation, with the final report to be completed by the 36th month of the study.