Ag Data Commons
Browse

Erroneous Payments In Childcare Centers Study (EPICCS)

dataset
posted on 2025-01-22, 22:19 authored by USDA FNS Office of Policy Support

Title

Erroneous Payments In Childcare Centers Study (EPICCS)


URL

These data are not published elsewhere. The public webpage that provides information about the study is https://www.fns.usda.gov/research/cacfp/epiccs.


Description of the experiment setting: location, influential climatic conditions, controlled conditions (e.g. temperature, light cycle)


These data are from the Erroneous Payments In Childcare Centers Study (EPICCS) study and EPICCS Adjustment study. The study methods are summarized at https://www.fns.usda.gov/research/cacfp/epiccs.


These studies examined payment errors and compliance with USDA meal pattern requirements for breakfast and lunch meals in a nationally representative sample of CACFP child care centers serving 2- to 5-year-old children in 2017. The studies included sponsored centers, independent centers, and Head Start centers. The studies did not include infant care centers, family day care homes, at-risk afterschool centers, outside school hours centers, adult care centers, or emergency and homeless shelters.


Processing methods and equipment used

N/A


Study date(s) and duration

EPICCS data were collected between March 2017 and March 2018. EPICCS Adjustment data were collected between April and June 2023 but are about 2017.


Study spatial scale (size of replicates and spatial scale of study area)

The intended study universe was CACFP child care centers serving 2- to 5-year-old children. The study data (for the study sample) are accurate. However, due to a weighting error, the national estimates are inaccurate. Please read our disclaimer about the accuracy of some of these data, and a summary of the study methods, at https://www.fns.usda.gov/research/cacfp/epiccs.


Level of true replication

N/A

Sampling precision (within-replicate sampling or pseudoreplication)

EPICCS used a multistage-clustered sample design as follows: (1) A representative sample of 25 States in the contiguous 48 States and the District of Columbia; (2) a representative sample of 450 childcare centers (and their sponsors) within Primary Sampling Units (PSUs); and (3) a random sample of 5,400 households (with children ages 2-5 years) enrolled in the sampled childcare centers who applied for free and reduced-price meals or were categorically eligible for free meals.


Level of subsampling (number and repeat or within-replicate sampling)


Study design (before–after, control–impacts, time series, before–after-control–impacts)

Cross-sectional


Description of any data manipulation, modeling, or statistical analysis undertaken


The EPICCS data were analyzed to produce sample-level descriptive statistics about sources of payment error, sources of noncompliance with USDA meal pattern requirements, and error rates. EPICCS Adjustment data (about the sampled centers’ meal counting methods) were used to re-analyze certification error (a source of payment error). Please read a summary of the study methods at https://www.fns.usda.gov/research/cacfp/epiccs.


The sample-level data were weighted to produce national-level estimates, but due to a weighting error these estimates are inaccurate.


To preserve the confidentiality of respondents, variables that could be used to identify sponsors, centers, or households were suppressed in the public-use files.


Description of any gaps in the data or other limiting factors

Please read our disclaimer about the accuracy of some of these data at https://www.fns.usda.gov/research/cacfp/epiccs.


EPICCS was sampled on accurate criteria. However, the EPICCS and EPICCS Adjustment study final post-stratification weights were raked to inaccurate population parameters using FNS keydata. FNS keydata for CACFP child care centers include emergency shelters and at-risk afterschool programs in addition to child care centers (see the instructions of form FNS-44 https://www.fns.usda.gov/cacfp/fns-44). As a result, the population parameters that the weights were raked to were significantly different than the actual universe being analyzed in EPICCS. Because of the way CACFP data are reported, at-risk afterschool programs were all included in the population as “non-Head Start, not-for-profit outlets” leading to a severe over-weighting of these types of outlets (and children attending them) and under-weighting of Head Start and for-profit outlets. This is particularly notable because certification error is not a source of payment error in Head Start centers; children are categorically eligible for free meals, so FNS reimburses at the free rate without the need for Head Start centers to certify applications. As a result, the calculations using the incorrect weights very likely overestimated certification error and resulting payment errors. FNS chose not to publish these estimates in keeping with USDA scientific integrity guidelines. These weights are left in these data files for transparency.


In the EPICCS Adjustment data, significant imputation of claiming methods was required due to non-response to the survey. More information is provided in the technical manual accompanying the data files.


Outcome measurement methods and equipment used

Data collection instruments included surveys of sampled sponsors and centers, meal observation booklets, abstraction of applications and meal counts, and household interviews.

Funding

USDA-FNS: Contract# AG-3198-C-14-0015

USDA-FNS: Contract# 12319822F0056

History

Data contact name

USDA FNS Office of Policy Support

Data contact email

OpsDataRequests@usda.gov

Publisher

USDA FNS Office of Policy Support

Intended use

The Payment Integrity Information Act of 2019 requires federal agencies, like FNS, to give Congress information about payment errors for federal programs, like CACFP. CACFP operates in several types of outlets, which serve nutritious meals and snacks to the children and adults in their care. Each month, FNS reimburses CACFP outlets for those meals and snacks. Payment errors happen when outlets are reimbursed too much (overpayments) or too little (underpayments). It's difficult to estimate payment errors for CACFP; program rules differ for each outlet type so payment errors must be estimated differently for each outlet type. FNS planned EPICCS to estimate payment errors in CACFP child care centers.

Use limitations

Meal observation data may be subject to measurement error, though subsequent USDA formative research suggests that the level of measurement error by a human conducting a meal observation compared to a camera (in a school setting) is not analytically significant.

Temporal Extent Start Date

2017-02-01

Temporal Extent End Date

2018-01-01

Frequency

  • notPlanned

Theme

  • Non-geospatial

Geographic location - description

United States

ISO Topic Category

  • economy
  • health
  • society

National Agricultural Library Thesaurus terms

child care centers; compliance; breakfast; lunch; children; child care; adults; households; statistical analysis; descriptive statistics; certification; Food and Nutrition Service; Child and Adult Care Food Program; child nutrition; governmental programs and projects; snacks

OMB Bureau Code

  • 005:84 - Food and Nutrition Service

OMB Program Code

  • 005:054 - Child Nutrition Programs

Pending citation

  • No

Public Access Level

  • Public

Usage metrics

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC