Advertisement
Research Brief| Volume 52, ISSUE 11, P1052-1057, November 2020

Download started.

Ok

SNAP-Ed Policy, Systems, and Environmental Interventions and Caregivers’ Dietary Behaviors

Open AccessPublished:July 14, 2020DOI:https://doi.org/10.1016/j.jneb.2020.05.013

      Abstract

      Objective

      To examine dietary behaviors and diet quality among caregivers of children regarding the number of policy, systems, and environmental (PSE) change interventions implemented in their neighborhoods.

      Methods

      Households with incomes ≤185% of the federal poverty level were randomly sampled throughout California. A validated 24-h dietary recall assessment tool was administered by telephone. The independent variable was the number of Supplemental Nutrition Assistance Program Education PSE change interventions per census tract where the caregivers lived.

      Results

      Most (69.1%) of the 2,222 caregivers were Latino. Policy, systems, and environmental reach predicted decreased intake of sugar-sweetened beverages (P = 0.022, Cohen d = −0.12) and added sugar (P = 0.014, Cohen d = −0.18), and increased Healthy Eating Index–2015 scores (P = 0.046, Cohen d = 0.18), regardless of race and/or ethnicity, age, or reach of Supplemental Nutrition Assistance Program Education direct education.

      Conclusions and Implications

      Replication of these methods and findings, and comparisons of dietary outcomes in association with PSE change interventions with and without direct education activities aimed at the same population under study, are encouraged.

      Key Words

      INTRODUCTION

      The Centers for Disease Control and Prevention and the US Department of Agriculture, Food and Nutrition Service (USDA-FNS) endorse the use of policy, systems, and environmental (PSE) change interventions as public health approaches to addressing chronic diseases, including those resulting from poor diets and obesity.
      • Honeycutt S
      • Leeman J
      • McCarthy WJ
      • et al.
      Evaluating policy, systems, and environmental change interventions: lessons learned from CDC's Prevention Research Centers.
      ,

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      In fact, USDA-FNS Supplemental Nutrition Assistance Program Education (SNAP-Ed) Plan Guidance requires states to implement PSEs in addition to traditional direct nutrition education interventions that involve face-to-face contact with persons eligible for SNAP-Ed, those living in households with incomes ≤185% of the federal poverty level.

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      Policy, systems, and environmental interventions offer a more comprehensive approach to public health interventions than traditional direct education by recognizing and addressing influences external to the individual that can affect risk and prevention behaviors.
      • Savoie-Roskos MR
      • DeWitt K
      • Coombs C
      Changes in nutrition education: a policy, systems, and environmental approach.
      To date, most evaluations of PSE interventions have been descriptive and have relied on documenting lessons learned,
      • Honeycutt S
      • Leeman J
      • McCarthy WJ
      • et al.
      Evaluating policy, systems, and environmental change interventions: lessons learned from CDC's Prevention Research Centers.
      ,
      • Nitta M
      • Navasca D
      • Tareg A
      • Palafox NA
      Cancer risk reduction in the US Affiliated Pacific Islands: utilizing a novel policy, systems, and environmental (PSE) approach.
      • Rohan EA
      • Chovnick G
      • Rose J
      • Townsend JS
      • Young M
      • Moore AR
      Prioritizing population approaches in cancer prevention and control: results of a case study evaluation of policy, systems, and environmental change.
      • Kegler MC
      • Honeycutt S
      • Davis M
      • et al.
      Policy, systems, and environmental change in the Mississippi Delta: considerations for evaluation design.
      • Hardison-Moody A
      • Fuller S
      • Jones L
      • et al.
      Evaluation of a policy, systems, and environmental-focused faith-based health promotion program.
      • Parsons AA
      • Monteban M
      • Lee E
      • et al.
      Indicators of readiness and capacity for implementation of healthy eating strategies in child care settings serving low-income children.
      • Fagen MC
      • Asada Y
      • Welch S
      • et al.
      Policy, systems, and environmentally oriented school-based obesity prevention: opportunities and challenges.
      or have used in part or whole the reach, adoption, implementation, and maintenance framework.
      • Patel S
      • Kwon S
      • Arista P
      • et al.
      Using evidence-based policy, systems, and environmental strategies to increase access to healthy food and opportunities for physical activity among Asian Americans, Native Hawaiians, and Pacific Islanders.
      • Naja-Riese A
      • Keller KJM
      • Bruno P
      • et al.
      The SNAP-Ed Evaluation Framework: demonstrating the impact of a national framework for obesity prevention in low-income populations.
      • Bunnell R
      • O'Neil D
      • Soler R
      • et al.
      Fifty communities putting prevention to work: accelerating chronic disease prevention through policy, systems and environmental change.
      Few studies have collected outcome data to assess the potential effectiveness of PSE interventions. Moreover, those studies that have connected PSEs to behaviors have not provided compelling evidence associating these interventions with improved outcomes. For example, Lepe and colleagues
      • Lepe S
      • Goodwin J
      • Mulligan KT
      • Balestracci K
      • Sebelia L
      • Greene G
      Process evaluation of a policy, systems, and environmental change intervention in an urban school district.
      compared fifth-graders receiving PSE lessons with those receiving only classroom-based nutrition education, in addition to documenting the fidelity, reach, and acceptance of a school-based PSE intervention. The authors reported that students exposed to the PSE lessons had higher fruit and vegetable knowledge scores, but no difference was found when comparing children's behavior, which was measured as the number of times they ate fruit and vegetables during the previous day.
      • Lepe S
      • Goodwin J
      • Mulligan KT
      • Balestracci K
      • Sebelia L
      • Greene G
      Process evaluation of a policy, systems, and environmental change intervention in an urban school district.
      One challenge to assessing outcomes regarding PSE change interventions outside of controlled settings such as a school includes accounting for non-PSE factors that may explain behavior change. Another challenge is measuring levels of PSE exposure, especially when individuals may not be aware that they were exposed to a PSE.
      One approach to evaluating population-based interventions where levels of exposure cannot be accurately ascertained from members of the target population is to employ an ecological study design. In 1 such study, 2,907 census tracts with the number of Californians receiving SNAP-Ed direct education were linked to geocoded, population-based survey responses from SNAP-Ed eligible mothers.
      • Molitor F
      • Sugerman SB
      • Sciortino S
      Fruit and vegetable, fat, and sugar-sweetened beverage intake among low-income mothers living in neighborhoods with Supplemental Nutrition Assistance Program-Education.
      This study found that higher reach of direct education was significantly related to greater intake of fruits and vegetables and decreased consumption of sugar-sweetened beverages (SSBs).
      • Molitor F
      • Sugerman SB
      • Sciortino S
      Fruit and vegetable, fat, and sugar-sweetened beverage intake among low-income mothers living in neighborhoods with Supplemental Nutrition Assistance Program-Education.
      In the intervening years, the number of Californians participating in SNAP-Ed direct education interventions has decreased by 32.6%, whereas sites implementing PSE change interventions increased from 682 in 2015 to 1,566 in 2018 in California.

      California Department of Social Services. California SNAP-Ed 2019 Annual Report.https://www.cdss.ca.gov/Portals/41/Documents/FFY%202019%20Annual%20Report_FINAL_ADA.pdf. Accessed June 23, 2020.

      These changes have been driven by the USDA

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      directive, as well as the cost savings of PSE changes over direct education interventions during a time of declining SNAP-Ed funding.
      The California Family Health Study is an annual statewide survey designed to track dietary behaviors and diet quality among persons from SNAP-Ed eligible households. The current study linked interview responses from adult caregivers participating in the 2018 California Family Health Study to the number of PSE change interventions implemented in their neighborhoods to examine dietary behaviors and diet quality regarding potential exposure to PSE change interventions. The goal of the current ecological study was to determine whether the empirical evidence supports the continued investment in PSE change interventions by the Centers for Disease Control and Prevention, the UDSA-FNS, and the California CalFresh Healthy Living (SNAP-Ed) program.

      METHODS

      The current study was reviewed and approved by the California Health and Human Services Agency, Committee for the Protection of Human Subjects. Oral consent was documented for all survey participants.
      Households with incomes estimated to be ≤185% of the federal poverty level, with at least 1 child aged 5–17 years, were sampled at random from within all 58 California counties using the California Department of Health Care Services, Medi-Cal Eligibility Data System. Recruitment and screening procedures included an initial letter in English or Spanish, followed by a phone call to identify the caregiver. Specifically, bilingual interviewers screened for the youngest adult in the household who “assumes the responsibility in caring for the health and well-being of the child(ren) and prepares the meals or buys food for the child(ren).”
      Before the dietary interviews, households were sent pictorial food and beverage portion-size booklets and measuring cups and spoons. The quantity and size of each food and drink item consumed for each meal and snack over the prior 24 hours were assessed using the Automated Self-administered 24-Hour Dietary Assessment Tool (ASA24),

      National Cancer Institute. Automated self-administered 24-Hour (ASA24®) Dietary Assessment Tool.https://epi.grants.cancer.gov/asa24/. Accessed April 25, 2020.

      while trained interviewers referred caregivers to portion-size pictures or measuring cups and spoons. Portion sizes for the reported items were entered into the Web-based ASA24 system. Responses to standardized demographic items were recorded separately. Survey participants received a $15 (USD) gift card.
      Five dietary outcome variables, in line with California's SNAP-Ed statewide program goals and objectives,

      California Department of Social Services. FFY 2017–2019 California State Plan: Supplemental Nutrition Assistance Program-Education: October 1, 2016 – September 30, 2019.http://www.cdss.ca.gov/foodstamps/res/pdf/FFY18CASNAPEdStatePlan.pdf. Accessed April 25, 2020.

      were examined: Fruits and vegetables (cups) were whole or cut fruits and dark green, red, orange, or starchy vegetables. Water (cups) included tap or unsweetened bottled water, including flavored or vitamin-fortified water. The SSBs (cups) represented sugar-sweetened soda, energy, fruit, sports, coffee, or tea beverages. Added sugars (teaspoons) were sugar (white, brown, and raw), syrup (corn, high fructose, malt, maple, and pancake) and fructose sweetener, liquid fructose, honey, molasses, dextrose, and dextrin that were eaten separately or as ingredients from processed or prepared foods. Diet quality was assessed by the Healthy Eating Index (HEI)–2015 composite scores.

      National Cancer Institute. Basic steps in calculating HEI scores. https://epi.grants.cancer.gov/hei/calculating-hei-scores.html. Accessed November 16, 2018.

      Healthy Eating Index scores range from 0 to 100, with higher values aligning with greater adherence to key recommendations of the 2015–2020 Dietary Guidelines for Americans.

      US Department of Agriculture. Dietary Guidelines for Americans: 2015–2020.https://health.gov/dietaryguidelines/2015/resources/2015-2020_Dietary_Guidelines.pdf. Accessed December 17, 2019.

      These 5 outcome variables are not mutually exclusive. Fruits, vegetables, and added sugars are included in the 13 component scores used to calculate total HEI–2015 scores.
      In 2018, all CalFresh Healthy Living program contractors across California entered information on PSE change and direct education interventions into the Program Evaluation and Reporting System.

      US Department of Agriculture. Producing PEARS, a data tracking system.https://snaped.fns.usda.gov/success-stories/producing-pears-data-tracking-system. Accessed December 17, 2019.

      Using these data, the physical addresses of all PSEs and direct education activities were geocoded to the census tract level. A file was then created identifying, by census tract, PSE and direct education reach, that is, the number of PSE change interventions and the number of direct education participants within each census tract. Direct education was included in this file to serve as a control variable because the reach of direct education activities has been associated with more healthful SSB and fruit and vegetable intake.
      • Molitor F
      • Sugerman SB
      • Sciortino S
      Fruit and vegetable, fat, and sugar-sweetened beverage intake among low-income mothers living in neighborhoods with Supplemental Nutrition Assistance Program-Education.
      These data were merged by census tract numbers with the survey response file based on the geocoded addresses where the 2018 California Family Health Study participants lived. The final analytic dataset excluded caregivers living in census tracts without PSE change and/or direct education interventions. This approach facilitated focusing the analyses on caregivers living in geographic areas where SNAP-Ed interventions had occurred, rather than on the larger sample of 2018 California Family Health Study participants representing SNAP-Ed eligible caregivers living in census tracts with and without SNAP-Ed interventions.
      The independent variable for the current study was coded as 0, 1, or ≥2 PSE change interventions per census tract. Initially, ANOVA was used to compare mean values for the 5 outcome variables across the 3 PSE groups, and Cohen d was calculated to determine the effect size for ≥2 vs 0 PSE change interventions. Regression analyses were then performed to control for caregivers’ age and race and/or ethnicity, and the reach of direct education within the census tracts. Descriptive analyses found cups of fruits and vegetables, water, and SSBs, and teaspoons of added sugars to be highly skewed to the right (skewness >2). Accordingly, these variables were examined by the ordinal PSE variable in both linear and log-linear regression analyses. HEI–2015 scores (skewness = −0.80) were examined using linear regression only. The covariates represented the number of direct education participants in each census tract, caregivers’ age (centered on the mean), and race and/or ethnicity: Latino (“Hispanic, Latina, or of Spanish origin”) was the reference group for White people, African Americans, and Other and/or Missing (responses to other ethnic categories or missing data).
      Excluded from all analyses were 74 records representing partial ASA24 interviews. Differences were considered significant at the 0.05 alpha level. The criteria of 0.2, 0.5, and 0.8 were used for interpreting Cohen d as small, medium, and large effects, respectively. Data merging, cleaning, coding, and analyses were conducted with SPSS (version 26.0, IBM Corp, Armonk, NY, 2019).

      RESULTS

      A total of 2,222 caregivers provided complete ASA24 interviews and lived in a census tract with direct education and/or PSE change interventions. One fifth (21.2%) of caregivers were male; 69.1% of the sample was Latino (Table 1). The average age of survey participants was 38.1 years, and 16.8% had less than an eighth-grade education.
      Table 1Characteristics of Caregivers from SNAP-Ed Eligible Households Across California, 2018 (n = 2,222)
      CharacteristicsValues
      Gender, %
       Female78.8
       Male21.2
      Race and/or ethnicity, %
       Latino69.1
       White14.1
       African American10.8
       Other3.5
       Missing2.5
      Age, y
       Mean38.1
       Median37.0
       SD9.9
      Highest grade completed, %
       ≤ Eighth grade16.8
       Some high school or high school graduate41.7
       Vocational, business schooling or some college30.9
       College or postgraduate degree8.3
       Missing2.3
      SNAP-Ed indicates Supplemental Nutrition Assistance Program Education.
      The 2,222 caregivers lived in 1,123 unique census tracts. A total of 170 caregivers lived in census tracts with no SNAP-Ed direct education activities; an average of 272 persons per census tract across the 1,123 census tracts received direct education. In addition, the 2018 Program Evaluation and Reporting System reported 500 PSE change interventions in the 1,123 census tracts, representing 30.0% of the 1,665 PSEs occurring in California in 2018. The most common, overlapping focus areas of the 500 PSE change interventions were fruits and vegetables (66.4%), the USDA MyPlate

      US Department of Agriculture. ChooseMyPlate.https://www.choosemyplate.gov/MyPlate. Accessed January 9, 2019.

      food groups and portion sizes (36.0%), intake of water (24.8%), and limiting added sugars (14.4%; Table 2). Six in 10 (57.6%) caregivers lived in a census tract with no PSEs, 28.7% lived near 1, and 13.7% lived near 2 or more PSE change interventions.
      Table 2Focus Areas of PSE Change Interventions (n = 500) Implemented in Census Tracts of Caregivers Participating in the 2018 California Family Health Study (n = 2,222)
      Focus AreasValues (%)
      Fruits and vegetables66.4
      USDA MyPlate food groups and portion sizes36.0
      Water24.8
      Limiting added sugars14.4
      Fat free or low-fat milk and/or soy beverages11.8
      Whole grains10.6
      Fiber rich foods7.0
      Limiting sodium5.8
      Protein food, including lean meats, poultry, eggs, and nuts6.0
      Limiting saturated fats3.6
      Healthy fats and oils2.2
      PSE indicates policy, systems, and environmental; USDA, US Department of Agriculture.
      Note: Focus Areas are reported as recorded in the Program Evaluation and Reporting System and are not mutually exclusive.
      The number of PSE change interventions per census tract was related to a decreased intake of SSBs (Cohen d = −0.12) and added sugars (Cohen d = −0.18), and increased HEI–2015 scores (Cohen d = 0.18), regardless of caregivers’ race and/or ethnicity or age, or the reach of direct education in one's neighborhood (Table 3). Cups of fruits and vegetables and water were not related to the reach of PSE change interventions. As seen in Table 3, these findings were consistent between the linear and log-linear regression models, suggesting that the non-normal distribution of the 4 dietary behavior measures did not influence the identification of significant correlates of PSE reach. On average, SNAP-Ed eligible caregivers living in census tracts with ≥2 PSE interventions consumed 0.2 fewer cups (1.6 ounces) of SSBs and 2.2 fewer teaspoons of added sugars per day and had a 2.6 higher HEI–2015 score, than caregivers without PSE interventions in the census tracts where they lived. Finally, the correlation between the number of PSE change interventions and direct education participants was significant (P ≤0.001), but weak (r = 0.16, R2 = 0.025), indicating that multicollinearity did not overly influence the regression models.
      Table 3Caregivers’ Dietary Behaviors and HEI–2015 Scores by Number of PSE Sites per Census Tract, 2018
      PSE Sites Per Census Tract
      Unadjusted MeanAdjusted β for Regression Analyses (95% CI)
      Dependent VariablesSkewness0 Sites1 Site≥2 SitesP
      P value for ANOVA. Note: Regression analyses adjusted for race and/or ethnicity, age, and the number of Supplemental Nutrition Assistance Program Education, direct education participants in the census tract where caregivers lived.
      Linear ModelLog−Linear Model
      Fruits and vegetables, cups3.002.82.73.10.080.049 (−0.088 to 0.186)−0.002 (−0.056 to 0.051)
      Water, cups2.808.58.48.00.4−0.191 (−0.570 to 0.189)−0.024 (−0.073 to 0.025)
      SSBs, cups2.801.31.11.10.02−0.120 (−0.224 to −0.017)−0.050 (−0.085 to −0.015)
      Added sugars, teaspoons2.1013.011.710.80.008−0.875 (−1.580 to −0.176)−0.074 (−0.145 to −0.003)
      HEI–2015 score−0.8055.856.558.40.020.797 (0.013–1.580)
      CI indicates confidence interval; HEI, Healthy Eating Index; PSE, policy, systems, and environmental; SSB, sugar-sweetened beverage.
      a P value for ANOVA.Note: Regression analyses adjusted for race and/or ethnicity, age, and the number of Supplemental Nutrition Assistance Program Education, direct education participants in the census tract where caregivers lived.

      DISCUSSION

      The PSE change interventions implemented in the census tracts of a random sample of caregivers across California in 2018 focused mostly on fruits and vegetables, the USDA MyPlate

      US Department of Agriculture. ChooseMyPlate.https://www.choosemyplate.gov/MyPlate. Accessed January 9, 2019.

      recommendations, drinking water, and limiting added sugar. These interventions appear to have been more effective in reducing the intake of added sugars overall and SSBs in particular than increasing the consumption of fruits and vegetables or water. Perhaps PSEs intended to address added sugars were better designed or were directed at populations in greater need of reducing sugar intake than those aimed at SNAP-Ed eligible individuals who believed that they were already consuming sufficient quantities of fruits, vegetables, and water. Alternatively, PSEs focusing on limiting the consumption of sugary foods and beverages may have resonated more with the SNAP-Ed eligible caregivers for reasons that included a greater understanding of the link between sugar, rather than fruits and vegetables or water, and the risk of obesity and the related health consequences for the children under their care. Moreover, PSE efforts to increase the intake of fruits and vegetables may be circumvented by the limited availability of fresh produce at home among low-income populations.
      • Chai W
      • Fan JX
      • Wen M
      Association of individual and neighborhood factors with home food availability: evidence from the National Health and Nutrition Examination Survey.
      Another explanation is that caregivers may not have responded to PSEs because they were already saturated with messages about eating more fruits and vegetables.
      Of greater importance is the finding that caregivers in neighborhoods with PSE interventions had higher HEI–2015 scores, and thus were more likely to report diets in adherence with the 2015–2020 Dietary Guidelines for Americans.

      US Department of Agriculture. Dietary Guidelines for Americans: 2015–2020.https://health.gov/dietaryguidelines/2015/resources/2015-2020_Dietary_Guidelines.pdf. Accessed December 17, 2019.

      This finding may be because over one-third of PSE change interventions focused on the USDA MyPlate

      US Department of Agriculture. ChooseMyPlate.https://www.choosemyplate.gov/MyPlate. Accessed January 9, 2019.

      recommendations, which are based on the Dietary Guidelines for Americans.

      US Department of Agriculture. Dietary Guidelines for Americans: 2015–2020.https://health.gov/dietaryguidelines/2015/resources/2015-2020_Dietary_Guidelines.pdf. Accessed December 17, 2019.

      Prior research has linked a lower risk of the incidence of and death from cardiovascular disease and a lower risk of all-cause mortality with increased HEI–2015 scores.
      • Hu EA
      • Steffen LM
      • Coresh J
      • Appel LJ
      • Rebholz CM
      Adherence to the Healthy Eating Index-2015 and other dietary patterns may reduce risk of cardiovascular disease, cardiovascular mortality, and all-cause mortality.
      Given that these protective effects may be benefiting caregivers from higher-reach PSE neighborhoods, and the generalizability of the results from a statewide, population-based survey, the current study offers the strongest evidence to date in support of the potential beneficial impact of PSEs.
      The USDA-FNS categorizes SNAP-Ed approaches as individual or group-based direct education, multilevel interventions, and community and public health interventions.

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      The USDA-FNS mandates that SNAP-Ed include a combination of these approaches, per the Social Ecological Model, which posits that individual behavior change and resulting health outcomes are best achieved by addressing (through programs or policies) different influential levels of society, such as communities and organizations.

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      ,

      US Department of Agriculture. Dietary Guidelines for Americans: 2015–2020.https://health.gov/dietaryguidelines/2015/resources/2015-2020_Dietary_Guidelines.pdf. Accessed December 17, 2019.

      Specifically, the USDA-FNS requires states to implement 2 of 3 approaches, with PSE change interventions, as multilevel or public health approaches, accompanying direct education.

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      The significant correlations presented in the current study between residing near 1 or more PSEs and decreased consumption of SSBs and added sugars, and improved overall diet quality, regardless of levels of direct education, suggest that individual or group-based education interventions may not be required to change nutrition behaviors. Thus, multilevel interventions could exclude direct education, and community and public health interventions without direct education may still be effective in changing unhealthful dietary behaviors.
      The temporal sequence between the independent variable and outcome measures is unknown and represents the most noteworthy limitation of the current study. In addition, covariates other than those included in the statistical models, such as local or regional non-SNAP-Ed efforts to improve dietary behaviors among low-income populations, might explain the findings. Shortcomings of the study also include self-reported information on dietary intake and not being able to identify which PSE interventions were more effective than others, and in turn identify those that meet the criteria for research-based PSE interventions.

      US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

      Finally, with Cohen d for SSBs, added sugars, and HEI–2015 scores failing to meet the criterion for small effects, the implications of the findings must be interpreted with caution.

      IMPLICATIONS FOR RESEARCH AND PRACTICE

      The findings from the current ecological study provide the strongest published evidence to date that PSE change interventions may be effective in improving dietary behaviors among the SNAP-Ed eligible population, regardless of direct education activities. The results offer initial confirmation that federal and state agencies are justified in promoting or requiring PSE change interventions as public health approaches to addressing chronic diseases, specifically those related to poor dietary behaviors. Attempts to replicate the current methods and findings are encouraged to provide additional evidence to support the continued investment in PSEs, and the ongoing funding of SNAP-Ed overall.
      Whether multilevel interventions that include direct education activities, as required by the USDA-FNS, produce larger effect sizes than those observed in the current study, and the cost-effectiveness of these interventions vs PSE change interventions alone, are questions worthy of future study. The results of such studies would provide greater empirical support for the USDA-FNS's continued stance on direct education as a required component of multilevel and community and public health interventions.

      ACKNOWLEDGMENTS

      The California Department of Social Services funded the California Family Health Study and provided the salary and consulting support to the authors (grant number 18-3045 to F. Molitor and grant number 18-7014 to C. Doerr).
      The California Department of Social Services is funded by the USDA's Supplemental Nutrition Assistance Program (SNAP). The authors thank the staff of the Public Health Survey Research Program at California State University, Sacramento, and Director Julia C. Tomassilli, for their dedication to collecting valid survey data from at-risk populations and treating respondents with dignity and respect.

      REFERENCES

        • Honeycutt S
        • Leeman J
        • McCarthy WJ
        • et al.
        Evaluating policy, systems, and environmental change interventions: lessons learned from CDC's Prevention Research Centers.
        Prev Chronic Dis. 2015; 12: E174
      1. US Department of Agriculture. FY 2021 Supplemental Nutrition Assistance Program Education plan guidance.https://snaped.fns.usda.gov/sites/default/files/documents/508_Compliant_FY_2021_SNAP-Ed_Plan_Guidance_04-13-2020_No_Doc_Number.pdf. Accessed April 21, 2020.

        • Savoie-Roskos MR
        • DeWitt K
        • Coombs C
        Changes in nutrition education: a policy, systems, and environmental approach.
        J Nutr Educ Behav. 2018; 50: 431
        • Nitta M
        • Navasca D
        • Tareg A
        • Palafox NA
        Cancer risk reduction in the US Affiliated Pacific Islands: utilizing a novel policy, systems, and environmental (PSE) approach.
        Cancer Epidemiol. 2017; 50: 278-282
        • Rohan EA
        • Chovnick G
        • Rose J
        • Townsend JS
        • Young M
        • Moore AR
        Prioritizing population approaches in cancer prevention and control: results of a case study evaluation of policy, systems, and environmental change.
        Popul Health Manag. 2019; 22: 205-212
        • Kegler MC
        • Honeycutt S
        • Davis M
        • et al.
        Policy, systems, and environmental change in the Mississippi Delta: considerations for evaluation design.
        Health Educ Behav. 2015; 42: 57S-66S
        • Hardison-Moody A
        • Fuller S
        • Jones L
        • et al.
        Evaluation of a policy, systems, and environmental-focused faith-based health promotion program.
        J Nutr Educ Behav. 2020; 52: 640-645
        • Parsons AA
        • Monteban M
        • Lee E
        • et al.
        Indicators of readiness and capacity for implementation of healthy eating strategies in child care settings serving low-income children.
        J Nutr Educ Behav. 2019; 51: 465-477
        • Fagen MC
        • Asada Y
        • Welch S
        • et al.
        Policy, systems, and environmentally oriented school-based obesity prevention: opportunities and challenges.
        J Prev Interv Community. 2014; 42: 95-111
        • Patel S
        • Kwon S
        • Arista P
        • et al.
        Using evidence-based policy, systems, and environmental strategies to increase access to healthy food and opportunities for physical activity among Asian Americans, Native Hawaiians, and Pacific Islanders.
        Am J Public Health. 2015; 105: S455-S458
        • Naja-Riese A
        • Keller KJM
        • Bruno P
        • et al.
        The SNAP-Ed Evaluation Framework: demonstrating the impact of a national framework for obesity prevention in low-income populations.
        Transl Behav Med. 2019; 9: 970-979
        • Bunnell R
        • O'Neil D
        • Soler R
        • et al.
        Fifty communities putting prevention to work: accelerating chronic disease prevention through policy, systems and environmental change.
        J Community Health. 2012; 37: 1081-1090
        • Lepe S
        • Goodwin J
        • Mulligan KT
        • Balestracci K
        • Sebelia L
        • Greene G
        Process evaluation of a policy, systems, and environmental change intervention in an urban school district.
        J Nutr Educ Behav. 2019; 51: 307-317
        • Molitor F
        • Sugerman SB
        • Sciortino S
        Fruit and vegetable, fat, and sugar-sweetened beverage intake among low-income mothers living in neighborhoods with Supplemental Nutrition Assistance Program-Education.
        J Nutr Educ Behav. 2016; 48: 683-690
      2. California Department of Social Services. California SNAP-Ed 2019 Annual Report.https://www.cdss.ca.gov/Portals/41/Documents/FFY%202019%20Annual%20Report_FINAL_ADA.pdf. Accessed June 23, 2020.

      3. National Cancer Institute. Automated self-administered 24-Hour (ASA24®) Dietary Assessment Tool.https://epi.grants.cancer.gov/asa24/. Accessed April 25, 2020.

      4. California Department of Social Services. FFY 2017–2019 California State Plan: Supplemental Nutrition Assistance Program-Education: October 1, 2016 – September 30, 2019.http://www.cdss.ca.gov/foodstamps/res/pdf/FFY18CASNAPEdStatePlan.pdf. Accessed April 25, 2020.

      5. National Cancer Institute. Basic steps in calculating HEI scores. https://epi.grants.cancer.gov/hei/calculating-hei-scores.html. Accessed November 16, 2018.

      6. US Department of Agriculture. Dietary Guidelines for Americans: 2015–2020.https://health.gov/dietaryguidelines/2015/resources/2015-2020_Dietary_Guidelines.pdf. Accessed December 17, 2019.

      7. US Department of Agriculture. Producing PEARS, a data tracking system.https://snaped.fns.usda.gov/success-stories/producing-pears-data-tracking-system. Accessed December 17, 2019.

      8. US Department of Agriculture. ChooseMyPlate.https://www.choosemyplate.gov/MyPlate. Accessed January 9, 2019.

        • Chai W
        • Fan JX
        • Wen M
        Association of individual and neighborhood factors with home food availability: evidence from the National Health and Nutrition Examination Survey.
        J Acad Nutr Diet. 2018; 118: 815-823
        • Hu EA
        • Steffen LM
        • Coresh J
        • Appel LJ
        • Rebholz CM
        Adherence to the Healthy Eating Index-2015 and other dietary patterns may reduce risk of cardiovascular disease, cardiovascular mortality, and all-cause mortality.
        J Nutr. 2020; 150: 312-321