Abstract
Objective
Develop reliable, valid questions to assess changes in food resource management (FRM)
behaviors in adults with limited incomes.
Design
Questionnaire development using a mixed-methods approach: content validity (subject
matter and curricula), face validity, temporal reliability (test-retest), sensitivity
to change, and exploratory factor analysis (EFA).
Setting
Community settings in 12 states.
Participants
Convenience samples of English-speaking Expanded Food and Nutrition Education Program (EFNEP) or EFNEP-eligible adults: 105 (cognitive interviews), 181 (test-retest),
185 (sensitivity), and 389 (EFA) adults.
Variables Measured
Behaviors related to FRM skills: planning, shopping, and budgeting.
Analysis
Consistency and agreement in cognitive interviews and temporal reliability; sensitivity
at posttest (paired t tests, Wilcoxon signed-rank tests); internal consistency of scales identified in
EFA (Cronbach α). P < 0.5.
Results
All questions had acceptable temporal reliability ranges for the intraclass correlation
coefficient (0.48–0.74) and Spearman rank-order correlation (0.48–0.73). All questions
were sensitive to change at posttest (P < 0.001). Planning and saving scales, revealed by EFA, demonstrated internal consistency
(> 0.80 Cronbach α).
Conclusions and Implications
The 9 FRM behavior questions have acceptable temporal reliability and content and
face validity and can be used nationally by EFNEP to assess participants’ self-reported
behavior changes. Other nutrition programs with similar audiences and content could
use these questions to measure changes in FRM behaviors.
Key Words
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessSNEB Member Login
SNEB Members, full access to the journal is a member benefit. Login via the SNEB Website to access all journal content and features.Subscribe:
Subscribe to Journal of Nutrition Education and BehaviorAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
REFERENCES
Kumcu A, Kaufman P. Food spending adjustments during recessionary times.https://www.ers.usda.gov/amber-waves/2011/september/food-spending/. Accessed September 8, 2021.
- Well-being of parents and children during the COVID-19 pandemic: a national survey.Pediatrics. 2020; 146e2020016824
- High level of food insecurity among families with children seeking routine care at federally qualified health centers during the coronavirus disease 2019 pandemic.J Pediatr X. 2020; 4100044
- Household Food Security in the United States in 2019.US Department of Agriculture, Economic Research Service, 2020 (Economic Research Report Number 275.) (Accesed September 8, 2021)
Fitzpatrick KM, Harris C, Drawve G. Assessing U.S. food insecurity in the United States during COVID-19 pandemic. University of Arkansas; 2020.https://fulbright.uark.edu/departments/sociology/research-centers/community-family-institute/_resources/community-and-family-institute/revised-assessing-food-insecurity-brief.pdf. Accessed August 22, 2021.
- Financial management skills are associated with food insecurity in a sample of households with children in the United States.J Nutr. 2012; 142: 1865-1870
- Improving health and increasing wealth: research insights and program outreach.J Natl Ext Assoc Fam Consumer Sci. 2017; 12: 11-23
- The impact of nutrition education on food insecurity among low-income participants in EFNEP.Fam Consum Sci Res J. 2003; 32: 127-139
- Food resource management mediates the relationship between participation in a SNAP-Ed nutrition education program and diet quality.J Nutr Educ Behav. 2021; 53: 401-409
- Food shopping practices are associated with dietary quality in low-income households.J Nutr Educ Behav. 2001; 33 (suppl 1): S16-S26
US Department of Agriculture, National Institute of Food and Agriculture. Community Nutrition Education Logic Model (CNE).https://nifa.usda.gov/resource/community-nutrition-education-cne-logic-model. Accessed September 8, 2021.
- The Expanded Food and Nutrition Education Program Policies.National Institute of Food and Agriculture, 2017 (Accessed September 8, 2021)
- Dietary Guidelines for Americans, 2020–2025.9th ed. US Department of Agriculture, 2020 (Accessed September 8, 2021)
- Physical Activity Guidelines for Americans.2nd ed. US Department of Health and Human Services, 2018 (Accessed September 8, 2021)
US Department of Health and Human Services. Keep food safe.https://www.foodsafety.gov/keep-food-safe. Accessed September 8, 2021.
- Improving measurement of the EFNEP outcomes using factor analysis of the Behavior Checklist.J Ext. 2011; 49 (Article 6)
- Methodology for developing a new EFNEP food and physical activity behaviors questionnaire.J Nutr Educ Behav. 2017; 49 (777–783.e1)
- Development of a national dietary behaviors questionnaire for EFNEP adult participants.J Nutr Educ Behav. 2020; 52: 1088-1099
- Validating responses to a food safety survey with observations of food preparation behaviors among limited resource populations.Food Prot Trends. 2019; 39: 449-460
- EFNEP Basics for New Coordinators: the Expanded Food and Nutrition Education Program (EFNEP).US Department of Agriculture, 2014 (Accessed September 8, 2021)
- Shopping behaviors of low-income families during a 1-month period of time.J Nutr Educ Behav. 2013; 45: 20-29
- Food preparers: their food budgeting, cost-cutting, and meal planning practices.Fam Econ Nutr Rev. 1997; 10: 34-37
- Nutrition content in a national nutrition education program for low-income adults: content analysis and comparison with the 2010 Dietary Guidelines for Americans.J Nutr Educ Behav. 2015; 47 (566–573.e1)
Expanded Food and Nutrition Education Program (EFNEP) digital resources. Adult evaluation archive. US Department of Agriculture; 2012.https://efnepdigitalresources.org/wp-content/uploads/2019/09/Adult-Evaluation-Archives.pdf. Accessed September 8, 2021.
Wardlaw MK, Hanula G. EFNEP Behavior Checklist Review. US Department of Agriculture; 2012.https://nifa.usda.gov/sites/default/files/resource/Behavior%20Checklist%20Review.pdf. Accessed September 9, 2021.
- Fruit and vegetable shopping practices and social support scales: a validation.J Nutr Educ Behav. 2006; 38: 340-351
- Prototype Notebook: Short Questions on Dietary Intake, Knowledge, Attitudes and Behaviors.US Department of Agriculture, Economic Research Service, Food and Rural Economics Division, 2004 (Accessed September 8, 2021)
- Review of evaluation tools used to assess the impact of nutrition education on dietary intake and quality, weight management practices, and physical activity of low-income audiences.J Nutr Educ. 2001; 33: S35-S48
- Development of a Questionnaire to Assess the Dietary Behavior of Low-Income Populations.Economic Research Service, US Department of Agriculture, 2009 (Accessed September 8, 2021)
- Best practices for developing and validating scales for health, social, and behavioral research: a primer.Front Public Health. 2018; 6: 149
- Scale Development: Theory and Applications.3rd ed. SAGE Publications, Inc, 2011
- Evaluating Food Stamp Nutrition Education: process for development and validation of evaluation measures.J Nutr Educ Behav. 2006; 38: 18-24
- Practical and relevant self-report measures of patient health behaviors for primary care research.Ann Fam Med. 2005; 3: 73-81
- Brief psychosocial fruit and vegetable tool is sensitive for the US Department of Agriculture's nutrition education programs.J Am Diet Assoc. 2007; 107: 2120-2124
- Research Synthesis: the practice of cognitive interviewing.Public Opin Q. 2007; 71: 287-311
Willis G. Cognitive Interviewing and Questionnaire Design: A Training Manual. US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics. 1994. Working Paper Series, No. 7. American Statistical Association; 1999.http://www.srl.uic.edu/links/CMS_WP07_Willis_1994_CogIntTraining.pdf. Accessed September 9, 2021.
- Assessing factorial and convergent validity and reliability of a food behaviour checklist for Spanish-speaking participants in US Department of Agriculture nutrition education programmes.Public Health Nutr. 2011; 14: 1165-1176
- Exploratory factor analysis and confirmatory factor analysis.in: Cooper H Camic PM Long DL Panter AT Rindskopf D Sher KJ APA Handbook of Research Methods in Psychology: Data Analysis and Research Publication Vol. 3. American Psychological Association, 2012: 361-390
- Sample size requirements for the internal validation of psychiatric scales.Int J Methods Psychiatr Res. 2011; 20: 235-249
- A First Course in Factor Analysis.Academic Press, 1973
- Health Measurement Scales: A Practical Guide to Their Development and Use.5th ed. Oxford University Press, 2015
- Examining test–retest reliability: an intra-class correlation approach.Nurs Res. 2002; 51: 59-62
- Relation of sample size to the stability of component patterns.Psychol Bull. 1988; 103: 265-275
- The application of electronic computers to factor analysis.Educ Psychol Meas. 1960; 20: 141-151
- Research in Health Care: Concepts, Designs and Methods.Stanley Thornes, 2000
- Validity and reliability of the instrument using exploratory factor analysis and Cronbach alpha.Int J Acad Res Bus Soc Sci. 2017; 7: 400-410
- Best practices for missing data management in counseling psychology.J Couns Psychol. 2010; 57: 1-10
- Measurement reliability and agreement in psychiatry.Stat Methods Med Res. 1998; 7: 301-317
- A model and research approach for studying the management of limited food resources by low income families.J Nutr Educ. 1989; 21: 162-171
- The development and validation of measures to assess cooking skills and food skills.Int J Behav Nutr Phys Act. 2017; 14: 118
- Using a grocery list is associated with a healthier diet and lower BMI among very high-risk adults.J Nutr Educ Behav. 2015; 47: 259-264
- Meal planning is associated with food variety, diet quality and body weight status in a large sample of French adults.Int J Behav Nutr Phys Act. 2017; 14: 12
- Selecting items for a food behavior checklist for a limited-resource audience.J Nutr Educ Behav. 2003; 35: 69-77
- Developing a measure of behavior change in a program to help low-income parents prevent unhealthful weight gain in children.J Nutr Educ Behav. 2012; 44: 12-21
- Validity and reliability of the Healthy Families Survey: a key component of the Maryland Supplemental Nutrition Assistance Program–Education (SNAP-Ed) evaluation.J Nutr Educ Behav. 2018; 50: 632-637
- Assessing face validity of a food behavior checklist for limited-resource Filipinos.Hawaii J Med Public Health. 2015; 74: 334-340
- Validity and reliability of a food skills questionnaire.J Nutr Educ Behav. 2019; 51: 857-864
- Validity and reliability of a short questionnaire for assessing the impact of cooking skills interventions.J Hum Nutr Diet. 2011; 24: 588-595
- Maternal literacy and associations between education and the cognitive home environment in low-income families.Arch Pediatr Adolesc Med. 2009; 163: 832-837
- Improving the quality of data from EFNEP participants with low literacy skills: a participant-driven model.J Nutr Educ Behav. 2014; 46: 309-314
- Practical guide to measuring physical activity.J Acad Nutr Diet. 2014; 114: 199-208
- Response shift bias: a problem in evaluating nutrition training using self-report measures.J Nutr Educ. 2001; 33: 165-170
- Effects of social approval bias on self-reported fruit and vegetable consumption: a randomized controlled trial.Nutr J. 2008; 7: 18
Expanded Food and Nutrition Education Program (EFNEP). Adult Questionnaire. US Department of Agriculture, National Institute of Food and Agriculture; 2020.https://efnepdigitalresources.org/wp-content/uploads/2020/07/EFNEP-Adult-Questionnaire.pdf. Accessed September 8, 2021.
Article info
Publication history
Published online: February 04, 2022
Accepted:
November 16,
2021
Footnotes
Conflict of Interest Disclosure: The authors have not stated any conflicts of interest.
Identification
Copyright
© 2021 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.
