Research Article| Volume 47, ISSUE 4, P308-316.e1, July 2015

Download started.


Development and Validation of the Guide for Effective Nutrition Interventions and Education (GENIE): A Tool for Assessing the Quality of Proposed Nutrition Education Programs

Published:April 27, 2015DOI:



      To develop and validate the Guide for Effective Nutrition Interventions and Education (GENIE), a checklist of research-based quality indicators for nutrition education programs.


      A prospective test of criterion validity and inter-rater reliability of a new tool comparing expert assessments and trained reviewer GENIE scores of the same nutrition education proposals.


      Ten nutrition education experts; 13 volunteer reviewers.

      Variables Measured

      GENIE’s face, content, and criterion validity and inter-rater reliability compared using expert assessments and reviewer objective and subjective scores.


      Reviewer scores compared using Spearman correlation. Inter-rater reliability tested using intra-class correlation (ICC), Cronbach alpha, and ANOVA. Criterion validity tested using independent t test and point bi-serial correlation to compare reviewer with expert scores.


      Correlation found between total objective and total subjective scores. Agreement found between reviewers across proposals and categories considering subjective scores (F = 7.21, P < .001; ICC = 0.76 [confidence interval, 0.53–0.92]) and objective scores (F = 7.88, P < .001; ICC = 0.82 [confidence interval, 0.63–0.94]). Relationship was not significant (r = .564, P = .06) between expert and reviewer proposal scoring groups (high, medium, and low).

      Conclusions and Implications

      Results support the validity and reliability of GENIE as a tool for nutrition education practitioners, researchers, and program funding agencies to accurately assess the quality of a variety of nutrition program plans.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access

      SNEB Member Login

      SNEB Members, full access to the journal is a member benefit. Login via the SNEB Website to access all journal content and features.


      Subscribe to Journal of Nutrition Education and Behavior
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Brun J.
        Nutrition education: a model for effectiveness a synthesis of research.
        J Nutr Educ. 1985; 17 (ii–S44)
        • Ho M.
        • Garnett S.P.
        • Baur L.
        • et al.
        Effectiveness of lifestyle interventions in child obesity: systematic review with meta-analysis.
        Pediatrics. 2012; 130: e1647-e1671
        • Sims
        • Laura S.E.
        [Special issue].
        J Nutr Educ. 1995; 27: 284-286
        • Academy of Nutrition and Dietetics
        Academy of Nutrition and Dietetics Standardized Language Committee. International Dietetics and Nutrition Terminology (IDNT) Reference Manual: Standardized Language for the Nutrition Care Process.
        4th ed. Academy of Nutrition and Dietetics, Chicago, IL2013
        • Nielsen J.N.
        • Gittelsohn J.
        • Anliker J.
        • O’Brien K.
        Interventions to improve diet and weight gain among pregnant adolescents and recommendations for future research.
        J Am Diet Assoc. 2006; 106: 1825-1840
        • Norris S.L.
        • Lau J.
        • Smith S.J.
        • Schmid C.H.
        • Engelgau M.M.
        Self-management education for adults with type 2 diabetes: a meta-analysis of the effect on glycemic control.
        Diabetes Care. 2002; 25: 1159-1171
        • Dusseldorp E.
        • van Elderen T.
        • Maes S.
        • Meulman J.
        • Kraaij V.
        A meta-analysis of psychoeduational programs for coronary heart disease patients.
        Health Psychol. 1999; 18: 506-519
        • Glanz K.
        • Sorensen G.
        • Farmer A.
        The health impact of worksite nutrition and cholesterol intervention programs.
        Am J Heal Promot. 1996; 10: 453-470
        • Desroches S.
        • Lapointe A.
        • Ratté S.
        • Gravel K.
        • Légaré F.
        • Turcotte S.
        Interventions to enhance adherence to dietary advice for preventing and managing chronic diseases in adults.
        Cochrane Database Syst Rev. 2013; 2: CD008722
        • Contento I.R.
        Nutrition education: linking research, theory, and practice.
        Asia Pac J Clin Nutr. 2008; 17: 176-179
        • Contento I.R.
        Nutrition Education.
        2nd ed. Jones and Bartlett Publishers, LLC, Sudbury, MA2011
        • Gillespie A.H.
        • Brun J.K.
        Trends and challenges for nutrition education research.
        J Nutr Educ. 1992; 24: 222-226
        • Contento I.
        Review of nutrition education research in the Journal of Nutrition Education and Behavior, 1998 to 2007.
        J Nutr Educ Behav. 2008; 40: 331-340
        • Lytle L.
        • Achterberg C.
        Changing the diet of America’s children: what works and why?.
        J Nutr Educ. 1995; 27: 250-260
        • Spahn J.M.
        • Reeves R.S.
        • Keim K.S.
        • et al.
        State of the evidence regarding behavior change theories and strategies in nutrition counseling to facilitate health and food behavior change.
        J Am Diet Assoc. 2010; 110: 879-891
        • Nation M.
        • Crusto C.
        • Wandersman A.
        • et al.
        What works in prevention: principles of effective prevention programs.
        Am Psychol. 2003; 58: 449-456
        • Greidanus I.
        • Contento I.
        The relationship between the ability to solve practical nutrition problems in an adult population and piagetian cognitive levels.
        J Nutr Educ. 1989; 21: 73-81
        • Contento I.
        • Balch G.
        • Bronner Y.
        • Paige D.
        • Gross S.
        • Bisignani L.
        The effectiveness of nutrition education and implications for nutrition education policy, programs, and research: a review of research.
        J Nutr Educ. 1995; 7: 277-418
        • Society for Nutrition Education
        State of Nutrition Education & Promotion for Report.
        (Indianapolis, IN)2009
        • US Department of Agriculture Food and Nutrition Service
        WIC Nutrition Services Standards.
        (Alexandria, VA)2013
        • Abusabha R.
        • Peacock J.
        • Achterberg C.
        How to make nutrition education more meaningful through facilitated group discussions.
        J Am Diet Assoc. 1999; 99: 72-76
        • McClelland J.W.
        • Keenan D.P.
        • Lewis J.
        • et al.
        Review of evaluation tools used to assess the impact of nutrition education on dietary intake and quality, weight management practices, and physical activity of low-income audiences.
        J Nutr Educ. 2001; 33: S35-S48
        • US Department of Agriculture Food and Nutrition Service
        Nutrition Education: Principles of Sound Evaluation Impact.
        (Alexandria, VA)2005
        • Contento I.R.
        • Randell J.S.
        • Basch C.E.
        Review and analysis of evaluation measures used in nutrition education intervention research.
        J Nutr Educ Behav. 2002; 34: 2-25
        • Walter S.D.
        • Eliasziw M.
        • Donner A.
        Sample size and optimal designs for reliability studies.
        Stat Med. 1998; 17: 101-110
        • Cohen J.
        Statistical Power Analysis for the Behavioral Sciences.
        L. Erlbaum Associates, Hillsdale, NJ1988: 567
        • Kline P.
        The Handbook of Psychological Testing.
        Psychology Press, New York, NY2000: 744
      1. Gateway to Health Communication & Social Marketing Practice. Centers for Disease Control and Prevention. Accessed February 19, 2015.

      2. The Center for Training and Research Translation Overview. The University of North Carolina Center for Health Promotion and Disease Prevention. Accessed February 19, 2015.

      3. The Community Guide. The Guide to Community Preventative Services. Accessed February 19, 2015.

        • Kerr J.
        • Sallis J.F.
        • Bromby E.
        • Glanz K.
        Assessing reliability and validity of the GroPromo audit tool for evaluation of grocery store marketing and promotional environments.
        J Nutr Educ Behav. 2012; 44: 597-603
        • Dehdari T.
        • Rahimi T.
        • Aryaeian N.
        • Gohari M.R.
        • Esfeh J.M.
        Developing and testing a measurement tool for assessing predictors of breakfast consumption based on a health promotion model.
        J Nutr Educ Behav. 2014; 46: 250-258
        • Hand R.K.
        • Medrow L.
        • Brown K.
        Developing and Assessing Nutrition Education Handouts (DANEH): testing the validity and reliability of the new tool.
        J Acad Nutr Diet. 2015; ([published online ahead of print])
        • Abram J.K.
        • Hand R.K.
        • Parrott J.S.
        • Ziegler P.J.
        • Steiber A.L.
        What is your nutrition program missing? Finding answers with the Guide for Effective Nutrition Interventions and Education (GENIE).
        J Acad Nutr Diet. 2015; 115: 122-130