Advertisement
Research Article| Volume 45, ISSUE 5, P392-403, September 2013

Download started.

Ok

Psychosocial Measures Used to Assess the Effectiveness of School-based Nutrition Education Programs: Review and Analysis of Self-report Instruments for Children 8 to 12 Years Old

      Abstract

      Objective

      To identify the psychometric properties of evaluation instruments that measure mediators of dietary behaviors in school-aged children.

      Design

      Systematic search of scientific databases limited to 1999–2010.

      Main Outcome Measures

      Psychometric properties related to development and testing of self-report instruments for children 8–12 years old.

      Analysis

      Systematic search of 189 articles and review of 15 instruments (20 associated articles) meeting the inclusion criteria. Search terms used included children, school, nutrition, diet, nutrition education, and evaluation.

      Results

      Fourteen studies used a theoretical framework to guide the instrument's development. Knowledge and self-efficacy were the most commonly used psychosocial measures. Twelve instruments focused on specific nutrition-related behaviors. Eight instruments included over 40 items and used age-appropriate response formats. Acceptable reliability properties were most commonly reported for attitude and self-efficacy measures. Although most of the instruments were reviewed by experts (n = 8) and/or pilot-tested (n = 9), only 7 were tested using both rigorous types of validity and with low-income youth.

      Conclusions and Implications

      Results from this review suggest that additional research is needed to develop more robust psychosocial measures for dietary behaviors, for low-income youth audiences.

      Key Words

      Introduction

      Childhood obesity is a serious public health issue in the United States (US) that affects a greater proportion of children from lower-socioeconomic families and from minority groups.
      • Rossen L.M.
      • Schoendorf K.C.
      Measuring health disparities: trends in racial-ethnic and socioeconomic disparities in obesity among 2- to 18-year old youth in the United States 2001-2010.
      • Odgen C.L.
      • Carroll M.D.
      • Kit B.K.
      • Flegal K.M.
      Prevalence of obesity and trends in obesity mass index among US children and adolescents, 1999-2010.
      In 2009–2010, the prevalence of obesity among school children aged 6–11 years was 18%.
      • Odgen C.L.
      • Carroll M.D.
      • Kit B.K.
      • Flegal K.M.
      Prevalence of obesity and trends in obesity mass index among US children and adolescents, 1999-2010.
      To combat this problem, many federally and non-federally funded school-based nutrition education programs promoting healthy eating and physical activity behaviors have been implemented. Effective school-based nutrition programs have 2 components: They must be behaviorally focused and they must include theory-driven educational strategies.
      • Roseman M.G.
      • Riddell M.C.
      • Haynes J.N.
      A content analysis of kindergarten-12th grade school-based nutrition interventions: taking advantage of past learning.
      • Contento I.R.
      Nutrition Education: Linking Research, Theory, and Practice.
      Research suggests that in addition to know-ledge, youth nutrition intervention programs should target essential mediators of behavior change (psychosocial constructs), such as outcome expectations, behavioral skills, habits, self-efficacy, and environmental and social support.
      • Cerin E.
      • Barnett A.
      • Baranowski T.
      Testing theories of dietary behavior change in youth using the mediating variable model with intervention programs.
      • Baranowski T.
      • Cerin E.
      • Baranowski J.
      Steps in the design, development, and formative evaluation of obesity prevention-related behavior change trials.
      • Contento I.R.
      • Randell J.S.
      • Basch C.E.
      Review and analysis of evaluation measures used in nutrition education research.
      Unfortunately, there is little evidence that assesses the extent to which these mediators of behavior are implemented into school-based nutrition education programs; therefore, it is unclear how these programs promote behavioral change.
      To produce consistent and correct information about the quality, accountability, and effectiveness of nutrition education, youth nutrition interventions need a comprehensive evaluation component with appropriate (ie, theory-driven, age/culturally appropriate), valid, and reliable measures.
      • Dignan M.B.
      • Steckler A.R.
      • Goodman R.M.
      Measurement and Evaluation of Health Education.
      • Townsend M.S.
      • Kaiser L.L.
      • Allen L.H.
      • Joy A.B.
      • Murphy S.P.
      Selecting items for a food behavior checklist for a limited resource audience.
      • Sherwood N.E.
      • Story M.
      • Neumark-Sztainer D.
      • Adkins S.
      • Davis M.
      Development and implementation of a visual card-sorting technique for assessing food and activity preferences and patterns in African American girls.
      Despite this need, a review conducted by Contento et al
      • Baranowski T.
      • Cerin E.
      • Baranowski J.
      Steps in the design, development, and formative evaluation of obesity prevention-related behavior change trials.
      in 2002 on nutrition education intervention studies found that overall, nutrition evaluation measures used and reported in the literature between 1980 and 1999 had significant limitations. The analysis revealed that psychometric properties were not reported and the scope of the measure was often mismatched with the program's objectives, duration, and intensity. Sample sizes were often not large enough either to report validity and reliability by ethnicity or other factors.
      • Baranowski T.
      • Cerin E.
      • Baranowski J.
      Steps in the design, development, and formative evaluation of obesity prevention-related behavior change trials.
      The purpose of this article is to review psychosocial measures of potential mediators of behavior change used with school-aged children, published between 1999 and 2010. The specific aims were to identify and describe self-report evaluation instruments that assess psychosocial measures related to dietary behaviors in school-aged children, and to assess the psychometric properties of such evaluation instruments. Results from this study will attempt to inform nutrition educators and researchers about quality measures and useful evaluation instruments to be considered for the evaluation of school-based nutrition education programs.

      Methods

      Evaluation instruments that aimed to evaluate psychosocial measures of dietary behavioral change for children were systematically reviewed. Searches of electronic databases were limited to 1999–2010 and included Ebsco, PubMed, Scholar Google, and Web of Knowledge. Search terms used were: children, school, nutrition, diet, nutrition education, evaluation, measures, questionnaire, survey, instrument, questionnaire development, survey development, instrument development, psychometric, validity, reliability, psychosocial constructs, and mediators of behavior and theory. The combination of search terms followed the same order: (1) study population terms (ie, children), (2) intervention terms (ie, nutrition), (3) psychometric terms (ie, validity), and (4) theory-based terms (ie, psychosocial constructs). Reference lists of selected studies and relevant published reviews were also searched.
      The initial database and references search revealed 9,810 articles. One of the authors scanned titles and abstracts across sources and across electronic databases for relevancy and duplicates. After this initial screening, 2 authors independently reviewed the full papers of relevant articles (n = 189) against the inclusion/exclusion criteria. Instruments were selected for review if they met all of the following inclusion criteria: (1) published in a peer-reviewed journal; (2) designed for outcome evaluation of nutrition education programs; (3) assessed psychosocial measures of dietary behavioral change for children ages 8–12 years old; (4) written in English; (5) paper-and-pencil self-report instruments completed by youth (not parents); and (6) reported psychometric properties. Instruments were excluded if they were used for descriptive studies of correlates of dietary intake, and for the evaluation of overweight and obesity treatments, clinical studies, or physical activity interventions. Evaluation instruments or measures that had multiple publications were counted as 1 study. Using this method (Figure), 15 instruments (20 associated studies) were selected for review.
      Figure thumbnail gr1
      FigureFlowchart depicting systematic literature for identification of evaluation instruments used in school-based interventions.
      Descriptive information from each selected instrument was extracted and tabulated. Variables of interest included name of the instrument; name of the school-nutrition program associated with the instrument; details about how the instruments were conceptualized (including type of selected outcome measures, theoretical framework used to design the instrument, and whether it was curriculum-based); details about the instruments' construction (whether the items or instruments were new or adapted, type of topics covered, number of items, response options format, and completion time); information on reliability, validity, and scope of pilot testing (ie, cognitive interviews); and general characteristics of the participants (ie, sample size, age group, gender, socioeconomic status, race/ethnicity).
      For reliability, researchers reviewed only those studies that reported acceptable internal consistency (Cronbach α > .6) and test-retest reliability (intra-class correlation [ICC], κ statistics, or Pearson/Spearman correlation [r] > .6).
      • Biddle S.J.
      • Gorely T.
      • Pearson N.
      • Bull F.C.
      An assessment of self-reported physical activity instruments in young people for population surveillance: Project ALPHA.
      For validity, researchers reviewed whether the instrument was tested for content and face validity, which are less rigorous types of validity (designated as type 1 validity in the current review), and/or for construct, convergent, concurrent, and predictive validity, which are more rigorous types of validity (designated as type 2 validity in the current review).
      • DeVellis R.F.
      Scale Development: Theory and Application.
      This was a literature review and human subjects were not used; therefore, human subjects approval was not sought.

      Results

      More than 20 types of outcome measures of potential psychosocial mediators of dietary behavior change were identified, including individual, social, and environmental (Table 1). Besides nutrition-related concepts, content areas such as physical activity and food safety were also included in some of the reviewed instruments (Table 1). Several approaches were used to develop and test the reviewed evaluation instruments (Table 2).
      Table 1Conceptualization and Construction Characteristics of Instruments Used to Evaluate the Effectiveness of Nutrition Education Programs in School-aged Children
      ConceptualizationConstruction
      Name of Instrument/ProgramSelected Outcome MeasuresTheoretical FrameworkCurriculum-basedNew, Adapted, or BothTopics CoveredItems, nResponse OptionsCompletion Time
      After School Student Questionnaire/CATCH Kids Club
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      Previous dietary intake, sedentary lifestyle and participation in sport activities, dietary knowledge, dietary intentions, self-efficacy for healthy food and for physical activity.SCTYesAdaptedBehaviorally focused: low-fat and low-sodium foods/physical activity58Multiple choice/paired food choices/3-point scaleNR
      Knowledge, Attitudes, and Behaviors Questionnaire/Pathways
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      Physical activity self-efficacy, social support, barriers, self-perception. Dietary knowledge, self-efficacy, social support, intentions, food frequency, weight-related attitudes, cultural identity.SLTNoAdaptedBehaviorally focused: low-fat foods and sugared beverages/physical activity/weight/cultural identity65 core items + 5 knowledge questionsMultiple choice/paired food choices 4-point scale/3-point scaleTwo sessions of 30 min
      Kids Kartoon/California Expanded Food and Nutrition Education Program—Eating Right Is Basic
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      Nutrition and food safety knowledge, food selection and preparation skills, and food safety practices.NRYesNewGeneral nutrition (ie, variety of foods, food selection, food preparation, and safety skills)16Multiple choiceNR
      Nutrition Knowledge, Attitudes and Practices questionnaire/Healthy Lifestyle in Children
      • Sabariah S.
      • Zalilah M.S.
      • Norlijah O.
      • et al.
      Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
      Nutrition knowledge, attitudes, and practices.NRNRAdaptedGeneral nutrition (ie, Food Guide Pyramid,
      Now referred to as MyPlate.
      breakfast, fast foods, healthy snacks, high-salt food, high-sugar foods, high-fat foods, calcium, nutrients, grains, V)
      44Multiple choice/3-point scale/4-point scale30–60 min
      Questionnaire/Pro Children Project
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      Self-rated for F&V intake, knowledge, attitudes, liking, subjective norm, parental encouragement, self-efficacy, intention, habit, preferences, family rules, availability at home, availability away from home, and perceived barriers.SCT, TTM, TPBNRNewBehaviorally focused: F&V1043-point scale/4-point scaleNR
      Questionnaire/Adequate Calcium Today Study
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      Calcium attitudes and preferences subscales: convenience, health benefits, preferences, temperature, tolerance, taste and weight; calcium social and environmental subscales: availability and social influence; calcium knowledge.SCTNRBothBehaviorally focused: calcium-rich foods55Multiple choice/5-point scale< 10 min
      Psychosocial Measures for Whole-grain Intake Among Children/NR
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      Whole-grain knowledge, intention, availability, self-efficacy.SCTNRBothBehaviorally focused: Whole grains14Multiple choice/paired food choices/3-point scaleNR
      Nutrition Questionnaire for Students in Years 5, 6, 7/Eat Well Be Active
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      Dietary patterns related to childhood obesity. Nutrition behaviors, attitudes, environment, and knowledge.NRNRNewBehaviorally focused: Non-core foods, sweetened beverages, F&V, and waterNR5-point scale/choice of frequencies20 min
      Mediating Variables of a School-based Nutrition Intervention/High 5
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      F&V availability, knowledge, positive outcome expectancies, negative outcome expectancies, self-efficacy, peer norms, family norms, and teacher norms.SCTNRBothBehaviorally focused: F&V77Multiple choice/true–false/ 3-point scaleNR
      Fruit and Vegetables Attitudes, Self-efficacy, and Social-Environmental Influences/NR
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      F&V scales: general attitudes, health and physical ability outcome expectancy, social outcome expectancy, preferences, self-efficacy in difficult situations, self-efficacy to choose F&V, self-efficacy on selecting F&V over other items, peer support, perceived peer support, perceived parental behavior, socialization-encouragement, permissive eating practices, obligation rules, and availability.NRNRAdaptedBehaviorally focused: F&VNR4-point scale/5-point scale/7-point scaleNR
      Questionnaire to Assess Applied Nutrition Knowledge/After School Cookery Club
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      Knowledge of applied nutrition and food preparation. Perceived confidence in cooking skills.NRNRNewGeneral nutrition (ie, healthful food choices, food preparation, and cooking)36Multiple choice/4-point scale< 15 min
      FJV Children's Psychosocial Measures/Gimme 5 Fruit, Juice, and Vegetables for Fun and Health Program
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      FJV knowledge, snack preference, positive outcome expectations, asking and shopping self-efficacy, social norms, and asking behaviors.SCTNRBothBehaviorally focused: F&V44Multiple choice/paired food choices/3-point scale/4-point scale/5-point scale/dichotomous scale30–60 min
      Nutrition Knowledge Questionnaire and Food Preference Survey/Nutrition to Grow On
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      Nutrition knowledge and V preferences.SCTYesNewGeneral nutrition and behaviorally focused (ie, V)30 and 36Multiple choice and dichotomous scale 5-point ordinalNR
      Dietary psychosocial scales/Weight Gain Prevention Study
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      Self-efficacy and outcome expectancies for healthy eating, and beverage preferences.SCTNRBothGeneral nutrition and behaviorally focused (ie, sweetened and unsweetened beverages)473-point scaleNR
      Self-efficacy questionnaires/After-school program for urban Native American youth
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      Self-efficacy.SCTNRNewGeneral nutrition (ie, sweetened and unsweetened beverages, F&V, low-fat foods)NR3-point scaleNR
      CATCH indicates Coordinated Approach to Child Health; F&V, fruits and vegetables; FJV, fruits, juices, and vegetables; NR, not reported; SCT, Social Cognitive Theory; SLT, Social Learning Theory; TPB, Theory of Planned Behavior; TTM, Transtheoretical Model; V, vegetables.
      a Now referred to as MyPlate.
      Table 2Questionnaire Testing, With Information on Subscales With Acceptable Reliability and Validity, Pilot-testing Information, and Participants' Characteristics
      Reliability AssessmentValidity Assessment
      Name of Instrument/ProgramCronbach αTest-Retest ReliabilityType 1Type 2Pilot TestedSample SizeCountryParticipant Age or GradeParticipant Ethnicity/Gender/ Socioeconomic Status
      After School Student Questionnaire/CATCH Kids Club
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      NR
      This instrument was based on the School-based Nutrition Monitoring Student Questionnaire and the Health Behavior Questionnaire, which have validity and reliability tests associated with them. Test-retest for nutrition knowledge questions, which the ASSQ covers, ranged from 0.14 to 0.52 for all items for fourth grade, which is part of the targeted audience of ASSQ. In addition, content validity was established through an expert panel
      NR
      There is a parent component to this instrument, but only the youth component was reviewed.
      NRNRNRNRUSThird to fifth gradesWhite, Hispanic, African-American/both/NR
      Knowledge, Attitudes, and Behaviors Questionnaire/Pathways
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      Subscales: Diet self-efficacy, diet intentions, attitudes toward attempts at weight lossSubscales: Body image attitudes, diet intentionsYesNRYes516USThird to fifth gradesAmerican Indian/both/NR
      Kids Kartoon/California Expanded Food and Nutrition Education Program—Eating Right Is Basic
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      Instrument as a wholeNRYesNRYes120US9- to 11-y-oldsNone specified/both/low-income
      Nutrition Knowledge, Attitudes and Practices questionnaire/Healthy Lifestyle in Children
      • Sabariah S.
      • Zalilah M.S.
      • Norlijah O.
      • et al.
      Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
      Subscale: nutrition knowledgeNRYesConstruct validity: factor analysis correlation between scales. Factor analysis yielded 5 factors for knowledge scale; 4 factors for attitudes and practice scales. All scales significantly correlated.Yes335Malaysia8-y-oldsMalay, Chinese, Indian/both/NR
      Questionnaire to measure personal, social, and environmental correlated with F&V intake/Pro Children Project
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      Subscales: F&V self-rated intake, F&V attitudes, F&V liking, F&V active parental encouragement, V perceived barriers, V subjective norm, V availability at home, F knowledgeSubscales: F&V self-rated intake, V knowledge, F attitudes, F&V liking, F&V subjective norm, F&V parental encouragement, V self-efficacy, F&V intention, F&V habit, F&V preferences, F&V availability away from home, F&V perceived barriersNRPredictive validity: Spearman correlations between F&V subscales, V, F intake. Correlations with intake significant except for “allow family rule” with F intake. Moderate to good (r = –.16–.54) for personal determinants, lower predictive validity for social and environmental determinants.Yes326Belgium, Denmark, Norway, Portugal, Spain10- to 11-y-oldsNone specified/both/NR
      Measures of Psychosocial Constructs Associated With Adolescents' Calcium Intake/Adequate Calcium Today Study
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      Subscales: attitudes and preference factor, social and environmental factor, knowledge factorSubscales: attitudes and preference factor, social and environmental factorYesFactor structure: cluster analysis. 3 constructs: attitudes and preference factor; social and environmental factor; knowledge.NR206US11- to 14-y- oldsWhite, Asian-American, Native Hawaiian, Pacific Islander/girls/NR
      Psychosocial Measures for Whole-grain Intake Among Children/NR
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      Subscale: self-efficacy to choose whole-grain foodsSubscales: availability of whole-grain foods in home, self-efficacy to choose whole-grain foods, whole-grain foodNRNRYes150USFifth gradeNone specified/both/NR
      Nutrition Questionnaire for Students in Years 5, 6, 7/Eat Well Be Active
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      Subscales: V attitude, F attitudeSubscales: healthy behavior, V attitude, sweetened beverages intake, F intake, V intakeNRNRYes141AustraliaFifth to seventh gradesPredominately whites/both/NR
      Mediating Variables of a School-based Nutrition Intervention/High 5
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      Subscales: availability, positive outcome expectancies, self-efficacy, peer norms, family norms, teacher normsNRNRConstruct validity: factor analysis for each potential mediator; 8 factors.NR1,676USFourth gradeNone specified/both/NR
      Fruit and Vegetables Attitudes, Self-efficacy, and Social-Environmental Influences/NR
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      Subscales: F&V general attitudes, F&V health and physical ability outcome expectancy, F&V preferences, F&V self-efficacy in difficult situations, self-efficacy for selecting F&V over other items, F&V perceived parental behavior, F&V socialization-encouragement, permissive eating practices, F&V obligation rulesSubscales: F&V preferences, F&V general attitudes, selecting F&V over other items, V perceived peer behavior, F parental behavior, F&V availability, F&V obligation rulesNRPredictive validity: Spearman correlations. Correlations were significant (r = 0.15-0.45) for F preferences, F self-efficacy, F perceived peer behavior, F perceived parental behavior, F&V availability, V preferences, V perceived peer behavior, V perceived parental behavior, F&V obligation rules, permissive eating practices.Yes207Belgium11- to 12-y-oldsNone specified/both/NR
      Questionnaire to Assess Applied Nutrition Knowledge/After School Cookery Club
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      Subscale: food preparation knowledgeAssessed, but subscales were not above thresholdYesNRYes98Scotland and England10- to 13-y-oldsNone specified/both/low-income
      FJV Children's Psychosocial measures/Gimme 5 Fruit, Juice, and Vegetables for Fun and Health Program
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      Subscales: F&V knowledge, F&V preference, snack preference, F&V positive outcome expectations, eating F&V self-efficacy for asking and shopping self-efficacy, social norms, asking behaviorsSubscales: outcome expectancies and self-efficacyNRConstruct validity: principal component analysis for each potential mediator.NR1,250USThird to fifth gradesAfrican- and Euro-American/both/NR
      Nutrition Knowledge Questionnaire and Food Preference Survey/Nutrition to Grow On
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      NRInstrument as a wholeYesNRYes213US9- to 10-y-oldsNone specified/both/low-income (25%)
      Dietary psychosocial scales/Weight Gain Prevention Study
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      Subscale: healthy eating self-efficacy and outcome expectanciesNRNRFood beverage preferences scale with no clear factor structure. IC: self-efficacy/outcome expectancies (r = .26, P ≤ .01). Concurrent validity: higher self-efficacy correlated with lower total energy intake (r = –0.17, P ≤ .01) and grams of fat (r = .16, P ≤ .01).NR303US8- to 10-y-oldsAfrican-Americans/girls/ low-income (24.1%)
      Self-efficacy questionnaires/after-school program for urban Native American youth
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      Subscale: self-efficacy scaleSubscale: self-efficacy scaleYesNRNo53Minneapolis, USNRNative Americans/NR/NR
      ASSQ indicates After School Student Questionnaire; CATCH, Coordinated Approach to Child Health; F, fruits; F&V, fruits and vegetables; IC, intercorrelation; ICC, intra-class correlation; NR, not reported; US, United States; V, vegetables.
      Note: For reliability, only those studies that reported acceptable internal consistency (Cronbach α > .6) and test-retest reliability ICC, κ statistics, or Pearson/Spearman correlation ([r] > .6).
      a This instrument was based on the School-based Nutrition Monitoring Student Questionnaire and the Health Behavior Questionnaire, which have validity and reliability tests associated with them. Test-retest for nutrition knowledge questions, which the ASSQ covers, ranged from 0.14 to 0.52 for all items for fourth grade, which is part of the targeted audience of ASSQ. In addition, content validity was established through an expert panel
      b There is a parent component to this instrument, but only the youth component was reviewed.

      Methodological Practices to Develop the Identified Instruments/Measures

      Only 14 of the 20 studies reported designing evaluation instruments based on explicit theories.
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      Social Cognitive Theory (SCT) was the most commonly used theoretical framework (n = 9). The instruments attempted to assess several theoretical components; however, knowledge (n = 12)
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      • Sabariah S.
      • Zalilah M.S.
      • Norlijah O.
      • et al.
      Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      and self-efficacy (n = 11)
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      were the most frequently assessed individual-level psychosocial measures. Only 3 instruments reviewed included curriculum-specific content.
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      To examine nutrition-related psychosocial measures, most studies either developed new items for their evaluation instruments (n = 6)
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      or included a combination of new items with items from other questionnaires (n = 5).
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      In terms of topics covered, the majority of the instruments included psychosocial scales/items that focus on specific nutrition-related behaviors (n = 12) rather than general nutrition. Psychosocial measures related to fruits and vegetables were the common targets of most of the reviewed instruments.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      Most of the questionnaires included over 40 items (n = 8) and several types of response options. Overall, multiple choice was the response option most frequently employed (n = 10); 3- and 4-point ordinal scales were also used (n = 10). Among studies that reported the estimated questionnaire completion time (n = 6), the length varied widely: 3 reported between 30 and 60 minutes and 3 reported < 20 minutes (many did not report completion time).

      Methodological Practices to Test the Identified Instruments/Measures

      In terms of reliability, results indicated that the majority of instruments had several subscales with an adequate level of internal consistency (n = 13) and test-retest reliability (n = 9). In terms of psychosocial constructs, acceptable levels of internal consistency (Cronbach α > .60) were most commonly reported for attitude (n = 5)
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      and self-efficacy (n = 7)
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      scales. Similarly, scales testing attitudes
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      (n = 5) and self-efficacy
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      (n = 3) most frequently reported acceptable test-retest reliability.
      In terms of validity, 8 instruments were tested for type 1 validity (expert reviews) and 7 were tested and/or had established type 2 validity (more rigorous types of validity).
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Reynolds K.D.
      • Yaroch A.L.
      • Franklin F.A.
      • Maloy J.
      Testing mediating variables in a school-based nutrition intervention program.
      • Reynolds K.D.
      • Franklin F.A.
      • Binkley D.
      • et al.
      Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
      • Domel S.B.
      • Thompson W.O.
      • Davis H.C.
      • Baranowsk T.
      • Leonard S.B.
      • Baranowski J.
      Psychosocial predictors of fruit and vegetable consumption among elementary school children.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Sabariah S.
      • Zalilah M.S.
      • Norlijah O.
      • et al.
      Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      In addition, there was little specific information on type 2 validity analysis (Table 2 notes specific associations between measures and topics), in that the authors did not provide the correlation coefficients between subscales.
      Most (n = 9) of the reviewed instruments were pilot-tested
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Townsend M.S.
      • Johns M.
      • Shilts M.K.
      • Farfan-Ramirez L.
      Evaluation of a USDA nutrition education program for low-income youth.
      • Sabariah S.
      • Zalilah M.S.
      • Norlijah O.
      • et al.
      Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      and intended with use for third to sixth graders, or 8- to 11-year-olds. Seven instruments were tested with ethnic groups other than non-Hispanic white children,
      • Kelder S.
      • Hoelscher D.M.
      • Barroso C.S.
      • Walker J.L.
      • Cribb P.
      • Hu S.
      The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
      • Penkilo M.
      • George G.C.
      • Hoelscher D.M.
      Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      and 4 of the instruments were tested with low-income participants.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Sherrill-Mittleman D.A.
      • Klesges L.M.
      • Lanctot J.Q.
      • Stockton M.B.
      • Klesges R.C.
      Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      For both of these characteristics, less than half of the instruments were tested with ethnically diverse, low-income samples.

      Discussion

      This review demonstrated that although a wide variety of self-report, written instruments have been developed for school-based interventions to evaluate psychosocial measures related to dietary intake, few were tested with rigorous psychometric procedures and/or with youth from low-income, ethnically diverse families.

      Strengths

      A major strength of most of the studies was that the researchers used a theoretical framework to guide the instrument development process. Specifically, SCT
      • Bandura A.
      Social Foundations of Thought and Action: A Social Cognitive Theory.
      was the theoretical framework most commonly reported. Although there is not 1 reference standard behavioral theory upon which nutrition education programs and interventions should be based, a review of nutrition intervention literature has shown that self-efficacy/perceived control, outcome expectations/attitude, habit, and behavioral intention are significant correlates of dietary behavior in children.
      • Contento I.R.
      Nutrition Education: Linking Research, Theory, and Practice.
      Social Cognitive Theory incorporates multiple mediators mentioned, including self-efficacy and outcome expectancies, and is therefore a strong framework upon which to build nutrition education programs and evaluations, particularly for children and youth.
      A second strength of the reviewed studies was that most of the instruments provided evidence of content validity and/or face validity through expert reviews and pilot studies (ie, cognitive interviews), respectively. However, cognitive interviews are particularly important when developing instruments for low-income, ethnically diverse populations, because they allow researchers to identify language and wording that is not culturally appropriate. Overall, both expert reviews and pilot studies are considered fundamental aspects of the instrument development process, because they help assess the quality of the items and address limitations of the instrument before it is rigorously tested for psychometric properties.
      • Bowen N.K.
      Cognitive testing and the validity of child-report data from the elementary school success profile.
      • Yaghmaei F.
      Content validity and its estimation.
      The third strength of the majority of the reviewed studies was the use of age-appropriate response formats. For example, some instruments measuring food choice intentions paired food choices with pictures of the food. For the other types of psychosocial measures, most instruments reduced the typical number of Likert scale items from ≥ 5 to 3- or 4-point scales. More response options create a larger burden for children because of cognitive demands, whereas more response options are desirable for adult populations, to increase reliability.

      Borgers N, Hox JJ. Reliability of responses in questionnaire research with children. Paper presented at the 5th International Conference on Logic and Methodology; October 3–6, 2000; Cologne, Germany.

      Weaknesses

      Few studies reported whether their psychosocial measures were curriculum-based. Studies should report this information more often, because instruments should not only be theory-driven, but also incorporate the program or curriculum's goals, objectives, intensity, duration, and content.
      • Contento I.R.
      Nutrition Education: Linking Research, Theory, and Practice.
      • Townsend M.S.
      • Kaiser L.L.
      • Allen L.H.
      • Joy A.B.
      • Murphy S.P.
      Selecting items for a food behavior checklist for a limited resource audience.
      General nutrition education measures may be beneficial and practical for national- and state-level programs to ensure data comparability and program justification. However, general measures may also represent a threat to validity because they may not be sensitive enough to capture the effects of specific behavioral situations within the program or curriculum use. Future research on nutrition education curriculum specific measures vs general measures is warranted.
      In terms of practicality, results indicated that most instruments did not have a reported completion time, and only half of those had a likely practical completion time (< 20 minutes). In fact, most of the reviewed instruments included over 40 items. Lengthy, time-consuming questionnaires create a response burden on participants, and this burden becomes compounded when dealing with young respondents. The majority of these instruments are intended for use with children who are still only capable of concrete operations (n = 8) (children ages 7–10).
      • Ginsburg H.
      • Opper S.
      Piaget's Theory of Intellectual Development.
      Only 2 instruments were intended for use with children ages 11 and older, and 11 is the age at which children can move beyond concrete experiences and engage in logical reasoning and abstract thinking.
      • Ginsburg H.
      • Opper S.
      Piaget's Theory of Intellectual Development.
      Children in the concrete operational stage cannot easily understand hypothetical concepts. Requiring them to perform many of these operations may be taxing and may ultimately lead to poor data quality.
      • Borgers N.
      • de Leeuw E.
      • Hox J.
      Children as respondents in survey research: cognitive development and response quality 1.
      Another major concern is that researchers did not report whether the instruments were tested with youth from low-income, ethnically diverse families. Low literacy levels, language diversity, and contextual factors such as limited opportunities to make affordable and healthy food choices, are critical factors among this population, and may significantly affect the way a survey question is understood, interpreted, and/or answered. There is a great urgency for validating evaluation measures that are understandable and applicable for this population, because ethnically diverse, low-income children experience greater health disparities related to obesity and nutrition compared with their counterparts,
      • Rossen L.M.
      • Schoendorf K.C.
      Measuring health disparities: trends in racial-ethnic and socioeconomic disparities in obesity among 2- to 18-year old youth in the United States 2001-2010.
      and they also are the target audience of 2 US Department of Agriculture national nutrition education programs.
      In terms of reliability, 9 of 15 instruments had acceptable test-retest reliability scores for subscales within the instrument or as a whole.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      • Morris J.L.
      • Briggs M.
      • Zidenberg-Cherr S.
      Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
      • Rinderknecht K.
      • Smith C.
      Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      In addition, it was difficult to draw conclusions or comparisons across studies because there was no standard parameter to establish acceptable levels of test-retest reliability. Some studies reported using Spearman or Pearson coefficients,
      • Glanz K.
      • Steffen A.
      Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
      • Burgess-Champoux T.L.
      • Rosen R.
      • Marquart L.
      • Reicks M.
      The development of psychosocial measures for whole-grain intake among children and their parents.
      • Burgess-Champoux T.L.
      Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
      • Anderson A.S.
      • Bell A.
      • Adamson A.
      • Moynihan P.
      A questionnaire assessment of nutrition knowledge—validity and reliability issues.
      • Vereecken C.A.
      • Van Damme W.
      • Maes L.
      Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
      whereas others used ICCs
      • De Bourdeaudhuij I.
      • Klepp K.I.
      • Due P.
      • et al.
      Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
      • Wilson A.M.
      • Magarey A.M.
      • Mastersson N.
      Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
      and/or Cohen κ coefficient.
      • Stevens J.
      • Cornell C.E.
      • Story M.
      • et al.
      Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
      • Stevens J.
      • Story M.
      • Ring K.
      • et al.
      The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
      • Baranowski T.
      • Davis M.
      • Resnicow K.
      • et al.
      Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
      Because the purpose of test-retest reliability is to assess the temporal stability of measures between test-retest and not associations, researchers suggest that ICC is the most appropriate reliability parameter for continuous measures, weighted κ coefficient for ordinal measures, and un-weighted κ coefficient for categorical measures.
      • Sim J.
      • Wright C.C.
      The kappa statistic in reliability studies: use, interpretation, and sample size requirements.

      Implications for Research and Practice

      The process of dietary behavior change, particularly among children, is still not well understood. As mentioned previously, a review of nutrition intervention literature has shown that self-efficacy/perceived control, outcome expectations/attitude, habit, and behavioral intention are significant correlates of dietary behavior in children.
      • Contento I.R.
      Nutrition Education: Linking Research, Theory, and Practice.
      These results underscore the fact that components of behavioral health theories are applicable to dietary behavior change, but no theory can adequately explain behavior.
      One possible explanation for this is that the field of nutrition is broad and complex, and cannot be reduced to singular activities and behaviors. For example, SCT, a theoretical perspective used frequently in the instruments reviewed, has been widely used in public health campaigns related to human immunodeficiency virus prevention.
      • Bandura A.
      Social Cognitive Theory and exercise of control over HIV infection.
      • Maibach E.W.
      • Cotton D
      Cognitive approach to message design.
      From a health promotion perspective, human immunodeficiency virus prevention involves few, targeted behaviors. Dietary behavior change, however, encompasses a vast scope of behaviors—increasing fruit and vegetable intake; reducing calories, fat, or sodium; or any other dietary message that is taught. A child receives many messages in relation to positive nutrition behavior, many of which are out of her control. For example, for a child to increase her intake of fruit, she must have access to more fruit (ie, it is offered to her by her family or is incorporated into her school lunch).
      Future studies should continue to be more precise in parsing behaviors that fall under the umbrella of dietary behavior change, and testing them in terms of a psychosocial theory. Fruit and vegetable intake is 1 dietary behavior that has frequently been tested with psychosocial theories.
      • Guillaumie L.
      • Godin G.
      • Vezina-Im L.A.
      Psychosocial determinants of fruit and vegetable intake in adult population: a systematic review.
      Reducing fat and sodium or increasing lowfat sources of calcium, whole grains, or water among youth, however, have not been frequently tested with psychosocial theories; yet, the federal dietary guidelines encourage these behaviors. Disaggregating dietary behavior as a whole into more specific and testable behaviors may lead to more accuracy in determining how these psychosocial theories really cause behavior change in the nutrition field, which in turn, would allow researchers to develop more accurate instruments to test their programs.
      The current study has important implications for the program evaluation of national nutrition education programs in the US. Specifically, findings from this review provide useful insights for conducting future research to develop and rigorously test evaluation instruments that are appropriate for more diverse audiences and can be embedded into federal nutrition education programs such as the youth Expanded Food and Nutrition Education Program.

      United States Department of Agriculture, National Institute of Food and Agriculture. Expanded Food and Nutrition Education Program (EFNEP). http://www.csrees.usda.gov/nea/food/efnep/efnep.html. Accessed February 25, 2013.

      Acknowledgments

      Partial funding was provided by the US Department of Agriculture, National Institute of Food and Agriculture, National Research Initiative, Human Nutrition and Obesity Project (grant 2009-55215-05074).

      References

        • Rossen L.M.
        • Schoendorf K.C.
        Measuring health disparities: trends in racial-ethnic and socioeconomic disparities in obesity among 2- to 18-year old youth in the United States 2001-2010.
        Ann Epidemiol. 2012; 22: 698-704
        • Odgen C.L.
        • Carroll M.D.
        • Kit B.K.
        • Flegal K.M.
        Prevalence of obesity and trends in obesity mass index among US children and adolescents, 1999-2010.
        JAMA. 2012; 307: 483-490
        • Roseman M.G.
        • Riddell M.C.
        • Haynes J.N.
        A content analysis of kindergarten-12th grade school-based nutrition interventions: taking advantage of past learning.
        J Nutr Educ Behav. 2001; 43: 2-18
        • Contento I.R.
        Nutrition Education: Linking Research, Theory, and Practice.
        2nd ed. Jones & Bartlett Publishers, Sudbury, MA2010
        • Cerin E.
        • Barnett A.
        • Baranowski T.
        Testing theories of dietary behavior change in youth using the mediating variable model with intervention programs.
        J Nutr Educ Behav. 2009; 41: 309-318
        • Baranowski T.
        • Cerin E.
        • Baranowski J.
        Steps in the design, development, and formative evaluation of obesity prevention-related behavior change trials.
        Int J Behav Nutr Phys. 2009; 6 (Accessed February 25, 2013): 6
        • Contento I.R.
        • Randell J.S.
        • Basch C.E.
        Review and analysis of evaluation measures used in nutrition education research.
        J Nutr Educ Behav. 2002; 34: 2-25
        • Dignan M.B.
        • Steckler A.R.
        • Goodman R.M.
        Measurement and Evaluation of Health Education.
        3rd ed. CC Thomas, Springfield, IL1989
        • Townsend M.S.
        • Kaiser L.L.
        • Allen L.H.
        • Joy A.B.
        • Murphy S.P.
        Selecting items for a food behavior checklist for a limited resource audience.
        J Nutr Educ Behav. 2003; 35: 69-77
        • Sherwood N.E.
        • Story M.
        • Neumark-Sztainer D.
        • Adkins S.
        • Davis M.
        Development and implementation of a visual card-sorting technique for assessing food and activity preferences and patterns in African American girls.
        J Am Diet Assoc. 2003; 103: 1473-1479
        • Biddle S.J.
        • Gorely T.
        • Pearson N.
        • Bull F.C.
        An assessment of self-reported physical activity instruments in young people for population surveillance: Project ALPHA.
        Int J Behav Nutr Phys Act. 2011; 8 (Accessed February 25, 2013): 1
        • DeVellis R.F.
        Scale Development: Theory and Application.
        Sage, Newbury Park, CA1991
        • Kelder S.
        • Hoelscher D.M.
        • Barroso C.S.
        • Walker J.L.
        • Cribb P.
        • Hu S.
        The CATCH Kids Club: a pilot after-school study for improving elementary students' nutrition and physical activity.
        Public Health Nutr. 2005; 8: 133-140
        • Penkilo M.
        • George G.C.
        • Hoelscher D.M.
        Reproducibility of the School-based Nutrition Monitoring Questionnaire among fourth-grade students in Texas.
        J Nutr Educ Behav. 2008; 40: 20-27
        • Stevens J.
        • Cornell C.E.
        • Story M.
        • et al.
        Development of a questionnaire to assess knowledge, attitudes, and behaviors in American Indian children.
        Am J Clin Nutr. 1999; 69: 773S-781S
        • Stevens J.
        • Story M.
        • Ring K.
        • et al.
        The impact of the Pathways intervention on psychosocial variables related to diet and physical activity in American Indian schoolchildren.
        Prev Med. 2003; 37: S70-S79
        • De Bourdeaudhuij I.
        • Klepp K.I.
        • Due P.
        • et al.
        Reliability and validity of a questionnaire to measure personal, social, and environmental correlates of fruit and vegetable intake in 10- and 11-year old children in five European countries.
        Public Health Nutr. 2005; 8: 189-200
        • Glanz K.
        • Steffen A.
        Development and reliability testing for measures of psychosocial constructs associated with adolescent girls' calcium intake.
        J Am Diet Assoc. 2008; 108: 857-861
        • Burgess-Champoux T.L.
        • Rosen R.
        • Marquart L.
        • Reicks M.
        The development of psychosocial measures for whole-grain intake among children and their parents.
        J Am Diet Assoc. 2008; 108: 714-717
        • Burgess-Champoux T.L.
        Healthy whole grains choices for children and parents: a school-based pilot intervention. [dissertation].
        University of Minnesota. ProQuest Dissertations and Theses, Minneapolis, MN2006
        • Reynolds K.D.
        • Yaroch A.L.
        • Franklin F.A.
        • Maloy J.
        Testing mediating variables in a school-based nutrition intervention program.
        Health Psychol. 2002; 21: 51-60
        • Reynolds K.D.
        • Franklin F.A.
        • Binkley D.
        • et al.
        Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project.
        Prev Med. 2000; 30: 309-319
        • Domel S.B.
        • Thompson W.O.
        • Davis H.C.
        • Baranowsk T.
        • Leonard S.B.
        • Baranowski J.
        Psychosocial predictors of fruit and vegetable consumption among elementary school children.
        Health Educ Res. 1996; 11: 299-308
        • Baranowski T.
        • Davis M.
        • Resnicow K.
        • et al.
        Gimme 5 fruit, juice, and vegetables for fun and health: outcome evaluation.
        Health Educ Behav. 2000; 27: 96-111
        • Morris J.L.
        • Briggs M.
        • Zidenberg-Cherr S.
        Development and evaluation of a garden-enhanced nutrition education curriculum for elementary schoolchildren.
        J Child Nutr Manag. 2002; 26 (Accessed February 25, 2013): 2
        • Sherrill-Mittleman D.A.
        • Klesges L.M.
        • Lanctot J.Q.
        • Stockton M.B.
        • Klesges R.C.
        Measurement characteristics of dietary psychosocial scales in a weight gain prevention study with 8- to 10-year-old African-American girls.
        Health Educ Res. 2009; 24: 586-595
        • Rinderknecht K.
        • Smith C.
        Social cognitive theory in an after-school nutrition intervention for urban Native American youth.
        J Nutr Educ Behav. 2004; 36: 298-304
        • Townsend M.S.
        • Johns M.
        • Shilts M.K.
        • Farfan-Ramirez L.
        Evaluation of a USDA nutrition education program for low-income youth.
        J Nutr Educ Behav. 2006; 38: 30-41
        • Sabariah S.
        • Zalilah M.S.
        • Norlijah O.
        • et al.
        Reliability and validity of the instrument used in the HELIC (Healthy Lifestyle in Children) study of primary school children's knowledge, attitude, and practice.
        Mal J Nutr. 2006; 12: 33-44
        • Wilson A.M.
        • Magarey A.M.
        • Mastersson N.
        Reliability and relative validity of a child nutrition questionnaire to simultaneously assess dietary patterns associated with positive energy balance and food behaviours, attitudes, knowledge and environments associated with healthy eating.
        Int J Behav Nutr Phys Act. 2008; 5 (Accessed February 25, 2013): 5
        • Anderson A.S.
        • Bell A.
        • Adamson A.
        • Moynihan P.
        A questionnaire assessment of nutrition knowledge—validity and reliability issues.
        Public Health Nutr. 2002; 5: 497-503
        • Vereecken C.A.
        • Van Damme W.
        • Maes L.
        Measuring attitudes, self-efficacy, and social and environmental influences on fruit and vegetable consumption of 11- and 12-year old children: reliability and validity.
        J Am Diet Assoc. 2005; 105: 257-261
        • Bandura A.
        Social Foundations of Thought and Action: A Social Cognitive Theory.
        Prentice-Hall, Englewood Cliffs, NJ1986
        • Bowen N.K.
        Cognitive testing and the validity of child-report data from the elementary school success profile.
        Soc Work Res. 2008; 32: 18
        • Yaghmaei F.
        Content validity and its estimation.
        J Med Educ. 2003; 3: 25-27
      1. Borgers N, Hox JJ. Reliability of responses in questionnaire research with children. Paper presented at the 5th International Conference on Logic and Methodology; October 3–6, 2000; Cologne, Germany.

        • Ginsburg H.
        • Opper S.
        Piaget's Theory of Intellectual Development.
        Prentice Hall, Upper Saddle River, NJ1979
        • Borgers N.
        • de Leeuw E.
        • Hox J.
        Children as respondents in survey research: cognitive development and response quality 1.
        Bull Sociol Method. 2000; 66: 60-75
        • Sim J.
        • Wright C.C.
        The kappa statistic in reliability studies: use, interpretation, and sample size requirements.
        Phys Ther. 2005; 85: 257-268
        • Bandura A.
        Social Cognitive Theory and exercise of control over HIV infection.
        in: DiClemente R.J. Peterson J.L. Preventing AIDS: Theories and Methods of Behavioral Interventions. Plenum, New York, NY1994: 25-59
        • Maibach E.W.
        • Cotton D
        Cognitive approach to message design.
        in: Maibach E.W. Parrott R.L. Designing Health Messages: Approaches from Communication Theory and Public Health Practice. Sage, Thousand Oaks, CA1995: 41-64
        • Guillaumie L.
        • Godin G.
        • Vezina-Im L.A.
        Psychosocial determinants of fruit and vegetable intake in adult population: a systematic review.
        Int J Behav Nutr Phys Act. 2010; 7 (Accessed February 25, 2013): 12
      2. United States Department of Agriculture, National Institute of Food and Agriculture. Expanded Food and Nutrition Education Program (EFNEP). http://www.csrees.usda.gov/nea/food/efnep/efnep.html. Accessed February 25, 2013.