Slide1 : PICCOLO A Head Start-University Partnership
Funded by ACYF Grant # 90YF0050 Parenting
Interactions with Children: Checklist of Observations Linked to
Outcomes Lori Roggman, Mark Innocenti,
Gina Cook, Vonda Jump, & James Akers
Presented at Society for Research in Child Development
Boston, MA
March 31, 2007
What is PICCOLO? : What is PICCOLO? An observational instrument we developed for practitioners working with parents of young children to measure positive parenting.
Psychometric data support PICCOLO as a measure that is:
Easy to use
Reliable
Valid
Why Measure Parenting? : Why Measure Parenting? Development in the early years is linked to certain kinds of interactions with parents and caregivers (Bornstien & Tamis-LeMonda, 1989; Estrada et al., 1987; Harnish et al., 1995; Hart & Risley, 1995; Kelly et al., 1996; NICHD Early Child Care Research Network, 1999).
Programs such as Early Head Start often aim to increase parenting behaviors that support early development.
Why develop a new parenting measure? : Why develop a new parenting measure? • to identify parenting that predicts child outcomes
• to track positive parenting outcomes in programs.
• to develop a measure practitioners can use
- easy to learn, easy to use
- psychometrically sound
- appropriate for diverse families
Why a parenting measure for diverse families? : Why a parenting measure for diverse families? • Most parenting measurement samples are:
• European-Americans
• Middle socio-economic status.
• Practitioners often work with parents of
• Diverse ethnicity/culture
• Lower socio-economic status
Challenges in developing a measure for diverse families : Challenges in developing a measure for diverse families • Getting a diverse sample: The national EHS study archived videotapes of parent-child interaction in a diverse sample.
• Getting diverse raters:
• Latino raters: Latino raters were recruited who were fluent in both Spanish & English.
• African-American raters: Intensive efforts were required to recruit African-American raters at Utah State.
How did we develop PICCOLO? : How did we develop PICCOLO? Step 1. The Evidence Base
Research team reviewed literature on parenting.
Most studies point to one of 4 main kinds of parenting that supports early development.
Research team selected items to test for PICCOLO in 4 domains.
Slide8 : What are the 4 PICCOLO Domains? Affection & Affect: Showing physical and verbal affection,
warmth, positive emotional expressions, and positive statements. Responsiveness: Reacting to child’s cues, emotions, words, and
behaviors, following child’s lead in play or conversation. Encouragement of Autonomy: Providing active and non-intrusive
support of exploration, effort, initiative, independence, and play. Teaching & Talking: Providing cognitive stimulation, questions,
explanations, and conversation; sharing pretend play.
PICCOLO v3.1 Affect/Affection : PICCOLO v3.1 Affect/Affection Expression of affection and positive emotions is sometimes called “warmth” and is related to
• less antisocial behavior
• better adjustment
• more compliance
• greater cognitive ability
• more school readiness Research by Caspi, et al. (2004),Dodici et al. (2003), Estrada et al. (1987), MacDonald (1992), Petrill et al., (2004), and Sroufe et al. (1990).
PICCOLO v3.1 Responsiveness : PICCOLO v3.1 Responsiveness Reacting sensitively to infant cues and expressions of needs or interests is related to
• more secure attachment
• better cognitive & social development
• better language development
• fewer behavior problems
• better emotion regulation & empathy Research by Bornstein & Tamis-LeMonda (1989),Davidov & Grusec (2006), Landry et al. (2001), Spencer & Meadow-Orlans (1996), Tamis-LeMonda et al. (2001), Volker et al., (1999), and Wakschlag & Hans (1999).
Slide11 : PICCOLO v3.1
Encouragement of Autonomy Providing support for children’s self-
direction and not being too restrictive or intrusive is related to
• greater independence
• less negativity
• willingness to try challenging tasks
• better cognitive & social development
• better language development Research by Frodi et al. (1985), Ispa et al. (2004), Hart & Risley (1995), Landry et al. (1997), and Kelly et al. (2000).
Slide12 : PICCOLO v3.1 Teaching/Talking Talking with children about their world, responding to their communications, and playing together is related to
• better cognitive & social development
• better language development
• more conversation
• more emergent literacy skills Research by Baumwell et al., (1997), Carpenter et al., (1998), Hart & Risley (1995), Hockenberger et al. (1999), Laasko et al. (1999), and Tamis-LeMonda et al., (2001).
Slide13 : How did we test PICCOLO items? Step 2. New Observations
~ 2,000 video clips
(Early Head Start Evaluation & Research Project)
Parenting interactions, ages 14, 24, 36 months
New observers rated items on video clips
Slide14 : What were the observations like? 3-bag task (from the national Early Head Start
Research and Evaluation Project):
• 10- min video-recorded observation
• Mother & child on blanket on floor at home
• 3 bags
bag #1 -- book
bag #2 -- pretend toys
bag #3 -- other toys
• Parents told to play with child using toys in
each bag, dividing time how they wished.
Slide15 : How did we test PICCOLO items? Observers
viewed clips independently
got regular feedback on agreement
gave regular feedback on items
were initially matched for ethnicity
Slide16 : Video Clips Rated by 3+ Observers
Slide17 : Video Clips Rated by 3+ Observers
How did we select PICCOLO items? : How did we select PICCOLO items? Step 3. Item Selection
Used multiple criteria to reduce the number of items based on:
Reliability
Validity
Sensitivity
Practicality
How many PICCOLO items? : How many PICCOLO items?
PICCOLO v3.1 Affect/Affection : PICCOLO v3.1 Affect/Affection
PICCOLO v3.1 Responsiveness : PICCOLO v3.1 Responsiveness
Slide22 : PICCOLO v3.1
Encouragement of Autonomy
Slide23 : PICCOLO v3.1 Teaching/Talking
How reliable is PICCOLO? : How reliable is PICCOLO? Inter-rater agreement across items = 74%
3 raters per clip
2 of 3 raters agree 91% of the time
Internal consistency across domains
Cronbach’s alpha = .73 - .81
Some variation across ethnic/culture groups.
PICCOLO Average Item Agreement by Ethnicity/Culture : PICCOLO Average Item Agreement by Ethnicity/Culture
PICCOLO Scale Reliability by Ethnicity/Culture : PICCOLO Scale Reliability by Ethnicity/Culture
Do PICCOLO Scores Differ by Ethnicity/Culture? : Do PICCOLO Scores Differ by Ethnicity/Culture?
Do PICCOLO items differ? : Do PICCOLO items differ?
Does PICCOLO have construct validity? : Does PICCOLO have construct validity? EA - European-Americans
LS - Latino Spanish Speaking
AA - African-Americans
Slide30 : What child outcomes does PICCOLO predict? Cognitive development
Bayley MDI at 36m
Woodcock Johnson at preK
Vocabulary
Peabody Picture Vocabulary Test at 36m
Peabody Picture Vocabulary Test at PreK
Social behavior
Bayley Behavior Rating Scales at 36m
Leiter Emotion Regulation at PreK
Outcomes at Age 3 : Outcomes at Age 3
Outcomes at PreK : Outcomes at PreK
Troublesome Items : Troublesome Items DOMAIN 1: Affection & Affect
Troublesome Items : Troublesome Items DOMAIN 2: Responsiveness
Parenting & Ethnicity/Culture Differences? : Parenting & Ethnicity/Culture Differences? Sampling
• Early Head Start sampling
• low-income, minority sampling
Observation Team
• background
• bias?
Parenting values & culture
• do same behaviors mean the same thing?
• do same behaviors combine in the same way?
Does PICCOLO have practical validity? : Does PICCOLO have practical validity? Practitioners say that PICCOLO helps them
• see parenting behavior more distinctly
“I saw things I didn’t see before--I realized
how little she actually speaks to her child”
• plan interventions
“You see things you might want to work
with the parent on the next visit.”
• work with parents
“It’s useful for parents to do so they
can look at their skills”
Slide37 : PICCOLO
Training DVD Support materials are
available for PICCOLO
PICCOLO Researchers- Utah State University Lori Roggman FaLori@cc.usu.edu Mark Innocenti Minno@eiri.usu.edu Gina Cook Vonda Jump Jim Akers Katie Christiansen Cora Price : PICCOLO Researchers- Utah State University Lori Roggman FaLori@cc.usu.edu Mark Innocenti Minno@eiri.usu.edu Gina Cook Vonda Jump Jim Akers Katie Christiansen Cora Price Program Partners Bear River Head Start, Logan, UT
—Sara Thurgood, director
Head Start Parent Child Centers, Layton, UT
—Kathy Shaw Sartor, director
Guadalupe Schools Early Childhood Program, SLC, UT
— Patty Walker, director For a copy of this presentation, go to:
http://www.eiri.usu.edu/projects/srcd
Slide39 : Most of the parenting and child video clips and outcome data used for developing PICCOLO were from the Early Head Start Evaluation and Research Project, conducted in collaboration with the Administration for Youth and Families, Mathematica Policy Research, and local research partners at 17 sites. Research institutions in the Consortium (and principal researchers) include ACF (Rachel Chazan Cohen, Judith Jerald, Esther Kresh, Helen Raikes, Louisa Tarullo); Catholic University of America (Michaela Farber, Lynn Milgram Mayer, Harriet Liebow, Christine Sabatino, Nancy Taylor, Elizabeth Timberlake, Shavaun Wall); Columbia University (Lisa Berlin, Christy Brady-Smith, Jeanne Brooks-Gunn, Alison Sidle Fuligni); Harvard University (Catherine Ayoub, Barbara Alexander Pan, Catherine Snow); Iowa State University (Dee Draper, Gayle Luze, Susan McBride, Carla Peterson); Mathematica Policy Research (Kimberly Boller, Ellen Eliason Kisker, John M. Love, Diane Paulsell, Christine Ross, Peter Schochet, Cheri Vogel, Welmoet van Kammen); Medical University of South Carolina (Richard Faldowski, Gui-Young Hong, Susan Pickrel); Michigan State University (Hiram Fitzgerald, Tom Reischl, Rachel Schiffman); New York University (Mark Spellmann, Catherine Tamis-LeMonda); University of Arkansas (Robert Bradley, Mark Swanson, Leanne Whiteside-Mansell); University of California, Los Angeles (Carollee Howes, Claire Hamilton); University of Colorado Health Sciences Center (Robert Emde, Jon Korfmacher, JoAnn Robinson, Paul Spicer, Norman Watt); University of Kansas (Jane Atwater, Judith Carta, Jean Ann Summers); University of Missouri-Columbia (Mark Fine, Jean Ispa, Kathy Thornburg); University of Pittsburgh (Carol McAllister, Beth Green, Robert McCall); University of Washington School of Education (Eduardo Armijo, Joseph Stowitschek); University of Washington School of Nursing (Kathryn Barnard, Susan Spieker); and Utah State University (Lisa Boyce, Lori Roggman). Additional data are from studies conducted by members of the PICCOLO research team at Utah State University in the Department of Family, Consumer, and Human Development and at the Early Intervention Research Institute.Thousands of parents and children in the video clips used to develop the PICCOLO measure have provided a rich opportunity for us to learn more about parenting. Acknowledgements