PICCOLO SRCD07 1

Slide1: 

PICCOLO A Head Start-University Partnership Funded by ACYF Grant # 90YF0050 Parenting Interactions with Children: Checklist of Observations Linked to Outcomes Lori Roggman, Mark Innocenti, Gina Cook, Vonda Jump, & James Akers Presented at Society for Research in Child Development Boston, MA March 31, 2007

What is PICCOLO?: 

What is PICCOLO? An observational instrument we developed for practitioners working with parents of young children to measure positive parenting. Psychometric data support PICCOLO as a measure that is: Easy to use Reliable Valid

Why Measure Parenting?: 

Why Measure Parenting? Development in the early years is linked to certain kinds of interactions with parents and caregivers (Bornstien & Tamis-LeMonda, 1989; Estrada et al., 1987; Harnish et al., 1995; Hart & Risley, 1995; Kelly et al., 1996; NICHD Early Child Care Research Network, 1999). Programs such as Early Head Start often aim to increase parenting behaviors that support early development.

Why develop a new parenting measure? : 

Why develop a new parenting measure? • to identify parenting that predicts child outcomes • to track positive parenting outcomes in programs. • to develop a measure practitioners can use - easy to learn, easy to use - psychometrically sound - appropriate for diverse families

Why a parenting measure for diverse families? : 

Why a parenting measure for diverse families? • Most parenting measurement samples are: • European-Americans • Middle socio-economic status. • Practitioners often work with parents of • Diverse ethnicity/culture • Lower socio-economic status

Challenges in developing a measure for diverse families : 

Challenges in developing a measure for diverse families • Getting a diverse sample: The national EHS study archived videotapes of parent-child interaction in a diverse sample. • Getting diverse raters: • Latino raters: Latino raters were recruited who were fluent in both Spanish & English. • African-American raters: Intensive efforts were required to recruit African-American raters at Utah State.

How did we develop PICCOLO?: 

How did we develop PICCOLO? Step 1. The Evidence Base Research team reviewed literature on parenting. Most studies point to one of 4 main kinds of parenting that supports early development. Research team selected items to test for PICCOLO in 4 domains.

Slide8: 

What are the 4 PICCOLO Domains? Affection & Affect: Showing physical and verbal affection, warmth, positive emotional expressions, and positive statements. Responsiveness: Reacting to child’s cues, emotions, words, and behaviors, following child’s lead in play or conversation. Encouragement of Autonomy: Providing active and non-intrusive support of exploration, effort, initiative, independence, and play. Teaching & Talking: Providing cognitive stimulation, questions, explanations, and conversation; sharing pretend play.

PICCOLO v3.1 Affect/Affection: 

PICCOLO v3.1 Affect/Affection Expression of affection and positive emotions is sometimes called “warmth” and is related to • less antisocial behavior • better adjustment • more compliance • greater cognitive ability • more school readiness Research by Caspi, et al. (2004),Dodici et al. (2003), Estrada et al. (1987), MacDonald (1992), Petrill et al., (2004), and Sroufe et al. (1990).

PICCOLO v3.1 Responsiveness: 

PICCOLO v3.1 Responsiveness Reacting sensitively to infant cues and expressions of needs or interests is related to • more secure attachment • better cognitive & social development • better language development • fewer behavior problems • better emotion regulation & empathy Research by Bornstein & Tamis-LeMonda (1989),Davidov & Grusec (2006), Landry et al. (2001), Spencer & Meadow-Orlans (1996), Tamis-LeMonda et al. (2001), Volker et al., (1999), and Wakschlag & Hans (1999).

Slide11: 

PICCOLO v3.1 Encouragement of Autonomy Providing support for children’s self- direction and not being too restrictive or intrusive is related to • greater independence • less negativity • willingness to try challenging tasks • better cognitive & social development • better language development Research by Frodi et al. (1985), Ispa et al. (2004), Hart & Risley (1995), Landry et al. (1997), and Kelly et al. (2000).

Slide12: 

PICCOLO v3.1 Teaching/Talking Talking with children about their world, responding to their communications, and playing together is related to • better cognitive & social development • better language development • more conversation • more emergent literacy skills Research by Baumwell et al., (1997), Carpenter et al., (1998), Hart & Risley (1995), Hockenberger et al. (1999), Laasko et al. (1999), and Tamis-LeMonda et al., (2001).

Slide13: 

How did we test PICCOLO items? Step 2. New Observations ~ 2,000 video clips (Early Head Start Evaluation & Research Project) Parenting interactions, ages 14, 24, 36 months New observers rated items on video clips

Slide14: 

What were the observations like? 3-bag task (from the national Early Head Start Research and Evaluation Project): • 10- min video-recorded observation • Mother & child on blanket on floor at home • 3 bags bag #1 -- book bag #2 -- pretend toys bag #3 -- other toys • Parents told to play with child using toys in each bag, dividing time how they wished.

Slide15: 

How did we test PICCOLO items? Observers viewed clips independently got regular feedback on agreement gave regular feedback on items were initially matched for ethnicity

Slide16: 

Video Clips Rated by 3+ Observers

Slide17: 

Video Clips Rated by 3+ Observers

How did we select PICCOLO items?: 

How did we select PICCOLO items? Step 3. Item Selection Used multiple criteria to reduce the number of items based on: Reliability Validity Sensitivity Practicality

How many PICCOLO items?: 

How many PICCOLO items?

PICCOLO v3.1 Affect/Affection: 

PICCOLO v3.1 Affect/Affection

PICCOLO v3.1 Responsiveness: 

PICCOLO v3.1 Responsiveness

Slide22: 

PICCOLO v3.1 Encouragement of Autonomy

Slide23: 

PICCOLO v3.1 Teaching/Talking

How reliable is PICCOLO?: 

How reliable is PICCOLO? Inter-rater agreement across items = 74% 3 raters per clip 2 of 3 raters agree 91% of the time Internal consistency across domains Cronbach’s alpha = .73 - .81 Some variation across ethnic/culture groups.

PICCOLO Average Item Agreement by Ethnicity/Culture: 

PICCOLO Average Item Agreement by Ethnicity/Culture

PICCOLO Scale Reliability by Ethnicity/Culture: 

PICCOLO Scale Reliability by Ethnicity/Culture

Do PICCOLO Scores Differ by Ethnicity/Culture?: 

Do PICCOLO Scores Differ by Ethnicity/Culture?

Do PICCOLO items differ?: 

Do PICCOLO items differ?

Does PICCOLO have construct validity?: 

Does PICCOLO have construct validity? EA - European-Americans LS - Latino Spanish Speaking AA - African-Americans

Slide30: 

What child outcomes does PICCOLO predict? Cognitive development Bayley MDI at 36m Woodcock Johnson at preK Vocabulary Peabody Picture Vocabulary Test at 36m Peabody Picture Vocabulary Test at PreK Social behavior Bayley Behavior Rating Scales at 36m Leiter Emotion Regulation at PreK

Outcomes at Age 3: 

Outcomes at Age 3

Outcomes at PreK: 

Outcomes at PreK

Troublesome Items: 

Troublesome Items DOMAIN 1: Affection & Affect

Troublesome Items: 

Troublesome Items DOMAIN 2: Responsiveness

Parenting & Ethnicity/Culture Differences?: 

Parenting & Ethnicity/Culture Differences? Sampling • Early Head Start sampling • low-income, minority sampling Observation Team • background • bias? Parenting values & culture • do same behaviors mean the same thing? • do same behaviors combine in the same way?

Does PICCOLO have practical validity?: 

Does PICCOLO have practical validity? Practitioners say that PICCOLO helps them • see parenting behavior more distinctly “I saw things I didn’t see before--I realized how little she actually speaks to her child” • plan interventions “You see things you might want to work with the parent on the next visit.” • work with parents “It’s useful for parents to do so they can look at their skills”

Slide37: 

PICCOLO Training DVD Support materials are available for PICCOLO

PICCOLO Researchers- Utah State UniversityLori Roggman FaLori@cc.usu.eduMark Innocenti Minno@eiri.usu.eduGina CookVonda JumpJim AkersKatie ChristiansenCora Price: 

PICCOLO Researchers- Utah State University Lori Roggman FaLori@cc.usu.edu Mark Innocenti Minno@eiri.usu.edu Gina Cook Vonda Jump Jim Akers Katie Christiansen Cora Price Program Partners Bear River Head Start, Logan, UT —Sara Thurgood, director Head Start Parent Child Centers, Layton, UT —Kathy Shaw Sartor, director Guadalupe Schools Early Childhood Program, SLC, UT — Patty Walker, director For a copy of this presentation, go to: http://www.eiri.usu.edu/projects/srcd

Slide39: 

Most of the parenting and child video clips and outcome data used for developing PICCOLO were from the Early Head Start Evaluation and Research Project, conducted in collaboration with the Administration for Youth and Families, Mathematica Policy Research, and local research partners at 17 sites. Research institutions in the Consortium (and principal researchers) include ACF (Rachel Chazan Cohen, Judith Jerald, Esther Kresh, Helen Raikes, Louisa Tarullo); Catholic University of America (Michaela Farber, Lynn Milgram Mayer, Harriet Liebow, Christine Sabatino, Nancy Taylor, Elizabeth Timberlake, Shavaun Wall); Columbia University (Lisa Berlin, Christy Brady-Smith, Jeanne Brooks-Gunn, Alison Sidle Fuligni); Harvard University (Catherine Ayoub, Barbara Alexander Pan, Catherine Snow); Iowa State University (Dee Draper, Gayle Luze, Susan McBride, Carla Peterson); Mathematica Policy Research (Kimberly Boller, Ellen Eliason Kisker, John M. Love, Diane Paulsell, Christine Ross, Peter Schochet, Cheri Vogel, Welmoet van Kammen); Medical University of South Carolina (Richard Faldowski, Gui-Young Hong, Susan Pickrel); Michigan State University (Hiram Fitzgerald, Tom Reischl, Rachel Schiffman); New York University (Mark Spellmann, Catherine Tamis-LeMonda); University of Arkansas (Robert Bradley, Mark Swanson, Leanne Whiteside-Mansell); University of California, Los Angeles (Carollee Howes, Claire Hamilton); University of Colorado Health Sciences Center (Robert Emde, Jon Korfmacher, JoAnn Robinson, Paul Spicer, Norman Watt); University of Kansas (Jane Atwater, Judith Carta, Jean Ann Summers); University of Missouri-Columbia (Mark Fine, Jean Ispa, Kathy Thornburg); University of Pittsburgh (Carol McAllister, Beth Green, Robert McCall); University of Washington School of Education (Eduardo Armijo, Joseph Stowitschek); University of Washington School of Nursing (Kathryn Barnard, Susan Spieker); and Utah State University (Lisa Boyce, Lori Roggman). Additional data are from studies conducted by members of the PICCOLO research team at Utah State University in the Department of Family, Consumer, and Human Development and at the Early Intervention Research Institute.Thousands of parents and children in the video clips used to develop the PICCOLO measure have provided a rich opportunity for us to learn more about parenting. Acknowledgements