ManagingData

Making Sense of Mountains of Input – Some Answers: 

Making Sense of Mountains of Input – Some Answers Carla Rogers – Evolve Facilitation and Coaching, NSW Allison Hendricks – Darzin Software, NSW

Session Outline: 

Session Outline Introductions and Background Philosophy/approach Framework Discussion of Framework using case study examples Compare different approaches/tools

The Workshop (April 2004)The Challenges Identified: 

The Workshop (April 2004) The Challenges Identified Establishing CLARITY on WHY you are collecting the data Involving decision makers through the process – “How to get decision makers to listen” How to capture all voices - “Literacy, Language & Culture” Establishing and maintaining credibility - “Dealing with Unhappy Customers” Knowing your Tools for Analysis – “Software”

Data and Core Values: 

Data and Core Values The public should have a say in decisions about actions that affect their lives. Public participation includes the promise that the public's contribution will influence the decision. The public participation process: Communicates the interests and meets the process needs of all participants. Seeks out and facilitates the involvement of those potentially affected. Involves participants in defining how they participate. Provides participants with the information they need to participate in a meaningful way. Communicates to participants how their input affected the decision

How “Getting it Right” Helps: 

How “Getting it Right” Helps Effective data management will enable you to: Meet Core Values Save time, money and frustration Address many of the challenges identified in the workshop

Making sense of input: 

Making sense of input Extract understanding and knowledge from the data you have Practical tools and tips Case study examples Making sure you collect data that is going to give you the understanding and information you need Approach Framework linking data collection, evaluation/use and analysis

Usual Practice: 

Usual Practice ‘Communicate’ with community ??

Evaluation Focused Approach: 

Identify need/issue Consider your evaluation needs How will you conduct your evaluation? Scope Prepare P2 Plan Prepare and disseminate information Analyse, evaluate, report Evaluation Focused Approach Consider the end use/needs before you plan. What are you going to need: For the decision? To judge success/effectiveness? ‘Communicate’

Why?: 

Why? Planning for evaluation and the end use of information helps you design your data collection so that you collect all the information you require (as well as eliminating that which you will not use), in a format that is going to work for you. Build in lots of return loops – keep checking that you are on track and addressing the needs for both process and content. You will not be helping your client or the community if you are not testing/exploring/identifying all the important issues

Collecting the “Right” Data: 

Collecting the “Right” Data Representative Collection area Collection methods Consider demographics & communication needs Informative Asking the right questions Useable

Slide11: 

Collect Match method with need Record Easy tracking, audit trails - transparency Analyse Extract information Check usability Report Measure outcomes as well as performance re objectives The Data Management Cycle The Foundational Principles Values and Ethics of IAP2 – Informs cycle Evaluate How will you know if you are successful? What do you want to know and why do you want to know it?

Slide12: 

Collect Workshops, Written Submissions, I Forums, Online Feedback Record Excel Spreadsheet, PlanInfo, Darzin Analyse Report Define Objective P2 Plan address core values IAP2 Communicate Newsletters, Media, Ongoing interaction with all Decision Makers, Reports outlining response to submissions, Report including raw data/comment from submissions, Extensive use of web and internet The Data Management Cycle The Foundational Principles Values and Ethics of IAP2 – Informs cycle Evaluate KEY Action for Myall Lakes and Escarpment Parks Projects Improvement made to Escarpment Parks Project Coder under supervision of experienced coder. Extensive review by experienced coder. Report summarizing issues and detailing decision made and how. Addition of raw data from submissions showing analysis. Continuous evaluation and adaptation of program with participants through cycle. Short evaluation against program objectives following completion (with participants)..

Data > Information > Knowledge: 

Data > Information > Knowledge Quantitative analysis – demographics, level of participation, frequency (relative importance) of issues/needs Qualitative methods – get more information/ test quantitative findings, patterns and links between issues/needs Spatial analysis – geographic distribution, patterns Evaluation methods – eg: participatory evaluation, test your understanding Whole picture analysis

How to….: 

How to…. Statistics – level of participation, response rates for overall program and individual activities, decisions influenced Compare demographic characteristics Distribution – maps, GIS, postcode Use ‘rich’ categories to organise data Explore patterns, links, drivers in categories Develop and test scenarios Collate information using categories, provide rich supporting data, use quotes Representative Useable Informative

Tools: 

Tools Excel spreadsheet – collate information, filter, graph and perform basic statistical tests. Access database – use for contact management and data sorting. Export results to Excel for analysis. Qualitative analysis packages eg NVivo (www.qsrinternational.com.au) or Atlas.ti (www.atlasti.com) are the main ones Quantitative analysis eg SPSS (www.spss.com) Contact management software eg Act! (www.act.com) Survey software eg: Zoomerang (www.zoomerang.com) Specialist software that combines all of the above functions - Darzin (www.darzin.com)