Goff

Using WebCT for Assessment, Dialogue and Feedback : 

Using WebCT for Assessment, Dialogue and Feedback Presented by: Lori Goff and Beryl Piccinin Biology Department

What is WebCT?: 

What is WebCT? Course management system Virtual course environment Course preparation, delivery, and management

Using WebCT in Biology: 

Using WebCT in Biology Biology 1A03 and 1AA3 First year biology courses with enrollment of 1200-1600 students 70-80 lab sections 60+ TAs Diverse backgrounds

Using WebCT in Biology: 

Using WebCT in Biology Biology 3Q03 and 3QQ3 Peer mentoring courses, many small group projects, discussions, and problem solving 15-20 students

Problems to solve! : 

Problems to solve! First year students were arriving to labs, unprepared! Difficult job for the TAs Time issues Poor results

Problems to solve! : 

Problems to solve! Poor performance on course tests Students were not using resources available to them Poor time management skills Relying on high school strategies

Problems to solve! : 

Problems to solve! Gathering student feedback about course, instructors, and TAs Poor response rate: Many students don’t attend the last few classes Tabulation: Time consuming

Problems to solve! : 

Problems to solve! Not enough class or lab time for discussion Student complaints about needing more interaction and discussion time with their peers Student complaints about not being able to attend TA office hours

Problem #1 : 

Problem #1 First year students were arriving to labs, unprepared! Possible Solution? Skill Quizzes and Pre-Lab Quizzes evaluated online

WebCT Quiz Tool: 

WebCT Quiz Tool Question bank (many types of questions) Tests created with random questions Timer Multiple attempts Selective release (when, who) Black out periods Conditions Instantaneous results Problem #1: Students unprepared for labs

Slide12: 

Problem #1: Students unprepared for labs

Slide13: 

Problem #1: Students unprepared for labs

Slide14: 

Problem #1: Students unprepared for labs

Slide15: 

Student submissions and grades Question statistics Problem #1: Students unprepared for labs

Our WebCT Quiz Solution: 

Our WebCT Quiz Solution Give students three attempts at each quiz Instant feedback on performance Allows students to see self-improvements Include 30 minute black-out period between attempts Encourages review of material Helps develop time-management skills Problem #1: Students unprepared for labs

Our WebCT Quiz Solution: 

Our WebCT Quiz Solution Make deadline at midnight on the day before the lab Encourages time-management Set “mastery” at 80% accuracy and include challenging questions Communicates high expectations Indicates how much understanding is required Record student participation Valuable analysis tool Problem #1: Students unprepared for labs

Reflection: 

Reflection Since inclusion of WebCT pre-lab quizzes in the course… Students arrive to lab prepared! They have read the lab manual and are familiar with the procedures and calculations! They are now able to finish the lab in the allotted time! Problem #1: Students unprepared for labs

Reflection: 

Reflection Since inclusion of WebCT pre-lab quizzes in the course… Lab results have improved tremendously! TAs can spend time on value-added activity! Students are more prepared than the TAs! Next step: WebCT quiz requirement for TAs? Problem #1: Students unprepared for labs

Problem #2 : 

Problem #2 Performance on first year tests was poor! Students were not spending enough time preparing for tests! Possible Solution? Offer pre-test quizzes in advance of each test?

Thought process : 

Thought process Since the pre-lab quizzes were working to encourage students to prepare for labs, WebCT quizzes should also work well to prepare students for tests Problem #2: Students unprepared for tests

Thought process : 

Thought process Test 1: Posted sample questions (static, passive) were not being accessed or utilized effectively Test 2: Experiment with interactive online WebCT quiz? Problem #2: Students unprepared for tests

WebCT Pre-Test Quizzes : 

WebCT Pre-Test Quizzes Bank of MC and SA questions Random tests generated Three attempts Time limit per attempt 30 minute black-out period 80% mastery required for bonus mark! Deadline: two days before the test Problem #2: Students unprepared for tests

Slide24: 

Test 2 Average = 68.7% Problem #2: Students unprepared for tests

Reflection: 

Reflection It’s only a correlation at this point, but… It appears that the pre-test quizzes are successful in helping the students to prepare for the term tests! Next step: Plan to include regular online quizzes throughout the semester as a component in the course to help encourage students to stay current with the lecture material Problem #2: Students unprepared for tests

Problem #3 : 

Problem #3 Gathering student feedback about course, instructors, and TAs was time-consuming and resulted in poor response rates Possible Solution? Online course evaluations and surveys?

Thought process : 

Thought process Provide students with the opportunity to evaluate the course, the instructors, and the TAs using online quizzes Must be anonymous: Survey tool! Problem #3: Gathering feedback was problematic

Results and Reflections : 

Results and Reflections Survey tool = Quiz tool, but anonymous Response rate = 75-90% Tabulation = electronic, automatic! Can ask course specific questions to solicit useful feedback Problem #3: Gathering feedback was problematic

Problem #4 : 

Problem #4 Not enough class or lab time for discussion Possible Solution? Electronic discussion forum or conference?

Thought process : 

Thought process WebCT offers online chat, mail, and discussion forum tools Students can contact TAs outside of class, synchronously or asynchronously Include participation component that requires students to participate in online discussions Problem #4: No time in class or lab time for discussion

Results and Reflections : 

Results and Reflections Biology 3Q03/3QQ3: Online discussion topic posted every other week Each student must reply to topic question Each student must then reply to two peers responses Promotes exchange of ideas Can monitor involvement Problem #4: No time in class or lab time for discussion

Results and Reflections : 

Results and Reflections Biology 1A03/1AA3: Students post group progress reports and drafts for group members and TA Online meeting space (chat, mail, forum) Promotes exchange of ideas, peer evaluation Can monitor participation Problem #4: No time in class or lab time for discussion

Summary: 

Summary Pros and Cons Final thoughts

Pros: 

Pros Gives prompt feedback Instant quiz results My Grades for test results Communicates high expectations 80% for mastery Examples of required detail

Pros: 

Pros Emphasizes time on task Forced black-out periods, multiple attempts, deadlines Develops reciprocity and co-operation WebCT discussions, team approach Exchange of ideas Respects diversity amongst students

Cons: 

Cons Learning curve for new technology Start-up is time consuming Problems with technology Never certain of who is participating

Cons – minimized: 

Cons – minimized Learning curve for new technology Students seem to be able to adapt pretty quickly, WebCT is user-friendly Start-up is time consuming Yes. Start slow and build. Trouble-shoot errors along the way.

Cons - minimized: 

Cons - minimized Problems with technology We offer students multiple attempts at each quiz worth grades in case of technological failure Never certain of who is participating and under what conditions Cannot replace traditional invigilated tests entirely.

Final Thoughts: 

Final Thoughts Few drawbacks to using WebCT for grading purposes Many advantages to help solve the problems we were experiencing and promote learning for our students