Assessing Students Online

Assessing Students Online: 

Assessing Students Online League for Innovation 2005 Dallas, TX October 24, 8:00 AM – 9:00 AM Manchester, Tower Mezzanine

Who Are We?: 

Who Are We? Montgomery County Community College, Blue Bell, PA Patricia Rahmlow Assistant Professor, Computer Science prahmlow@mc3.edu Marie Hartlein Associate Professor, Computer Science mhartlein@mc3.edu Linda Moulton Professor Mathematics and Computer Science lmoulton@mc3.edu http://faculty.mc3.edu/prahmlow/Presentations/index.html

Who Are You?: 

Who Are You? Disciplines Online, hybrid, face-to-face professor Blackboard, WebCT, other Use publisher packages Use online quizzes

Why Assess Students Online?: 

Why Assess Students Online? Space and time independent

Why Assess Students Online?: 

Why Assess Students Online? Immediate feedback

Why Assess Students Online?: 

Why Assess Students Online? Learning aide

Uses of Online Assessment: 

Uses of Online Assessment Evaluation of student learning Pre-test Post-test

Uses of Online Assessment: 

Uses of Online Assessment Evaluation of student learning Assessment of knowledge Exams Make-up tests

Uses of Online Assessment: 

Uses of Online Assessment Evaluation of student learning Assessment of knowledge Self-evaluation Repetitive testing Feedback

Uses of Online Assessment: 

Uses of Online Assessment Evaluation of student learning Assessment of knowledge Self-evaluation Distance learning assessment Keeps students as “distance” learners More convenient for student

Online Assessment Tools: 

Online Assessment Tools Course delivery software Blackboard WebCT Publisher course delivery sites

Online Assessment Tools: 

Online Assessment Tools Course delivery software Simulated software application testing SAM Train IT SimNet SNAP

Online Assessment Tools: 

Online Assessment Tools Course delivery software Simulated software application testing Free / low-cost quiz sites http://getonline.wichita.edu/transitions/assess.asp#assessmenttools

Online Assessment Tools: 

Online Assessment Tools Course delivery software Simulated software application testing Free / low-cost quiz sites Textbook web sites Computer Science Concepts http://csilluminated.jbpub.com/ Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html

Online Assessment Modes: 

Online Assessment Modes Time constraints None Timed – warning mode Timed – shut down mode

Online Assessment Modes: 

Online Assessment Modes Time constraints Number of attempts One Multiple Unlimited Student specific

Online Assessment Modes: 

Online Assessment Modes Time constraints Number of attempts Restricted access Site password Assessment password **********

Online Assessment Modes: 

Online Assessment Modes Time constraints Number of attempts Restricted access Survey Anonymous Course evaluation ?

Knowledge Based Questions: 

Knowledge Based Questions True/False Multiple Choice Matching Multiple Answer Ordering Fill in the Blank Essay Calculated Numeric Calculated Formula File Response Hot Spot Fill in Multiple Blanks Jumbled Sentence Opinion Scale/Likert Short Answer Either/Or Quiz Bowl

Performance Based Questions: 

Performance Based Questions Open / close files Search internet Send email Format documents Develop formulas Query a database

Assessment Integrity: 

Assessment Integrity Timed Allow use of textbook Insufficient time to look up all answers

Assessment Integrity: 

Assessment Integrity Timed Question pool Large pool of questions No two quizzes identical

Assessment Integrity: 

Assessment Integrity Timed Question pool Randomize questions Facilitates face-to-face use Less likely to memorize answers

Assessment Integrity: 

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Less likely someone else will take assessment

Assessment Integrity: 

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal answers Send answers after exam time ends Send only correct / incorrect indicator Time release results

Assessment Integrity: 

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal correct answers Proctored

Assessment Integrity: 

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal correct answers Proctored Other forms of assessment “Portfolio” of student ability Discussions Homework / Projects

Technical Issues: 

Technical Issues ISP Disconnect “Passive” assessments Keep under 30 minutes Reset quizzes Question pools “Active” assessments Count first recorded response Pop-up Blockers Special Software

Tool Selection: 

Tool Selection Cost Ease of use Student Access Software Professor Set-up Grading (SCORM) Purpose Graded assessment Self-assessment

Demonstrations: 

Demonstrations SAM http://sam2003.course.com Blackboard https://my.mc3.edu/ Textbook web sites Computer Science Concepts http://csilluminated.jbpub.com/ Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html