Summer EOI Test Prep

Oklahoma School Testing Program (OSTP)Test Preparation InserviceSummer 2006: 

Oklahoma School Testing Program (OSTP) Test Preparation Inservice Summer 2006 Sandy Garrett State Superintendent of Public Instruction State Department of Education (SDE)

Purpose of Inservice: 

Purpose of Inservice Provide testing information for the 2006 Summer administration of tests Provide training and materials to District Test Coordinators (DTC) and Building Test Coordinators (BTC) concerning the rules, regulations, administration, and security of the Oklahoma School Testing Program

Purpose of the Oklahoma School Testing Program (OSTP): 

Purpose of the Oklahoma School Testing Program (OSTP) The purpose of the Oklahoma School Testing Program (OSTP) is to measure Oklahoma students’ levels of proficiency in the subjects assessed in Grades 3 – 8 and the End-of-Instruction assessments.

Purpose of the Oklahoma School Testing Program (OSTP): 

Purpose of the Oklahoma School Testing Program (OSTP) Students are required to respond to a variety of items linked to the content standards identified in the Priority Academic Student Skills (PASS). Each of the test forms assess identified content standards and objectives in the PASS. State assessments for Reading and Mathematics are accountability tests required by the 2001 Federal Legislation “No Child Left Behind” (NCLB).

Who Is Tested?: 

Who Is Tested? All students, including: -Students with Individualized Education Programs (IEP) -English Language Learners (ELL) -Non-Full Academic Year (NFAY) Students

Who Is Tested?Participation Requirements: 

Who Is Tested? Participation Requirements State and Federal regulations: 95% of students enrolled in Reading and Math in Grades 3-8, Algebra I and English II, must be tested at each site. 95% participation applies to all students and to specific student subgroups. Summer test results will be a part of the 2006-2007 accountability data.

Who Is Tested?Graduation Requirements: 

Who Is Tested? Graduation Requirements In order to graduate, all students who complete instruction for Algebra I, Biology I, English II, and U.S. History shall complete an EOI test for these competencies, which will be recorded on their high school transcripts. A student may retake the tests once prior to graduation. The highest achieved performance level will be recorded on the student’s transcript.

Who Is Tested? Graduation Requirement Exceptions: 

Who Is Tested? Graduation Requirement Exceptions Students who completed instruction prior to the year of implementation listed below are exempt from testing. English II and U.S. History: 2000-2001 Algebra I and Biology I: 2002-2003 Any student who transfers from out-of-state whose transcript shows he/she has completed the instruction prior to the transfer is exempt from testing.

Who Is Tested?EOI Interpretation and Guidance: 

Who Is Tested? EOI Interpretation and Guidance All students, including special education students and ELL, who have completed instruction over the specified competencies, regardless of the name of the course, will participate in the EOI tests. Some IEP students receiving instruction on specified competencies will not complete instruction in one year. They will test when they have completed instruction or at the last available testing date prior to graduation, whichever comes first.

Who Is Tested?EOI Interpretation and Guidance: 

Who Is Tested? EOI Interpretation and Guidance Completion of instruction is not defined by whether the course is passed or failed; it means the student was enrolled for the entire length of the course up to the time of the test. Completion of instruction may also be accomplished by passing a proficiency test for proficiency-based promotion.

Large-Print and Braille : 

Large-Print and Braille Large-print and Braille versions of each test are available for use with visually impaired students. Written procedures for administering these versions are included with each book. The DTCs enroll students needing the Large-Print or Braille version of the test during the enrollment process.

Testing Accommodations : 

Testing Accommodations Accommodations for IEP and Section 504 Students must be: specified in the IEP or Section 504 Plan, and selected from the accommodations specified in Appendix I. ELL students may be provided testing accommodations selected from those specified in Appendix II.

Testing Accommodations (cont.) : 

Testing Accommodations (cont.) Accommodations should include only those normally employed in the classroom and those which do not result in invalidating the test. Only scientific calculators may be used on the Algebra I test as an accommodation.

Testing Accommodations: 

Testing Accommodations “ELL with or without test accommodations” applies to any student who has not passed the English Proficiency test. (See Appendix II in the TPM for a list of allowable accommodations.) “ELL first or second year proficient” indicates an ELL student has attained proficiency and has exited the program within the last one or two years.

Alternate Assessments: 

Alternate Assessments Alternate assessments are not available for the summer test administration window. The English Language Learners (ELL) Alternate test must be approved by the Bilingual Office at (405) 521-3196.

General Assessment Information: 

General Assessment Information End-of-Instruction

General Information for End-of-Instruction (EOI): 

General Information for End-of-Instruction (EOI) CTB/McGraw-Hill is the test vendor for EOI Contact Information 1-888-282-0589 www.ctb.com/okeoi

Slide19: 

End-of-Instruction Testing Dates

Student Demographic Information: 

Student Demographic Information Districts needing to make corrections for accountability will review scores when they are received, make a spreadsheet of corrections, and email it to CTB.

Time Schedule : 

Time Schedule The tests are not timed. Students should be given additional time, if needed. Some studies have shown that more than one hour of additional time can contribute to a decrease in students’ scores. The additional time is available as an immediate extension of the testing session; it is not available as a separate session at another time.

Time Schedule : 

Time Schedule The estimated testing times include: distributing books, filling in student demographic information, and reading directions. All tests are paper and pencil.

Important Information: 

Important Information The Algebra I, Biology I, and U.S. History EOI may be administered in one or two sessions. English II may be administered over two or three days. Section 1 of the English II test (Writing) does not have a statewide writing day. Section 2 and Section 3 may be administered on any one day or consecutive days following Section 1 within the testing window.

Writing Reports: 

Writing Reports Scores are reported as an objective. Analytic scores will be included. The Writing score is calculated in overall English II score. You will now be able to view students’ writing scores on the Student List Report.

Writing Reports (cont.): 

Writing Reports (cont.) Condition codes are used if the student’s writing response is UNSCORABLE response may be in a language other than English no response off-topic illegible

Weights for Scoring Writing: 

Weights for Scoring Writing Analytic Traits Weights Ideas and Development 30% Organization, Unity and 25% Coherence Word Choice 15% Sentences and Paragraphs 15% Grammar, Usage, and 15% Mechanics

Demographic Information: 

Demographic Information A demographic page needs to be completed for each student taking an End-of-Instruction test during the summer testing window. Precode labels will not be available. Incorrect or incomplete information will result in inaccurate student data and may have a negative impact on the final reports.

Student Demographic Information (cont.): 

Student Demographic Information (cont.) SDE Approval is required for the following designations: Other Placement Emergency Exempt ELL 1st year exempt (English II test only) Forms are available for requests of approval on the Accountability and Assessment website. Documentation is also required on a school letterhead to be faxed to the SDE office.

Guidelines for Students Who Receive Instruction Away From Sites of Official Enrollment : 

Guidelines for Students Who Receive Instruction Away From Sites of Official Enrollment Alternate sites of instruction include: special education consortiums alternate education cooperatives and interlocals hospital placement, and homebound placement neglected and delinquent facilities Students may be administered assessments at their alternate site of instruction with approval from the Office of Accountability and Assessment.

Guidelines for Students Who Receive Instruction Away From Sites of Official Enrollment: 

Guidelines for Students Who Receive Instruction Away From Sites of Official Enrollment Test Materials: All test materials will be ordered by and sent to the district where the students are being tested. Score Reports: Score reports will be sent to the districts where the students are tested. It is the responsibility of the district administering the test to send the reports to the student’s home school.

Full Academic Year (FAY) : 

Full Academic Year (FAY) Enrollment Lapse for 10 or More Consecutive School Days? Full Academic Year – FAY Non Full Academic Year - NFAY

2nd Time Test Opportunity : 

2nd Time Test Opportunity

Demograghic Page (cont.): 

Demograghic Page (cont.) If a student becomes ill during testing and can not complete the test, mark the student as absent on the demographic page. There are no equivalent forms available during the Summer test administration.

Resources for Test Preparation: 

Resources for Test Preparation Access the State Department website at: www.sde.state.ok.us

DTC ResponsibilitiesReceiving and Distributing Materials: 

DTC Responsibilities Receiving and Distributing Materials Inventory materials immediately. If materials in the district shipment will not cover the district wide shortage, call the testing company before testing begins. Check the security barcodes on the test booklets against the Security Checklist. Refer to instructions in TPM to notify testing companies if materials are missing

DTC Responsibilities (cont.): 

DTC Responsibilities (cont.) If additional materials are needed, call CTB for EOI assessments. Additional orders requested less than one week before the test begins may not be received in time for testing.

DTC ResponsibilitiesCollecting and Returning Materials : 

DTC Responsibilities Collecting and Returning Materials The DTC must have students’ names matched to booklet barcodes. Keep a copy for your records and send the original to CTB. All materials should be returned to a central location, following procedures established by the district. The DTC must package all materials and arrange for pickup according to the schedule in the Test Preparation Manual. Make a copy of the District Header Sheet, School Group List, and Security Checklists before returning.

DTC Responsibilities (cont.): 

DTC Responsibilities (cont.) Verify the barcode numbers assigned to each school with the Security Checklist Make sure you have enough Group Information Sheets (GIS). You will not receive ANY blank ones. Give out Parent, Student, and Teacher Guides and Test Administration Directions to Building Test Coordinator (BTC) at least a week before testing.

DTC Responsibilities (cont.)PACKAGING: 

DTC Responsibilities (cont.) PACKAGING Log on to www.ctb.com/okeoi to arrange pickup.

Help in Returning Materials: 

Help in Returning Materials Your test coordinator kit will include a poster that outlines how to return your testing materials. Return shipping labels are precoded with your district name and address.

District Header Sheet (DHS)  : 

District Header Sheet (DHS) Information you enter on this sheet will be used at the Scoring Center to verify that your district’s entire shipment of scannable materials has been received. This form was introduced in the 2004-2005 testing year to help the DTC ensure that all participating schools return their test materials. The DTC should fill out the District Header Sheet prior to returning materials to CTB/McGraw-Hill for scoring. Goes in Box #1 with the scoreable materials.

Slide47: 

District Header Sheet

BTC Responsibilities:Receiving and Distributing Materials: 

BTC Responsibilities: Receiving and Distributing Materials Conduct training sessions for TAs and Test Monitors. Distribute Test Administration manuals to TA’s several days prior to testing Conduct make-up sessions Check the barcodes on the test booklets against the Security Checklist.

BTC Responsibilities (cont.): 

BTC Responsibilities (cont.) Check testing materials out to TAs the day of testing using the Security Checklist. Make sure there is a monitor in every testing session before testing begins. It is a violation to administer a test without a test monitor. Identify students who need special accommodations.

BTC Responsibilities:Collecting and Returning Material: 

BTC Responsibilities: Collecting and Returning Material BTCs need to have students’ names matched with booklet barcodes. Keep a copy for yourself and give a copy to your DTC. All materials must be returned to the BTC and accounted for. Follow the step-by-step instructions for checking and assembling the test materials for return to the DTC. However, The Guide For Parents, Students, and Teachers and the Test Administration Directions may be destroyed.

School/Group List : 

School/Group List The BTC should fill out the School/Group List prior to returning materials to the DTC. The School/Group List is CTB’s way of double-checking that all answer documents returned for scoring have been received.

School/Group List: 

School/Group List

Group Information Sheet (GIS): 

Group Information Sheet (GIS) The GIS provides CTB with data at the class and school level. Any number of classes may be grouped under one teacher name if the classes are all assessing the same content area at the same school or location. Place the GIS on top of each stack of Answer Documents whose scores are to be reported together.

Group Information Sheet (GIS): 

Group Information Sheet (GIS)

Test Administrator (TA) Responsibility Checklist: 

Test Administrator (TA) Responsibility Checklist Double-check which students require special accommodations. Review Guide for Parents, Students, and Teachers with students prior to testing. Preview Test Administration Directions several days prior to testing. Write student’s name next to the bar code number of the booklet he or she is using for testing on the Security Checklist. Administer tests with monitor present.

TA Responsibility Checklist: 

TA Responsibility Checklist Check and complete Student Demographic Page. Have students put their names on the front cover of their test booklets. Mark invalidations. Administer make-up tests. Complete the Group Information Sheet. Separate answer documents and test booklets.

TA Responsibilities (cont.): 

TA Responsibilities (cont.) Remove or cover visual aids and clues and keep them hidden throughout the administration of all subtests. Dictionaries, or any other additional material or equipment, are NOT allowed. Keep a log of unusual student behavior or circumstances.

Instructions For Test Monitors(Appendix IV): 

Instructions For Test Monitors (Appendix IV) All OSTP test administration sessions shall be monitored by an adult other than the TA. Requirements for this adult are: (a) must be approved by the school principal (b) can be a member of the faculty or community (c) does not have to possess an Oklahoma Teaching Certificate. In addition, different monitors may be used in the same test situation (or classroom setting) during the various days of testing.

Instructions for Test Monitors (cont.): 

Instructions for Test Monitors (cont.) The main job of the Test Monitor is to observe and report any irregularities in testing procedure. Monitors are to become knowledgeable about testing procedures and time schedules.

Instructions for Test Monitors (cont.): 

Instructions for Test Monitors (cont.) Monitors are to be present during administration of all tests. Monitors are not to look at the tests at any time. Monitors are to maintain the security of all test materials.

Test Security : 

Test Security Test books are not to be opened prior to or after the test session by anyone. Only the students tested are allowed to view the contents of a test booklet at the time of testing. It is critical that each bar code be matched to a student’s name. Ensure checklists are complete with student names before returning to testing company. Keep one copy for your records.

Test Security (cont.): 

Test Security (cont.) District Level Test Security Forms will be provided and must be signed and dated by the DTC and the District Superintendent. (Forms are included in the DTC kit, and a copy is in the manual.)

Test Security (cont.): 

Test Security (cont.) Building Level Test Security Forms will be provided and must be signed and dated by the BTC and Building Principal. (Forms are included in the DTC kit, and a copy is on page in the manual.)

Test Security (cont.): 

Test Security (cont.) TA and Test Monitor Test Security Forms will be provided and must be signed and dated by the TA and Test Monitor. In addition, Test Monitors must indicate the day(s) in which they were monitors. Forms are included in the DTC kit..

Test Security (cont.): 

Test Security (cont.)

Test Security (cont.): 

Test Security (cont.) Nondisclosure Agreement for Test Administrators is in the back of the Test Administrator’s Manual. (Forms are included in the DTC kit, and a copy is in the manual.)

Test Security (cont.): 

Test Security (cont.) Record of Tests Missed and Made-Up (Forms are included in the DTC kit, and a copy is in the manual.)

Test Invalidations): 

Test Invalidations ) Reasons for possible test invalidations include, but are not limited to, the following: (1) If a student cheats; (2) If test security is violated; (3) If improper test administration occurs; and (4) If students are tested outside the test window. Notify SDE for invalidation permission and procedures. If SDE approves the invalidation, the score becomes Non-Participating. There are no equivalent forms during summer test administration.

Test Security and Validity: 

Test Security and Validity Test Security rules are in the Oklahoma Administrative Codes.

Test Security (cont.): 

Test Security (cont.) Who should be trained on test administration procedures of the Oklahoma School Testing Program (OSTP)? DTCs BTCs TAs Monitors

Office of Accountability and Assessment (405) 521-3341: 

Office of Accountability and Assessment (405) 521-3341 Jennifer Stegman, Assistant Superintendent Ronda Townsend, Executive Director, State Testing Karen Robertson, API Director Clayton Hollingshead, Director, Research and Evaluation Joyce DeFehr, Assessment Specialist Allysone Moore, Assessment Specialist Melissa Jones, NAEP State Coordinator Sue Fleming, Administrative Support Coordinator Dorita Post, API/AYP Administrative Assistant