Education Department releases provisional cut scores on new test

Two-thirds of Arkansas students in grades 3-10 scored below “proficient” in English language arts on the state’s new ATLAS end-of-year exam, according to a system of cut scores that Arkansas Department of Education officials recommended to the State Board of Education in a workshop Wednesday (Oct. 9).

The State Board will vote on approving the cut scores Oct. 10. If that happens, the department will further compute the data at individual, student, school and state levels, Secretary of Education Jacob Oliva said in a briefing with reporters prior to the workshop.

The Department of Education has been developing the new Arkansas Teaching and Learning Assessment System (ATLAS) for the past year and a half. It replaces the ACT Aspire.

Students in the spring were tested in English language arts, math and science. Students also were given end-of-course exams for algebra, geometry, and biology.

Across all grade levels in grades 3-10, scores would be as follows in English language arts, if the State Board approves the cut scores:

– Level 4 – advanced: 10.04%
– Level 3 – proficient: 23.79%
– Level 2 – basic: 39.69%
– Level 1 – limited: 26.2%

In math in grades 3-8 plus algebra and geometry, scores would be as follows:

– Level 4 – advanced: 11.54%
– Level 3 – proficient: 21.07%
– Level 2 – basic: 31.6%
– Level 1 – limited: 35.79%

In science grades 3-8 plus biology, scores would be as follows:

– Level 4 – advanced: 12.55%
– Level 3 – proficient: 23.16%
– Level 2 – basic: 36.87%
– Level 1 – limited: 27.43%

Level 3 and Level 4 students are considered ready to learn at the next grade level, with Level 4 students considered ready for accelerated content. Level 2 students would need personalized support and intervention to advance to the next grade. Level 1 students would require significant support and intervention.

The department also released scores by grade level. For example, in English language arts, 13% of third grade students would score at Level 4 – advanced, while 23% would score at Level 3 – proficient. In addition, 37% of third graders would score at Level 2 – basic, while 27% would score at Level 1 – limited.

Oliva told reporters the Department of Education wanted to provide an accurate picture of where students are scoring.

“The last thing we want to do as a state is lie to students and families saying that their kids are doing great when they’re not,” he said. “And if we came out and said 70% of our students are proficient, we know that’s not the case. We need to be honest, and this is a true, honest measure of student performance.”

The department expects to release school-level results before November 1. Families will receive student scores, while scores at the school and grade levels will be released to the public. Results typically are released in the summer but were delayed this year while the standards were being set.

The department then will undertake a standards setting process for applying the assessment to school grades and accountability. That process probably will happen in January.

Oliva said the ATLAS scores are consistent with scores on the ACT Aspire. He said the scores cannot be compared because these are different tests. He emphasized that this is a baseline year for the new assessment.

ATLAS was designed to align with Arkansas standards as opposed to the ACT Aspire. Oliva said it is unique in the nation in that it’s a comprehensive test measuring subjects in grades K-12. It’s the first time all grades in the state have been unified and coordinated in one system. It also includes dyslexia screener information for grades K-3.

Oliva told reporters that the department wanted to have clear, precise standards in setting the cut scores. More than 3,700 educators provided input in helping the department develop ATLAS. More than 500 educators reviewed and approved items that were included on the tests, and more than 200 educators worked with national experts in recommending the cut score standards.

“This isn’t an off-the-shelf product,” he said. “This is a tool created specifically for the students in our state based on the input of the experts that know exactly what our students need, so that we can make sure that our students are able to compete on a national level.”

A press release from the department stated that the recommended test scores were meant to be similar in rigor to the National Assessment of Educational Progress, a biennial test given to a sample of students in each state. This would help identify how Arkansas students are doing compared to others.

Oliva said expectations for meeting proficiency will be clear.

“We’re creating the opportunity for teachers to go in the system and pull actual test items from an approved test item bank that are very similar and written in the same manner that they’re going to be assessed,” Oliva said. “So this one-stop-shop for student performance and support for teachers is really setting our state above other states because we’re being upfront. We’re saying, this is what we want students to know and learn, and this is how we’re going to measure them. And here’s a bunch of tools that you can use at your disposal to support your students with the teaching and implementation of those standards.”

Oliva said parent resource guides will be developed that describe expectations and provide sample test questions. Parents will be able to log in and see how students are performing on progress monitors administered in the fall, winter and spring.