9 Jan 2014
Cover image © 2013 istockphoto.com/Yuri_Arcurs. All rights reserved. Used under license.
The new 2015–2016 assessments written by Smarter Balanced Assessment Consortium and the Partnership for Assessment of Readiness for College and Careers both heavily feature questions that require students to provide evidence for their reply. This is a dramatic departure from simple multiple-choice questions where student can guess the best response if they are unsure of the answer. What can teachers do to prepare students for this more rigorous form of testing? How can teachers help students pinpoint the heart of open-ended questions to give the best response?
Suppose you are a student taking one of the new assessments that have been developed to measure attainment of the Common Core State Standards for the English Language Arts (CCSS/ELA). After reading a text about a baseball-loving girl and her grandmother, you look at the questions you are to answer. Here is what you see:
What does Naomi learn about Grandma Ruth? Use details from the text to support your answer. (Grandma Ruth, Smarter Balanced test sample)
This task is an example of the Smarter Balanced Assessment Consortium’s (SBAC) tasks for grades 3–5. It is illustrative of a task format thousands of students will encounter when they take that assessment in the fall of 2014. It is also similar to a format found on the end-of-year assessment tasks used by the Partnership for Assessment of Readiness for College and Careers (PARCC).
These tasks, open-ended questions as well as research simulations (often described as performance assessments), require students to construct their own responses rather than select them from a set of given possibilities. And, if you are a typical student, this assessment may be the first time that you have been required to respond to a task by doing little more than filling in a bubble. Needless to say, if you are a typical student, responding successfully to such a task might prove daunting.
A great deal has been written—and continues to be written almost daily—about implementing classroom instruction that promotes the skills and knowledge called for in the CCSS/ELA. Less focus has been given, however, to addressing the additional skills and different kinds of knowledge that are called for to complete some of the tasks found on the new CCSS/ELA-related assessments.
The skills and knowledge that underlie understanding the expectations of and writing responses to higher-level questions are not simply test-taking abilities. Rather they are skills and dispositions that apply to both demonstrating achievement on the assessments and, more importantly, to effective information processing in the 21st century.
Focusing on open-ended tasks (future issues of Text Matters will address other types of tasks, such as research simulations), this issue of Text Matters identifies the skills and knowledge that students will need if they are to achieve success on the new CCSS/ELA-related assessments and offers ideas for ways that teachers can develop these skills and understandings. The three main goals of this article are:
As of early 2014, most American students are not accustomed to writing extended responses for assessment questions. Rarely do state assessments (and even more rarely commercial publishers’ norm-referenced tests) require students to write even a phrase or a sentence or two in response to questions, much less an entire paragraph. They might write answers to some questions in core reading materials. However, these answers are seldom extended and the questions do not yet reflect the “close reading” intent of the CCSS/ELA, which involves inspecting a text closely for evidence that supports responses. In many classrooms, students do little writing in response to their reading. Most often, they construct responses, usually orally, for an immediate audience (e.g., a small group or the entire class in a classroom setting). If a response misses the point of a text, the student gets immediate clarification and correction from the teacher or a peer.
On the CCSS/ELA-related assessment tasks, however, students will be reading texts on their own and writing responses for an audience that is remote. And, whereas students in a classroom setting get a second chance for a correct response as the teacher repeats a question in a class discussion or asks for greater clarification on a written report or essay, there is no such fallback for students who miss the intent of an open-ended test task. The lack of immediate feedback and guidance creates a major impediment to the ability of students to write responses that demonstrate what they comprehend from the text and provide support from the text for these responses.
In addition, when one examines student responses to open-ended tasks, it becomes apparent that many students also do not read the questions carefully, and their responses are off target or not sufficient.
Consider this example of a constructed-response question and what specifically it requires students to do:
What could you conclude about the author’s bias? Provide two pieces of evidence from the text that support your conclusion.
Mistakes students are likely to make in answering this question have nothing to do with their comprehension of the stimulus text. Often these mistakes reflect lack of attention to the specifics of the task and lack of completeness in responding. Common mistakes that students make in their responses include the following:
The first three problems indicate that close reading is a skill applicable not only to how students must read the stimulus text, but also to how they must read a question and think about what it requires them to do.
Another mistake students often make as they read assessment tasks is the failure to pay attention to the verbs in the questions. For these open-ended tasks, the scoring guides are closely aligned with the verbs, and teachers must make sure students understand that there are differences among explain, describe, list, summarize, and identify. For example, a student response that describes a situation will not receive a full score if the assessment task asks the student to explain it. Some lessons on these verb differences and on how to respond to questions that contain each can help students in their careful reading of tasks and successful construction of responses. Students also need practice responding to questions with different verbs and discussing how their responses reflect the verbs’ intent. This attention to understanding the verbs of questions is useful for almost all students, but it is critical for English language learners. The final two mistakes made by students in their responses, as noted above, are largely conceptual shortcomings that will be discussed in the following section.
One important note: It is crucial that teachers directly teach close reading of tasks. Students might be able to perform an assessment task but fail to demonstrate their ability because they misread the task. Moreover, attention to the specific requirements of tasks is not only a skill but a critical disposition for success at school, at work, and even in personal pursuits such as sports and hobbies. Helping students recognize the importance of attention to task requirements in all aspects of their lives promotes the development of this disposition. Teachers can use games such as Simon Says to develop this ability with very young students. Keeping classroom discussions on topic or work groups on task can promote this disposition as students move across grades.
The new CCSS/ELA-related assessments contain a variety of open-ended tasks, in addition to the ones that have already been described. Table 1 lists ways in which students may fall short in their responses to particular kinds of tasks.
|Example of Task||Examples of Frequent Mistakes Made by Students|
|Give three reasons, based on details in the text, that Wolfgang thought he was doing the right thing.||
|What is the main point the author is making in this article? Provide three details that make that point.||
|Tell which character you believe was the bravest and give evidence from the story that shows that the character was brave||
Students’ faulty responses reflect a lack of experience with the types of tasks—tasks that require students to read closely and attend to the evidence in the text. To become competent at these tasks requires experience with such tasks and deliberate instruction of strategies and close reading of tasks. Three actions on the part of teachers will support students in developing the competence that will keep them on the road to college and career readiness:
Look again at the typical mistakes students make, such as those listed in Table 1. The related mistakes that students are likely to make in responding to the tasks reflect two major problems:
Teachers can help students avoid these problems by helping them to understand who their readers will be and by demonstrating for them how to frame the responses in ways that make explicit connections between their ideas and information from the text.
Writing for “remote readers” is a new experience for young students who are accustomed to sharing their writing with teachers and peers who can give feedback about clarity on the spot. Teachers need to help their students understand that as they write responses on a large-scale assessment, they are writing for readers who are unfamiliar with them personally and who will not available to ask for clarifications or to point out shortcomings of their writing. Indeed, students need to know that their responses might even be “read” and scored by a computer.
In addition, students, especially younger students, are not aware of the importance of providing clear indications of their thinking in their writing. During class discussions of text-related questions, students can ask for clarifications and have incomplete or vague responses corrected. When writing answers for a stranger to read, clarity is essential. Showing students some unclear responses to questions and discussing how to fix them is one step in developing both their awareness of the need for clarity and their skill in providing it. Having them work in groups to improve the clarity of their own responses and those of peers is another approach that can help focus student attention on how to apply this skill.
Finally, prompting students to self-monitor by asking questions is an especially effective way to help them keep in mind the need for clarity as they write. A guiding checklist can provide them with hints such as the following:
Making connections between ideas in writing is a key aspect of clarity. As in the examples above, most CCSS/ELA-related assessment tasks ask students to give evidence from the text to support their responses. Examination of student work shows that those who are unfamiliar with this kind of test question commonly provide just a conclusion and list two details from the text. They seldom offer any information as to how these details support their conclusion.
Direct instruction and practice with both written and oral responses can develop students’ skill in making connections explicit. The following are some practices and activities that teachers can use both to help students develop a model for thorough, complete answers and to learn about the aspects of their writing that trigger confusion in readers:
The constructed-response questions on the new assessments require students to produce thorough responses quickly. Although the assessments are not timed, the capacity of students to focus and stay on task automatically limits the time that they can spend responding. This means students need to be able to respond relatively quickly while being thoughtful and clear. This is a tall order. The importance of being clear has been addressed above. The ability to respond quickly with thorough writing requires separate attention on developing the required “cognitive muscles” involved in fluent writing.
One approach to accomplish this is simply to have students write frequently in response to classroom activities, including reading sessions, media presentations, and discussions. Teachers should lead students to examine such writing and to discuss it in terms of clarity, focus on task, and use of information from the connected activity.
Teachers also need to make the criteria for acceptable written responses clear and apply them often to student writing, as well as having students use the criteria to monitor their own writing. Remember, the goal is not just to have students write but to have them write clearly and fluently. Here is one possible rubric that can be used to gauge how well students manage this:
For self-monitoring, teachers might provide these questions for students to answer as they evaluate their own work:
Again, it is important to give students time to evaluate their own responses, those of other students, and work as a class on sample responses. Conversations about the content of the writing pieces as well as the strategies used to produce them can provide students with crucial insights into the unique genre of open-ended question responses.
Another way teachers can help students to develop fluency in writing responses is the use of response logs for literature and learning logs with textbooks and classroom activities. The use of logs or journals has been around for many years, but the strategy needs to be adapted to prepare students for the new assessments. For example, students should be prompted to focus closely on identifying and including specific details from texts read, class presentations, and discussions to support their ideas in responses.
Some possible questions teachers might ask to keep their students focused as they prepare their logs include:
Students can use highlighters to indicate where in their journals they provide support for their responses. This also will help them develop the habit of rereading what they have written for completeness.
Some constructed-response tasks require students to gather and organize information from more than one source and to present that information clearly. Very simple graphic organizers can help students with this strategy (Figures 2 and 3 show some basic examples). Teachers should discuss with students which types of organizers work for which tasks and why, explaining that the organizers function like training wheels on a bicycle, and that students will not need them once they develop proficiency and facility with the thinking underlying the organizers. As specific organizers are taught and applied, students can keep models in their logs or on a set of index cards for easy referral when preforming their classroom writing tasks.
Older students who compose on computers and tablets can find graphic organizers in their word-processing programs. Taking time to point them out and encouraging students to use them is sound preparation not just for completing the open-ended tasks on the new assessments, but also for their everyday writing.
To respond to items on both the summative assessments and performance tasks, students need to maintain focus as they read long, complex texts and write extended responses and compositions. This means that they must develop stamina, or staying power (see Hiebert, 2014, for a full discussion of stamina). To achieve this, they must participate in many classroom activities that demand focus and maintenance of effort over time. A class in which students read or write for an entire half hour is not wasted time but time spent building students’ cognitive muscles. Teachers can use this time to serve as coaches and monitors, helping students stay on task, maneuver over rough places, or get moving again after stalling. For these activities, guiding questions that help students monitor their efforts and self-correct especially need to be part of teachers’ tool kits.
Encouraging students to read more outside of class and to keep response logs can also help them develop stamina. Younger students might benefit from keeping a chart of how long they read at home at least three nights a week.
The skills and knowledge discussed in this issue of Text Matters are essential for success in college, career, and everyday life (Partnership for 21st Century Skills, 2006). Anyone given an assignment, whether at school or at work, will not succeed if she or he does not comprehend the task and complete it as instructed. These proficiencies involve the critical thinking and management skills that allow individuals to be successful in college, careers, and communities.
In addition, the pervasive use of electronic media by students to participate in online college courses and to interact socially, and by business people to communicate with remote colleagues and clients, makes the use of clear, easy-to-understand writing crucial. And, faced with the glut of information—and misinformation—available through the Internet, it is equally crucial to be able to back up claims with specific information from reliable sources—and to recognize when others have not done so.
Consequently, providing students with the skills and knowledge needed for success on the CCSS/ELA-related assessments also provides them with key tools they will need for success throughout their lives.
Hiebert, E.H. (forthcoming February, 2014). Stamina, silent reading and the CCSS. In E.H. Hiebert (Ed.), Stamina, silent reading, and the Common Core State Standards. Santa Cruz, CA: TextProject.
Kapinus, B.A. (2002). Assessment of reading programs. In S.B. Wepner, J.T. Feeley, & D.S. Strickland (Eds.) The administration and supervision of reading programs 3rd Ed. (pp. 162–177). New York, NY: Teachers College Press and Newark, DE: International Reading Association.
Common Core State Standards Initiative (2010). Common Core State Standards for English language arts & literacy in history/social studies, science, and technical subjects. Washington, DC: CCSSO & National Governors Association. Retrieved from http://www.corestandards.org/assets/CCSSI_ELA%20Standards.pdf
Partnership for 21st Century Skills. (2006, March). Results that matter. Retrieved from http://www.21stcenturyskills.org/index.php?option=com_content&task=view&id=204&Itemid=114
Smarter Balanced Test Samples. Grandma Ruth. Retrieved January 6, 2014 from http://sampleitems.smarterbalanced.org/itempreview/sbac/ELA.htm
Buss, K., & Karnowski, L. (2002). Reading and writing nonfiction genres. Newark, DE: International Reading Association.
Moss, C.M., & Brookhart S.M. (2012). Learning targets: Helping students aim for understanding in today’s lesson. Alexandria, VA: Association for Supervision and Curriculum Development.
Newkirk, T. (2012). The art of slow reading. Portsmouth, NH: Heinemann.
Perry, T & Manery, R. (2011). Supporting students in a time of standards English language arts grades 6-8. Urbana, IL: National Council of Teachers of English.
Popham, W.J. (2008). Transformative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.
Vasquez, V. (2003). Getting beyond “I like the book.” Newark, DE: International Reading Association.
Wessling, S.B., Lillge, D., & VanKooten, C. (2011). Supporting students in a time of standards English language arts grades 9–12. Urbana, IL: National Council of Teachers of English.
Wiliam, D. (2011). Embedded formative assessment. Bloomington, IN: Solution Tree Press.
Williams, J., Homan, E.C., & Swofford, S. (2011). Supporting students in a time of standards English language arts grades 3–5. Urbana, IL: National Council of Teachers of English.