The 2019 reading project: takeoff!

Yesterday at our HOD forum, we looked at the draft proposals for our annual plan objectives and targets, based on the data and discussion presented at our annual plan middle leaders' hui last month.  Reading will definitely be a school objective and target, and we considered the challenge of how to measure reading progress throughout the year.

For me, measuring is irrelevant if we don't unpack our processes with teaching reading.  I've mentioned before (I think....) my frustration with the current state of reading guidance for secondary schools.  Lots of good ideas, lots of links on TKI which are often for primary audiences, but I know something is missing.  It could be that it is missing from my world and I find nirvana just by doing some more research.  Or it could be (more likely), that we need to start by locating ourselves in the student's experience, and building up from there.

So, yesterday afternoon we started with unpacking the PAT reading experience.  In blue below is the task I set up for us to work on in our department meeting time.

Unpacking PAT reading: Tuesday 11 December 2018

We will each work with a photocopied set of the PAT Test Seven booklet (typically used with Year 10 classes).  I will have highlighters and scissors available. We will work through the following questions on paper (so old school!  I’m all about tactile at the moment, and then taking photos to upload for records and next steps).

1. Can you code each question: blue = on the lines; orange = between the lines; green = beyond the lines?
2. What is the essential vocabulary for each question which not all of our students will have?  Make a list.
3. Is it feasible for us to integrate this vocabulary into our teaching?  Ethical?
4. What other skills are needed to decode the answers?  Make a list and link the skill to a specific question(s).  E.g. p3, q1 requires understanding of connotation.
5. What key competencies/dispositions are needed for students to demonstrate their best skills in this test?
6. Next steps/questions for 2019?

We were blown away by the experience. We all thought that the test is very difficult. It is very 'white' and 'middle class' in terms of the texts ("The lore of finchland"?!). The demands of the vocabulary in the text are considerable, and the process of making the inferences required to answer many questions correctly requires three steps and strong visualisation skills. Key next steps for me/us include:

• The first set of questions is really difficult, possibly the most difficult in the test. We need to flag this to our students, and help them develop their resilience to keep concentrating, and not to give up and make random or close to random choices for their answers.

• Provide a paper copy of the test for the students. As with the Unfamiliar text exams for NCEA, students will answer online, but have the ability to underline, highlight, circle and do any other annotation which supports their processing. We noted for the Science text in particular, that the questions were on the lines questions, but they required close reading of the text to isolate the precise step which answers the question. Doing that manually is much easier than only being able to use our eyes to search for a specific piece of information.

• There are some processes tested which are specific to Maths and specific to Science. Using my Literacy Leader hat, I could break these skills down and share the expectations with the relevant departments in my school.

• The level of inference that the test asks for is very high. For example, one question asks the reader to choose the best word to describe the sea. When I went searching for the keyword "sea," it was nowhere in the text. I then looked for words which referred to the water, and found Pukewai Harbour. All good for the student who knows the word harbour, not so much for the student who does not. Then the phrase in the text was "Pukewai harbour was a sheet of bronze." So in order to decide whether the sea was white, choppy, warm, flat or stormy, the student has to identify the reference to a body of water, understand and visualise the metaphor and then evaluate it against four adjectives. That is a 3-4 step process of making inferences, and I think we generally teach two steps of inference.

• Some teachers noted that this seems harder than the Level One Unfamiliar Text paper, and I am inclined to agree. We do really well with our results for Unfamiliar Text at Grey High, and I have wondered before about the relationship (dissonance?) between the closed nature of the norm-referenced reading tests (we used asttle reading before we used PAT reading) and the open nature of the Level Six texts and questions we see a year later. However, PAT Reading tests skills across a much wider area than just English, and interrogating the test from a student's experience has already begun to show us paths for us to be more effective at how we teach critical thinking and close reading.

• We started with PAT reading three years ago, and I think I didn't go near the actual test because it seemed like cheating in some way - that we might be influenced to teach specific vocabulary and that would compromise the test process. This meant that the world of these skills (or the specific PAT manifestation of these skills) stayed quite closed for us. We have spent time (quite a lot of time) analysing the results of the tests, and we have had a valuable session with Cathy Johnson of NZCER looking at how we can make the most of the NZCER data, but that hasn't brought us closer to understanding the student's experience.

• Lauren and I are going to spend some time in January looking at a possible coding system for the different types of reading skills required in this test, and then look developing a skill focus and tracking test for one skill for each term.