Showing posts with label testing. Show all posts
Showing posts with label testing. Show all posts

Sunday, June 12, 2016

It's Time to Decide What's Next in Ed

Stanley Howe CC License
Over the last decade, education has developed a dual personality. One is the high stakes assessment driven culture that focuses on a narrow top-down curricular vision. It is a vestige of the 20th-century vision for education. It is organized, clear in its means and outcomes. The yardsticks are set, and we are all measured against them. After trying this way for the better part of 20 years, we can say a few things. The first is that the accountability put in place helped shine a light on educational inequities that were sometimes hidden by local reporting practices. Accountability done well showed clearly the "achievement gap" and its relationship to income and other inequalities. However, the neo-liberal expectation that exposing certain inequalities will lead to a self-correcting system through a system of rewards and punishments has failed miserably.

At the same time, educators have realized that the post-industrial economy presents new challenges and need a decidedly different educational output. The vision was not necessarily new (Dewey was right) but it was now deemed necessary not just by humanist but also by business leaders. The call for education that is creative, problem-solving oriented, and includes soft skills is now coming from all sides. The problem is that we cannot do both at the same time. At least not well.

We have tried for a while to claim that working on 21st skills will also lead to growth in test scores a-la Dr. Seuss and Jack Prelutsky (Hooray for Diffendoofer Day!). The linear nature of tests defies this logic. From an effort perspective, you get more "bang for your buck" (the buck here is time) if you focus only on tested skills than if you work on a complex wide array of outcomes many of them long term. My mentor Lee Swanson used to call it confusing the independent and dependent variables. In this case, limited measurement gives you a false sense of impact.

What I see in the field are schools trying to satisfy both personalities. Let's score high on the test with a narrow curricular vision AND be creative. The reality is that our days are too short, and both teachers and students find it very hard to pivot from a structured almost canned curriculum to creativity and soft skills and then back again.

The question is how to combine the advantages of the accountability era, namely accountability that shines a light on inequities, with 21st-century curricular goals. The answer is simple. Technology. Technology allows us to record everything students do. The need for a narrow window of time in which all students are measured on a narrow set of skills can be replaced by a flexible system that records everything that students do and tags their growing abilities. My personal work with Actively Learn is an example of how this can be achieved. But for that to work, we need to put our attention to making sure that we have the right personality.

Saturday, February 21, 2015

Reflections on China Tour II- When the Stakes are High

Here in the US we often talk about High Stakes tests and their impact for example the work by Berliner and colleagues. In China the conversation about High Stakes was very different.

We had lunch on our last day in Shandong province hosted by one of the lead directors of the school district. After the exchange of gifts and pleasentries we had an inetersting discussion which started with his concern for student well being. He relayed that families are putting too much pressure on students to excel within the system, pressure that may harm some students maybe all. At the same both of us acknowledge the immense impact educational success measured by tests can have on individual lives.

We saw the importance of high stakes testing in almost every conversation with teachers and parents. Our research in China (With Stephanie Wessles and Guo Ji) is looking at the interaction between school and family. We had a chance to see the interaction in our first meeting with parents. Teachers took charge and directed parents who, in turn, complied without question. The parents were professionals from a middle class background but they followed teacher's demands. In the US middle class parents would have responded very differently probably actively resisting what they did not like and asking for a voice in the discussion. Here in China it was different and we were intrigued by it. In conversation some have speculated that this was part of the culture and Confusian ideals. Culture may have had something to do with it, though in private conversations and interviews parents were often critical of teacher's actions and did not think that teachers "knew better". The question that emerged was why parents did not resist what they thought was bad practice?

The answer seems to be linked to High Stakes. In China high stakes are meaningful most often to the individual. Starting very early students take tests that are critical for their advancement into the next level. There is a middle school test, high school etc. Each one of these has potentially dire implications for the student and his/her future path. The High Stakes for students and their family (pressure is intensified by the one child policy) create a need to comply. Parents relayed to us: "I do not always agree with the teacher  but I will not say anything because I fear there will be negative outcomes for my child." In the large classrooms (we saw elementary schools with 40-50 students) teachers cannot attend to all student needs. Each parent is keenly aware of the high stakes and the positive role the teacher can play, thus they do not want to rock the boat fearing that their students will be ignored or underserved.

In this case the impact of high stakes testing is a lost voice for students and parents who should be part of the conversation about education. This is not all one sided. This very same situation helped our efforts to integrate iPads into classroom instruction. Not all parents were in favor and a few worried about it but none resisted it This gave them an opportunity to see the impact on their students. After parents saw the impact they were decidedly positive. This is similar to the model Guskey suggested for teachers.

Tuesday, April 23, 2013

Grading, Creativity, and Teacher Education- Making Room fo Complexity

I caught the middle piece of a radio lab broadcast on choice. In it Gladwell (of Outliers and Blink) discusses the impact of explaining choice on the decision making process. In the battle between system 1 (quick snap judgements as in Blink) and system 2 (deliberate thinking), the latter seems to try and counter bias system 1- with the results being less than satisfactory (I borrowed the system 1 and 2 from Kahneman). In this he quotes Tim Wilson's work from VGA.

I started thinking about this effect as I was grading my students work on a rubric. I just finished grading and it dawned on me that my very specific rubrics, valued by my students, seem to encourage students to back away from ambiguity and complexity. In simple terms it means that when the rubric is specific it is economically beneficial for students to respond with simple lessons than complex ones, to choose one or two objectives than a complex integrated lesson. Going back to Gladwell (not fully Wilson's et al. point) forcing students to explain in detail may push them to make simplistic choices and shy away from complexity.

As  nation our testing system seems to be having exactly the same effect. Measuring creativity a popular subject recently may have the same exact effect. By clarifying what we mean by creativity we may be losing sight of the big picture...

Adding to my challenge is the fact that I do not control the milieu for the assignments. It is a negotiation between our students and their cooperating teachers. It is not always clear who sets the tone for the lesson- so I cannot penalize students for having simple lessons because it is not always up to them. The question is how do we make room for complexity- reward it in this context.

I suggest simply rewarding complexity (I know it when I see it) and demanding that simple lessons (like simple dishes on cooking challenge shows) are perfect. This note just like myself is a work in progress: We need more poetry! (A quote from a recent presentation by Sarah Thomas)

Saturday, September 29, 2012

Cart, Horses, and iPads

A district I work with just announced they were ordering sa large number of Dell laptops. One of the key reasons mentioned in the news article announcing this move was the need to have enough machines to conduct state testing. Now, I don't mind assessment and accountability but I do think we need to start considering the impact on school decision making. I do not have a problem with the districts decision making progress, they are facing a reality and need to respond. I am, however, questioning a system in which accountability pressures dictate everything from teacher bonuses to decisions about which technology to buy and what it will be used for.

I will pull a NASCAR metaphor. In racing, crews choose tires to fit the conditions of the road so their driver will have the best chance to win. In education we invest in the photofinish camera instead... Only problem is with the wrong tires the photofinish camera views will be very sad.

As an iPad fan I have a request from Apple. Districts are asking Apple to create an ecosystem that will allow students to participate in assessments on the iPad essentially locking other features so students could not "cheat" (on the nature of cheating another time). I am begging Apple to not succumb to this pressure. If you will create such an ecosystems you will undoubtedly sell more iPads but they will be used in all the wrong ways for all the wrong reasons. Experience tells us they will have a whole set of closed apps that will disable the joy of exploration and cross validation. At the same time such devices will be unavailable for instruction months each year so students can participate in testing.
It is time to put the horses in front of the cart. It is time to invest in the right tires so all students can get to the finish line.