Well, it's pretty clear that the legislators over in St. Paul have not been reading my blog. As I said in my previous two posts, using student's test scores on standardized tests is an ineffective way to evaluate teachers. There are links in both of those posts to well articulated reasons why test scores are not a good idea. To be fair, according to the StarTribune report today, the legislators have not specified that test scores need to be used to determine student academic growth. "School districts will also have to start new periodic evaluations of teachers based on a loose set of guidelines. Thirty-five percent of that evaluation must be based on student academic growth. If districts and unions cannot agree to an evaluation plan, they must use one outlined by the education commissioner."
I'll hold out a little bit of hope that at least one or two districts in the state will attempt to determine student academic growth by using something other than standardized test scores. But even if a couple of districts manage to use authentic assessment methods, most districts will rely on some standardized test score. While ineffective and expensive, it's easy and accepted. What's likely to happen is that we'll end up with a hodge podge of ways to determine student academic growth and a hodge podge way of applying that information to teacher pay schemes. I think we're well on our way to making the current mess even messier.
You know, of course, that I'm a Moodle advocate. It's a tool that can be used for most of the many aspects of teaching and learning. Most significantly, for this discussion, Moodle provides the means to assess student academic growth in a whole bunch of ways that can be about as detailed as you want to make them; it also provides a real way to assess or evaluate the work of teachers while actually making authentic correlations of the teacher work to student academic growth. The final outcome could even be enumerated, if necessary, which is what is so attractive to the folks pushing the idea of using test scores.
One of the big reasons, I think, that the currently accepted ways of measuring academic growth is going to be pitiful, in addition to the reasons listed in the articles I've linked to in my two most recent posts, is that teaching and learning is changing, and it will be continuing to change very rapidly, and the standardized testing method doesn't have a prayer of keeping pace with the changes that are happening in learning and teaching.
Take for example Grovo, one of the new companies that will be a force in changing teaching and learning. Grovo isn't in schools, yet, and it's 'only' teaching new high tech types of things, so far. But, it's a method of student centered 24/7 kind of learning that will be what students of all kind are looking for soon. Well, students want Grovo lessons, now. Grovo, so far, doesn't have a way to report student work. I heard a rumor that they might be working on some kind of way to do that - I would recommend using Moodle. Even without built in reporting tools, Grovo and Grovo types of learning environments could easily be ported to electronic Portfolios, which is the way that academic growth will eventually be measured. Yes, portfolios are more complicated than a raw score/percentile score/growth score report, but then teaching and learning is way more complicated than a raw score/percentile score/growth score, isn't it?
And then we have Sophia, my local favorite to make a real dent in how teaching and learning happens in the next months and years. Sophia has actually taken a step toward assessing and evaluating the work of teachers. The posted lessons (learning packets in Sophia speak) are rated by people who already have credentials or experience in the topic area. Sophia has taken the all important step in teaching and learning of including a discussion board and grouping tool. (Full disclosure: I know they're thinking about ways to report out student work to portfolio tools because they picked my brain for a few hours re: Moodle etc. The Sophia folks are very talented, creative, and brave, and I don't think they'll mind me saying that they're open to any ideas you might have, too.)
Socrative is small and new and way out there in New York City by Grovo, but this tool has legs, IMHO. They've leap frogged a lot of the people trying to do something new in education by going right to mobile devices of any kind. Because the Socrative tool is limited in the way that Twitter is limited, it's simple and small, it also has the flexibility to be adapted to all kinds of teaching and learning. Student and teacher work is immediately portable and quantifiable. The issue with Socrative is getting admin people, teachers, too, up to speed on how to actually use all of that raw real data. Tangentially, I think there will also be a learning curve in how to use the tool for optimum pedagogical effect, but it should be a quick curve.
Betterlesson.org is already big and not so different from the way we've always done things in the past. It's really just a big online folder full of reproducible lessons - a black line master lesson book on the web. The good news is that there's hardly anything a teacher needs to learn about using Betterlesson.org that's different from the way things were done in the 1970s, and that's the bad news, too. It's an example of how to use technology to keep doing things the same old way. But, it still has enough variety to really mess up a plan to use standardized tests.
I'm trying to think of the right way to tie-up this post to say that standardized tests are already obsolete before the laser printed bills over in St. Paul cool down to room temp. They were obsolete even before that.
July 25, 2011
A really cool thing about blogs is that you can edit them. This morning I received a Tweet (from Knewton) with a link which said it was about their online learning platform. Since I'd just done a brief review of some eLearning platform type tools, I was curious to learn more about what Knewton was up to. It turns out that the article under the link is actually an interview with George Siemens about how new technologies, like Knewton and the ones I mentioned above, can change teacher evaluation and several other aspects of education, as well. That's what I was getting at in these last three posts.
I've admired and commented about George's work before. His thorough and articulate analysis of the possibilities of eLearning is most definitely worth a read.
Dan,
ReplyDeleteGreat post- caused me to reflect a bit.
Standardized - multiple choice, in particular- tests confound purpose in the world of learning. Kids don't learn to read, write or do math because of a standardized test. They don't learn history, science, a second language or the arts because of a standardized test. They don’t love learning because of a standardized test.
Children learn when they find value in the work they create, when they discover a passion worth pursuing, when they’re challenged to think deeply and work hard. You can’t measure these and equate them to teaching quality through a standardized test.
Because of the U.S. propensity for standardized testing on the cheap (in public schools), we've lost focus upon honing the teaching skill of noticing children as individual learners who bring different context, knowledge, interests, and capabilities to the learning community. This critical skill fuels the act of teaching well.
Day to day informative assessment for learning defines the role of teacher as one who can assist a learner to make sense of learning so that scaffolding "new" can occur. This begins with teachers who build capacity to observe, synthesize, evaluate and create - indeed design think their role as teacher of the individual learner and within the greater learning community. Learning happens differently for children- there is no one-size-fits all recipe but there are patterns.
One pattern remains true over time. Kids don't begin school on the same starting line and they don't take the same path through the learning work they encounter. The time it takes for them to navigate differs from child to child and the knowledgeable teacher understands this.
Standardized tests assume that a teacher will level those differences by closing “gaps.”
Yes, we think we can sit kids down, place a screen or a paper test in front of them and measure "them." Then, we think we can equate the quality of teaching with their learning growth as if A=B. However, if we've proven anything in the last decades it's that:
standardized testing ≠ learning
kids still ≠widgets
teaching quality ≠ one standardized test measure
Thanks for your post series- thoughtful work as always.
Hi, Dan. Thanks for the post! Have you seen this: http://blogs.edweek.org/teachers/living-in-dialogue/2011/07/complex_thinking_is_not_tested.html
ReplyDeleteApparently many of us are on the same page. I didn't know about the march this weekend, but I'll be paying attention now that I do.
Keep these posts coming! :-)