All you can cheat, part II (a response)

by | Friday, November 13, 2009

Cheating

Patrick Diemer commented on my previous posting, All you can cheat, the web & learning by saying:

Do you have any words of wisdom or resources on how to create appropriate questions? This sounds great, but easier said than done in my humble opinion.

I started writing a response to his comment, but as I wrote on, I realized that it was better as a post in its own right. So here it is…
Patrick, I agree that this is not easy, at least not as easy as pulling out a set of multiple choice questions. However, it is not all that hard either. What we need to do as educators is look for open-ended questions, questions that test for understanding require reflection on the part of the learner. For instance in the courses I teach here at MSU (undergrad and grad level) we strive hard to develop assessments that students of this nature. There are many examples I can give but here’s one.

In a fully-online undergrad course on educational psychology we ask students to view a series of video clips taken from popular movies and documentaries that deal with different aspects of learning. This happens at the very beginning of the semester (sometime in the first week or two). Students are then asked to write their response to these clips speaking to “what they see” that is of educational relevance.

Students then go through the semester and then at the end of the semester are asked to do this again. This time the comments they made the first time around are hidden from them. Then we reveal what they had written the first time around. They are then asked to go back and read what they had written the first time around (as well as what other students had written). Finally, they write a response discussing what has changed in “what they see” – providing examples from their own writing and those of their classmates.

This task – spread out as it is over a semester – does a bunch of things. First, it allows us to see how much students have learned. If there is no significant difference between what they wrote the first time and the second, it is clear that not much learning has happened. Second, and more important, this is not something we need to tell them. They can see it for themselves, particularly when they compare it to what their classmates have written.

Now we could give them an end of semester exam that asks them all kinds of questions about different theories of learning and development – but don’t you think this is much better?

As for using (or not using) the Internet… it is not an issue at all. There is nothing they can do to cheat to find the right answer. They can use the Internet (and we recommend that they do) to reference and justify what they write but that is neither here nor there. If they don’t “see” the clips through ed-psych eyes, they won’t know what to search for in the first place.

An important question here is whether this assignment will  fit for each and every course we teach? No way. But that is what makes this interesting to me as an educator. These assessments have to emerge from the instructors deep understanding of course content and course goals. We need to keep asking ourselves what do we want our students to take away from this class – and try develop assessments to match. In this class, our goal is the help students develop an ed-psych way of thinking and looking at the world and this assignment does that, I think. As we have written in our TPACK related work, there is no general solution to the problems of teaching. Solutions are local, unique and depend on finding the “sweet spot” (so to speak) that connects content, technology and pedagogy. This solution works best in an online course, it would have to be modified somewhat in a face to face version (particularly the part where students can read all of the other students’ responses). Can it be done? Sure. Will it be the same? Not really. This is where teacher creativity and innovation comes in.

I must add that this is not the only assignment in this class. There is a book review, an interview of an educator and a bunch of others. So all of these work together to help us (and them) develop a better understanding of all the ideas we cover in the class.

Image: Wikimedia

A few randomly selected blog posts…

Harris, Mishra & Koehler, republished

Back in 2009, Judi Harris, Matt Koehler and I published in a piece in the Journal of Research on Technology in Education. That article has now been included in a book, titled: Considerations on Technology & Teachers: The Best of JRTE, edited by Lynne Schrum, and...

Cost of living

Being alive costs taxpayers trillions of dollars a year First time research reveals staggering annual taxpayer cost for being alive East Lansing, MI, April 15: In first-ever research, a new report quantifies a minimum 3 trillion annual taxpayer cost from citizens...

Qualitative research in an age of AI

Qualitative research in an age of AI

Qualitative data can be extremely rich, complex and insightful, allowing us to uncover the complexities of human experiences, perceptions, and interactions. It can also be complicated and messy. And the way we make sense of it is through the one-two punch of thematic...

How to complete a half-marathon

I completed the Capital City River Run Half Marathon today. This race has become an annual event for me, this being my 7th outing so far (the first three years being a 10 mile run before it shifted into a half-maraton). [See links here, here and here]. I completed the...

Meta poems too

Meta poems too

Layout is the first to go Lines of poetry are sacred to both the author and the reader. To alter the specific construction in line length is to alter the look and rhythm of the poem. However, as ebooks and eReading devices have become more prevalent, readers have come...

véjà du, on seeing anew

I recently learned about véjà du (see here to learn more). I was sufficiently intrigued by this idea to use this as an assignment in the CEP818, Creativity in Teaching and Learning course I am currently teaching (with Mike DeSchryver). The assignment students were...

Educators as Designers

Educators as Designers

How might we? Three words, and a question mark. At one level it is a simple question—leaving open what it is that we might do. But at another level its openness is its strength. Because inherent within it is a call to action, a discomfort with the way things are, and...

Penang update

Today was my presentation at the University Sains Malaysia. I was picked up this morning by Abdul Hamid, a huge beefy man, with little English, but a great smile. A beautiful half-hour drive along a sea-side highway led us the University which is perched somewhat on a...

Guest blogging for Nashworld: TPACK video

Sean Nash over at Nashworld asked me to guest blog for this week while he is out with his students doing some really cool stuff. Here is a link to my posting: A TPACK video mashup!. I end the post with a couple of videos, one a commercial and the other my mashup...

10 Comments

  1. Dan

    Well done, Punya!
    This is a good post. Keep it up…

    Reply
  2. Punya Mishra

    Thanks Lindsey for your thoughts. I will try and find the book you mention – sounds interesting (and a great title as well). ~ Punya

    Reply
  3. Lindsey Tilley

    Punya,

    I feel your ideas are spot on with my personal philosophy of education and I am really interested in hearing that Denmark is in many ways forcing their teachers to re-evaluate their assessment practices. Unfortunately, this is probably the only way many teachers would actually change their methods.

    Kelly Gallagher, who wrote a book titled Readicide in 2009, articulates many of the same points you made here and offers some suggestions for revamping assessments that align with your post beautifully! (particularly in Chapter 1)

    Thanks for sharing your thoughts!

    Reply
  4. Cheryl

    One portion of your post thet particularly hit home with me was, “We need to keep asking ourselves what do we want our students to take away from this class – and try develop assessments to match. “Even though I often fall short, I still strive to do that very thing.

    The ideas and techniques you discuss in your post demonstrate that students are challenged to think at a higher level, using the Internet to support their thoughts. That certainly isn’t cheating in my book.

    Reply
  5. Punya Mishra

    Thanks Tina for your note.

    Chuck, I completely agree with you that the idea of developing information literacy as being a first step is a crucial one. I see kids not being able to distinguish between advertisements and actual websites (especially when the conduct a google search). The abundance of information (often on all sides of a topic) is an issue too. I would love to find out more about your “six steps” as you develop it. Developing procedures and strategies such as the one you hope to develop are of utmost importance today, and for that you need a teacher!

    Reply
  6. tina gupta

    Hi, this Tina from mumbai, thats a nice write up, I did my MBA from Sikkim Manipal University Distance Education. They too provide awesome courses in management and IT, with no entrance exams and with reasonable fees too. They have their centers all over and you can take transfer wherever you want.

    I had fun while studying with SMUDE, keep up the good will SMUDE.

    Regards,
    Tina

    Reply
  7. chuck

    Punya,

    I agree with your blog post…and these sorts of assessments would work well in an idealistic educational setting. However, we teach and learn in an educational system that tells us to be flexible, yet lacks flexibility itself.

    Could the type of assessment you describe be a rich learning opportunity? Absolutely. It actually gets me excited about what “could be!” If the internet could be utilized during assessments, as suggested by the Danish government, I believe we need to take a step back before surging on.

    In a recent Inquiry Project in CEP 806 (teaching science with technology), we explored “finding and using internet science information.” As a middle school teacher, I was amazed at how much kids lack the necessary skills for finding information. They are literally drowning in information, and they do not even realize it. So, the “step back” I suggest is to properly equip students with the tools to find information that is helpful, relevant, and useful (I try to avoid using the word “appropriate” because it is somewhat ambiguous). In response to my inquiry project, I have been working with my school’s media center specialist to create a “six steps to success” (or something like that), that would walk kids through what resources are available to them (giving them an order, and allowing them to work from there, etc.). The hope is that this will give kids the steps for them to be successful in finding information. Additionally, it will get all the teachers on the same page…creating less confusion for students as they move from class to class, and moving on to different grades.

    The possibilities for assessment with the internet is exciting. However, we cannot assume that kids “know” how to find information…because many do not have a clue. Just because they can download songs to their iPods and update their facebook status from their phones does not make them effective at finding information. We can’t assume they know “how”…and…this is a great place to insert a teacher…

    Reply
  8. Buckdat

    Hello Punya! Thank you for sharing! A very nicely crafted post! 🙂

    Reply
  9. Punya Mishra

    Stewart, Thanks for your note. You get it exactly right. Why should education be about (as you so aptly note) “tricking students, about placing little traps to trip them up.” If you see my previous posting about teaching for anticipation – it is all about “showing them the end”, the big picture as it were.

    Back in May I conducted a workshop on creative teaching for MSU faculty and one of the ideas we came up with was giving students the final exam the first day of the class – not to evaluate them (though it could be a pre-test of sorts) but rather to let them know what they would be learning in the upcoming semester. Then when they do get to the final exam, you can compare (or better still) ask them to compare their performance on the first test to the one taken at the end of semester.

    In my experience students, even at the end of the semester, don’t often realize what they have learned, or how they have changed over the past few months of engagement with content. It all happens oh, so gradually. By giving them the final test at the beginning and then again at the end of the semester you can make apparent to them just how much they have learned.

    Additionally, the first test, as you said, shows them the end and raises the possibility of finding their own way. And if everything really works out, they could find a new end! How cool would that be.

    Reply
  10. Stewart Sternberg

    I have been encouraging my students to cheat for some time. I remember a long time ago a speaker at a professional development session said: “Let the kids see the test. Give it to them at the beginning of every unit. Why not? Show them where you’re heading. Let them see it. Be transparent.”

    I loved that philosophy. It’s not about tricking students, about placing little traps to trip them up, but about showing them the end and letting them find their own way, or at least letting them find their way and possibly finding a new end.

    The net is the same way. Giving them open ended questions is a tremendous idea. It forces them to think for themselves and to work at a deeper level, drawing different sources together and managing connections, seeing cause and effect to create a synergistic response. Also, as kids search through different web pages, looking for appropriate and pertinent content, they are exposed to different ideas and it may spark other routes of inquiry.er

    Reply

Submit a Comment

Your email address will not be published. Required fields are marked *