How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

TPACK in a textbook!

Just found out from Kathryn Dirkin that a prominent textbook of Educational Technology now features the TPACK framework. The book is titled "Integrating Educational Technology into Teaching" [link to Amazon.com] and is authored by Margaret D. Roblyer and Aaron H...

Technology Integration 2.0 — was TPACK 😉

The recently concluded NECC conference had quite a bit of TPACK related presentations. Sadly neither Matt nor I could make it to NECC... maybe next year! One I discovered just today (h/t @mhines on twitter) was one titled School 2.0 & Understanding by Design....

Call: Failure and Creative Risk in Technology-Enhanced Learning

Call: Failure and Creative Risk in Technology-Enhanced Learning

I am excited to announce a call for articles on Failure and Creative Risk in Technology-Enhanced Learning for a special section in the journal Tech Trends, edited by Danah Henriksen, Punya Mishra, Edwin Creely, and Michael Henderson. You can download the the...

You’re invited! MAET Showcase July 26th 10am, Room 252 Erickson

Dear MAET graduates, current students, and other friends of the program: You are cordially invited to our current MAET Summer 2013 students’ final project showcase, on July 26th, at 10am, in room 252 Erickson Hall. As you may know from your own past experiences with...

TED talk: How to design a school for the future

TED talk: How to design a school for the future

My TED talk, titled How to design a school for the future just went live this morning. Sadly, I was traveling in India when the recordings were scheduled so I missed the whole "standing on the red-dot" looking like a thought leader who will give a talk that will...

TPACK Newsletter, Issue #11, October 2011

TPACK Newsletter, Issue #11:October 2011 Welcome to the eleventh edition of the (approximately quarterly) TPACK Newsletter! TPACK work is continuing worldwide, and is appearing in an increasing diversity of publication, conference, and professional development venues....

Summer travel 2008 photographs

I have been taking photographs as I travel around Asia (what I have previously described as my multi-national TPACK tour) and uploading them onto Flickr as and when I can. Go to the photographs

TE150 presentation in streaming video

Terri Gustafson has created streaming downloads of the presentation recently made by the TE150 (Reflections on Teaching, Reflections on Learning) Online team (see this for more context). The video can be seen in two parts: Part I: The presentation "Reflections on...

Baby Talk

This piece was written sometime early 1996 when we were expecting our first child. I posted it to the web when we were expecting our second. It still reads well... Connections A few weeks ago, Smita (my wife) and I found out that we were going to have a baby–our...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *