How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

Representing me

Sharon Guan with the Instructional Design & Development Group at DePaul University has invited me to present at a faculty conference next April. I will be speaking about the manner in which new technologies are pushing us to blur the lines between the professional and...

Mishra, Dirkin & Cavanaugh, 2007

I have been teaching summer course in our master's program for years now and for the most part have found them to be the most enriching teaching experiences I have had. These are intense 8 hours a day, 5 days a week programs that typically go on for a month. [We are...

Explore: To see … or not to see

I have been working with my kids on a series of short videos around the themes of Explore, Create, Share. These three words were used in my video mashup of a commercial (see the commercial AND my mashup here). Original music for this series was created by my cousin,...

More sketches

A few weeks ago I had blogged about my experiments with sketching on a Wacom graphics tablet. Here are more sketches I have created in the meanwhile. You can see them here as a webpage or view it as a slide show.

Designing 917: A conversation

Danah Henriksen and I taught CEP917 (Knowledge Media Design) last semester. This was a somewhat unique class, with half the students being present here on campus and the other half online. We met synchronously once every two weeks and the rest of the class happened...

Perspectives on Global Learning: SLL at the GLOW Conference:

Perspectives on Global Learning: SLL at the GLOW Conference:

I joined my Silver Lining for Learning (SLL) co-hosts - Chris Dede, Curt Bonk, and Lydia Cao (with Yong Zhao unable to attend due to travel) - to deliver a keynote at the Global Learning for an Open World Conference. SLL has been a labor of love over the past five...

Tech integration models and GenAI: Podcast episode (Part I)

Tech integration models and GenAI: Podcast episode (Part I)

I was recently invited to be a guest on the Superspeaks | Microsoft EDU podcast on the BAM Radio Network. the topic at hand were technology integration frameworks in the age of Generative AI. I was joined by a literal who's who of educational technology scholars, all...

James Kaufman on creativity: New article

James Kaufman on creativity: New article

Dr. James C. Kaufman is Professor of Educational Psychology in the Neag School of Education at the University of Connecticut and a highly-renowned creativity researcher. He is also a writer and playwright, having recently written the book and lyrics to the musical...

Understanding student engagement

I had posted recently about a Gallup poll on student engagement. Essentially the poll showed that student engagement dropped precipitously (though as I wrote, not as starkly as their graph indicated) as students moved from elementary to high school. My friend, Gaurav...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *