How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

Of play and games

Some thoughts on play and games inspired by a recent article in the NYTimes Magazine titled "Taking Play Seriously". Based on the article I argue that play is essential for learning... I also throw in some thoughts about the distinction between play and games, and why...

TPACK Newsletter, #44 March 2021

TPACK Newsletter, #44 March 2021

This is a delayed (by more than a year) posting of the TPACK newsletter #44 (link to PDF). My apologies, I am not entirely sure how I missed that. As always, Judi Harris and team have done a great job. You can find the previous issues archived here. This issue...

Creepy

How do you react to this flash animation? I don't know about you but it completely creeped me out. My reaction is almost visceral in its intensity... It is one thing to read an an article speaking to our fear of snakes and spiders that "Certainly there are certain...

Martin Gardner, RIP

Martin Gardner, 1914 - 2010 Martin Gardner died five days ago. Gardner was an influential writer about mathematics and was one of the greatest influences on me (and my friends) as I was growing up. His recreational mathematics column was the main reason I subscribed...

Diwali 09 Photos

The Lansing temple recently organized a special Diwali program. My daughter Shreya participated in a dance and I, as always, took photographs of the event. Click here or the image below to see all 161 of the photographs I took. Enjoy. You can also read a poem written...

Eye Twisters

Eye Twisters: Ambigrams & other Visual Puzzles to Amaze and Entertain is a book edited by Burkard Polster, a professor of mathematics at Monash University. It features some of my work... From the back cover: Eye Twisters is all about ambigrams--words that are...

Milap 2008

The Indian Cultural Society of greater Lansing (ICS) held its annual cultural program Milap 2008 this past Saturday. It was a great program with traditional and Bollywood dances, songs, and other performances. My daughter Shreya's dance troup, performed a Kathak dance...

Cheating in a test, why that’s the way to go

I just read this wonderful essay by UCLA professor Peter Nonacs titled: Why I Let My Students Cheat On Their Game Theory Exam. In this essay he describes an experiment he recently conducted in his game theory class. This is what he told his students a week before the...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *