How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Design | Good | Bad Design | Learning | Research | Technology

A few randomly selected blog posts…

Representing tensions through photography

Education is always about leadership and leadership has always been about tensions—navigating through them and seeking to find the right balance between them.  Leaders often feel a tug from individuals with conflicting interests or needs, with ideas that often tug in...

Creativity, computers & the human soul

In his article Is Google making us stupid? the author Nicholas Carr takes Sergi Brin to task for something he had said in a 2004  interview with Newsweek. Brin is quoted as saying “Certainly if you had all the world’s information directly attached to your brain, or an...

Update on SITE08 Keynote

A re-edited version of the SITE 2008 Keynote address (by Matt Koehler and me) has been uploaded to the website. You can find the new version here. This presentation depended quite heavily on the exact synching of slide transitions to the audio - and the previous...

TPACK in Science Ed (Video)

Jamie Smith at Ohio University has created a Prezi presentation on TPACK in Science Education. I think it is a pretty good introduction to the topic. Enjoy

Creativity & Teaching, new article in TCRecord

How do exemplary teachers incorporate creativity in their teaching? For her dissertation study, Dr. Danah Henriksen  interviewed several National Teacher of the Year award winners (and finalists), to better understand their beliefs, interests, and practices involving...

Who is god rooting for?

I have often wondered, while watching sports movies, particularly the ritual prayer scene before the big game, as to who is god rooting for? I mean, surely the other team is invoking god as well? So how does god decide? And if one team wins does that mean their god is...

A tangent, a line & a circle, another Math-Poem

A tangent, a line and a circle A math poem Image credit: chrstphre (on Flickr) A point outside a circle, shoots out two lines one heading for the center the other more feline smoothly kisses the curve That delicate swerve of the ball and then, abruptly turns to the...

Celebrating 10 Years of Re-imagining Creativity, Technology & Learning

Celebrating 10 Years of Re-imagining Creativity, Technology & Learning

10 years ago, we, the Deep-Play Research Group (DPRG), were invited to write a series for the journal TechTrends around the broad and intersecting themes of reimagining creativity, technology, and learning. A decade is a significant chunk of time to devote to a series...

Rethinking technology & creativity, now in paper form!

Rethinking technology & creativity, now in paper form!

For the past 4 years, the Deep-Play group has written a series of articles for the journal Tech Trends under the broad rubric of Rethinking Technology & Creativity in the 21st Century. The first article was published in 2014 and we are still going strong....

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *