How not to conduct research

by | Tuesday, July 23, 2013

Note: This post has been edited somewhat to (a) clearly hide the url, which I had not done a good job of before; and (b) to add a few suggestions in the last paragraph for some strategies to make it easier for the participants to take part in the study.  (September 18, 2013).

There are many pitfalls one can face while engaged in conducting research with humans. For instance, if you are designing a survey it is important to make it easy for participants to actually complete it. Matt Koehler pointed out to me one person who just got it totally wrong.

Here is a flyer, recruiting participants for a study on college students’ use of social media, that has been posted near the elevators here at Erickson Hall.

surveyWhat stands out (to both Matt and me) was the fact that the student (name blurred) running the study had included an URL for the survey in the flyer itself. Here it is in greater detail (with some details blurred).

socialmediastudy

Now think for a moment what this student was expecting users to do. They needed to memorize or write down the complicated address (http://blahblah.qualtrics.com/SE/?SID=PQ_HLpCqrqC45nn) and go back to their office or computer and then type this sequence of letters in and then participate in the survey. Just how many people would be willing to do this? Imagine actually going through the process and making just one mistake in typing out that crazy list of characters and getting to a “404 Not Found page!”

It would have to be someone highly motivated to help you with you research to go through all this.. and frankly nobody I know is that motivated.

Now, designing your research instrument (in this case a survey) is just half (an important half but just half none-the-less) of the research enterprise. The end goal is ending up with data that you can then analyze to answer the research questions you started with. The approach shown here just about ensures that you will not have any data in hand to test your hypotheses or theory!

There many-many ways this process can be made easier for the participants—and I do hope the student researcher is also looking into these alternative methods. A few ways could be to (a) take advantage of social media itself to contact participants; (b) a mass emailing to MSU students with the link embedded; or (c) just go ahead and buy a simple domain name that would be easy to remember. A register.com search shows that msusocialmedia.com is available, as is msusocialmediastudy.com! The current approach, quite surely, will not work!

Topics related to this post: Essay

A few randomly selected blog posts…

CEP818: First note

The following note just went out to all the students signed up for CEP818, Creativity in Teaching and Learning (Fall semester 2011).  We hope you have had a great summer are ready to get back to school! We (Punya Mishra & Kristen Kereluik) will be your instructors...

Drawing with Circles: Vibe coding the Fourier Transformation

Drawing with Circles: Vibe coding the Fourier Transformation

In my presentations I sometimes talk about my four years in engineering school as being something of a disaster. The way I present this fact is through this image, and the math/science types get the pun - Four Year / Fourier Transformation! A slide I typically use in...

The distance education revolution

TCRecord this week features an article by Gary Natriello titled Modest Changes, Revolutionary Possibilities: Distance Learning and the Future of Education. As the abstract says In this essay, I take stock of the developments shaping distance learning and consider the...

Introducing David Pogue

Introducing David Pogue

My college (The Mary Lou Fulton Teachers College) was one of the sponsors of the Arizona School Board Association Annual Conference. As a part of this, we got the privilege to introduce and have lunch with the keynote speaker. As it turns out the keynote speaker...

Walking away from Happy Valley

I have been haunted the past week or so with the scandal enveloping Penn State. Much as been written about it already - and I really have nothing fundamentally new to offer to this discussion. What I did want to share was a parallel that struck me recently about these...

TPACK @ Henrico

The Innovative Educator had a recent post about how the "Henrico County School system has adopted TPACK as the Framework for professional development and 21st Century Learning." Read the complete story Using TPACK as a Framework for Tech PD, Integration and...

EduSummIT 2015: Summary Report

EDUsummIT 2015 (International Summit on ICT in Education) is a global knowledge building community of researchers, educational practitioners, and policy makers committed to supporting the effective integration of research and practice in the field of ICT in...

Of Three Minds

Of Three Minds

I was of three minds,Like a treeIn which there are three blackbirds.—Wallace Stevens, "Thirteen Ways of Looking at a Blackbird" I thought of Stevens's three minds earlier today when I looked at my calendar for the upcoming week. That’s what I usually do on Sundays,...

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *