Technology & research

by | Wednesday, February 20, 2008

Patrick Dickson just forwarded an article in the APA Monitor titled Beyond chalk and talk, in which Art Graesser, the new editor of Journal of Educational Psychology, indicates an openness to including more technology related articles in JEP. Patrick argued that this means that JEP could be a good site for future publications by faculty and graduate students in educational technology. I am not so sure.

The article begins as follows:

Millions of children and adults play video games each day—in fact, video game design is the fastest growing U.S. industry. And while many video games are pure entertainment, others, such as the popular America’s Army, are teaching content to gamers of all ages, which makes incoming Journal of Educational Psychology (JEP) editor Art Graesser, PhD, wonder: Why isn’t education more plugged into gaming?

It goes on to argue that JEP would be more open to articles on technology and education.

The problem it seems to me is not that there isn’t research on the role of technology in education but rather that the field of educational psychology needs to rethink how it defines research in the field. Is it true that education is not plugged into gaming? I don’t think so. It is just that there haven’t been many articles in JEP about gaming. But that is not the fault of gamers and educational technologists. Not at all.

For the most part, a classic ed psy study takes a couple of years from conceptualization to implementation to analysis to manuscript – and then a year or so by the time it goes through reviews and revisions till final publication. Given the rapid rate of change in technology, this means that a publication is out of date by the time it reaches readers. By this time, the technology being studied is most probably out of date. In the fast changing world of educational technology, this is a problem.

Moreover, the demands of experimental rigor (often required for journals such as JEP) frequently mean that studies that make the cut are narrow in focus, or based on well funded research projects geared around developing specific software programs that have a tight and specific pedagogical role. This is all very good, but it seems to me that most of the action in the field of educational technology is happening not in large, funded projects bent upon developing new tools, but rather in generic, all purpose, maybe even free, software tools that can easily be used by teachers.

Think a moment about how many multi-million dollar federally funded projects have ever lasted beyond the expiry of the grant. (Do a search on website to see for yourself.) In contrast, the US Department of Education funded PT3 projects, with much looser guidelines about what constitutes research, have had a greater impact on teacher education programs and technology integration than any of these research-based grants. Now this is not to knock these research projects (clearly they play an important role in showing us what is possible) but rather to say that the matter of not enough educational technology research is a complex problem and not one that can be solved by more “classic” ed psy research.

Imagine conducting a rigorous study on the value of blogging on student writing. By the time you conduct the study, blogging itself may be less relevant technology. And more importantly, in conducting the research you would have lost opportunities to actually work with teachers and students and deepening your understanding of what benefits it may have. I have always used the example of Hypercard, a technology that was huge back in the early 90’s. Hundreds of studies were conducted and published about the educational uses of Hypercard. None of those studies mean anything much today. Such is the nature of technology.

However, if these studies had focused on broader issues of design and how one develops tools for learning, the situation would not be as bad. These “process” studies would still be informative – since issues of design (of what I have elsewhere called the act of going from “thought to thing”) are still important today. However, such a process study would not be published by JEP.

As an aside, I should add that it was this very reasoning that made me include a chapter on design in my dissertation back when I was developing a software program to teach about the periodic table of elements. My gut instincts were on the mark. A chapter that I published about the design process, still seems relevant today. The software I developed does not work any more since one of the plugins that it needed no longer exists today!

I would argue is what we need is not more journal articles but rather a new paradigm of research. A paradigm that is sensitive to the fact that we live in a new world, a world where things change fast and that research and its dissemination needs to reflect this.

To be blunt, JEP as a journal is not very relevant to educational technology researchers. I learn more about educational technology by following blogs and the websites than through any educational journal. Frankly, it seems to me that the main reason articles are published in many of these journals is to help academics get tenure. And over time this influence these journals have will wither away. That won’t happen anytime soon, but I know that there will come a day when some faculty member will receive tenure for maintaining an influential blog…

Of course, JEP and other journals of its ilk, could change. Clearly JEP has a superior brand name that it can leverage in this world of the Internet, but it will need moving away from a commercial publishing model to something else… exactly what it will be I am not sure of but there are some interesting opportunities here, if someone is willing to step up. However, I am not confident that this will happen anytime soon. I have blogged about a recent initiative here and here.

* Illustration constructed by Punya Mishra from images available here and here. Cartoon from here and Ed-Psy ambigram by Punya Mishra.

Topics related to this post: Learning | Psychology | Publications | Technology | Worth Reading

A few randomly selected blog posts…

Seeing mathematics everywhere…

Dame Kathleen Ollernshaw was deaf since the age of 8. Despite this she had an amazing life as a mathematician, amateur astronomer, politician (she served as mayor of Manchester as well as in the Thatcher administration) and mother. To learn more about her read this...

Contruction (sic)

Check out this page of examples of bad design. Some of these look too crazy to be true - but who knows... stranger things have happened. Interestingly enough the title of the page is "Award winning contructions!" I wonder if that is deliberate. Site worth sharing with...

Creativity @ Plymouth, year 3

I spent some time last week with each of the MAET cohorts at Plymouth England. I have blogged about my time with Year 1 here and Year 2 here (as well as some other posts here and here). This is about what I did with the Year 3 cohort. As usual, I did my TPACK and...

Thanks Wipro & Microsoft

#MSUrbanSTEM Thanks Wipro! #MSUrbanSTEM Thanks Microsoft Over this past summer I have had one of the best teaching/learning experiences of my career. Through a project funded by Wipro (and with support from Microsoft) we have the opportunity to work with 125 teachers...

eduPUNKing a course website!!

I had written about the EduPunk movement earlier, in fact had even designed a logo for it. A brief description of Edupunk can be found on Wikipedia (a google search will reveal many more). Wikipedia describes it as follows: Edupunk is an approach to teaching and...

TPACK underpins Aussie Teacher Ed Restructuring

Dr. Matthew Kearney (who was featured in my recent post on student constructed iVideos) just wrote to inform me about a teacher preparation project currently underway in Australia. The Teaching Teachers for the Future (TTF) project is a $7.8 million project ... aimed...

On merging with our technologies (Unpacking McLuhan 4/3)

On merging with our technologies (Unpacking McLuhan 4/3)

This is the fourth of what was supposed to be a three post-series about how media influence our thinking. The first post, uses the invention of writing and print to unpack the meaning of McLuhan’s statement, “The medium is the message.” The second post, focuses on a...

Dirkin, Mishra & Altermatt (2005)

Dirkin, H. K., Mishra, P., & Altermatt, E. (2005). All or nothing: Levels of sociability of a pedagogical software agent and its impact on student perceptions and learning. Journal Educational Multimedia and Hypermedia. 14(2), 113-127. Abstract: This article...

Engineering Education, past & future II

A couple of weeks ago I made a presentation (with Neeraj Buch) to a group of engineering educators from India. This was a meeting organized by the College of Engineering and the Indo-US Collaboration for Engineering Education. Having made this presentation once I had...


  1. azlio

    Your recent initiative on your post about “breaking free of academic publishers” is very great. I salute to you.

  2. Dr. Matthew J. Koehler

    Good post, and for the most part I do agree. Although, I do think that being open to educational technology studies is a good thing, and a step in the right direction. I think skepticism is warranted.

    For example, an example of a study that would be ideally suited for JEP would be the one conducted by the National Center for Education Evaluation and Regional Assistance called Effectiveness of Reading and Mathematics Software Products: Findings from the First Student Cohort,” (Dynarski et al., 2007). In fact, this type of research is often disappointing, in that simply making good experimental design leaves out answering the important questions of what individual teachers do with technology, and considering the full interactions of how technology, content matter, and pedagogical approach interact. For a full critique of the study, please see our editorial.

    Another problem with the idea of doing “good experimental design” when it comes to technology research, was best illuminated by my own effort to get published in JEP when I was a graduate student. Armed with a nicely designed hypermedia environment, I tried to study its ability to perhaps impart better understanding to learners. I made the best control group possible, giving other learners videos, and documents about the same material. The Editor at the time called this type of research “disappointing” and a classic example of what was wrong with technology research in that it “compared apples to oranges.” *SIGH* Wasn’t that the point?

    Since then, I published it the Journal of Educational Multimedia and Hypermedia, and have found the Journal of Cognition and Instruction to be a good place to publish high-quality technology research.

    As far as the JEP goes, let’s hope times are changing. I for one will hope for the best but expect the worst.



  1. Dr Matthew J. Koehler » Blog Archive » The Journal of Ed Psych … a good venue for Ed Tech? - [...] Punya Mishra has made a follow up blog entry, indicating his deep skepticism about JEP’s newfound interest in publishing…

Submit a Comment

Your email address will not be published. Required fields are marked *