ADTED 531 Unit 10 - Reflections

Continuing on this week's discussion of Evaluation Objectives, I'd like to provide a review of the following article, which deals with trying to develop and measure the effectiveness of an instructional design model or process.

Richey, R., and Klein, J. (2005). Developmental research methods: creating knowledge from instructional design and development practice. Journal of Computing in Higher Education. 16 (2), 23-38. Retrieved from: http://ezaccess.libraries.psu.edu/login?url=http://proquest.umi.com.ezaccess.libraries.psu.edu/pqdweb?did=2164864051&sid=9&Fmt=6&clientId=9874&RQT=309&VName=PQD

This article is “a discussion of establishing the credibility of a given developmental study by assuring authenticity and methodological precision.” In short, it’s a study on how to study the development of an instructional design model or process. There are often many ways in which one could study or quantify the results of a particular educational design or intervention, so this article helps to examine and identify how to choose amongst them.

The first step in developmental research methods discussed in the article is to focus the research problem on only ONE particular aspect of the design, development, or evaluation process, rather than focusing on a variable that might impact learning. Also, one must determine whether the research will be collected as the development occurs, or after the fact. Then, we must frame our specific research questions, and identify what limitations we will have in our data. Then, we proceed with normal research methods – review the literature, identify the target population, and decide on a research methodology. There is a great discussion of the types of research methodology used in developmental studies, and an equally detailed description of how to collect and analyze the data. Both review specific case examples, which might help a student to design their own study.

I would recommend this article as an introductory reading assignment to anyone new to designing and developing research studies to measure any aspect of instructional design. There is in particular a very useful table on page 31 (page 9 in the PDF document) that details Common Research Methods Employed in Developmental Research Studies, which highlights typical methodology patterns used in developmental studies and can provide great direction for anyone needing some ideas on how best to design a research study.