The assigned articles focused on 4 major types of research that is currently conducted in Instructional Technology-Design Research, quantitative, qualitative and mixed methods research. Reeves, Herrington, and Oliver (2005) presented an argument for the use of Design Research in education and specifically in Instructional Technology. They described Design Research as research that is focused “on broad-based, complex problems critical to higher education.” They further state that known and hypothetical design principles should be integrated with technological resources to provide solutions to these problems. In addition, Design Research should involve rigorous inquiry that seeks to design and refine effective innovative learning environments. This type of research demands a long term commitment to revising and refining research questions and designs. It is necessary for researchers and practitioners to collaborate in this process that addresses solving real world problems. Design Research can incorporate a combination of quantitative and qualitative methods to ascertain the effectiveness of the innovations being studied. Therefore the authors appear to be supporting the mixed methods approach advocated by Johnson and Onwuegbuzie.
The advantage of Design Research is that it advocates the importance of carefully looking at instructional design rather than merely examining the mode of delivery of instruction. I strongly feel that if the lesson is not effectively designed to stimulate student interest and accomplishment that it doesn’t matter whether technology is employed or not.
Quantitative research is described by Johnson and Onwuegbuzie as focusing on “deduction, confirmation, theory/hypothesis testing, explanation, prediction, standardized data collection and statistical analysis. Since my background is in science this is the type of research that I am most familiar with because it is widely utilized in my field. The advantage of quantitative research is that it can test and validate a theory or hypothesis. The data that is collected can be used to support or refute a particular way of doing things. If the population is selected appropriately the results of the study can be generalized to other similar populations and the results may have predictive value. Another advantage of quantitative research is that it can be designed in such a way so to eliminate influences of other variables and the bias of the researchers. Furthermore often quantitative research because it deals in hard numbers is often more credible to those who are instrumental in making decisions and providing funding.
The disadvantages of quantitative research lie in the fact that it may overlook other things that are occurring in its emphasis on hypothesis testing. Another disadvantage is that the parameters that are being tested by the researcher may not be relevant in other situations. As stated by Johnson and Onwuegbuzie, the ”knowledge produced may be too abstract and general for direct application to specific local situations, contexts, and individuals.” In other words quantitative research may show that a specific instructional method is effective with inner city children. These results may not be applicable at all in rural Montana because the environment is so radically different.
Qualitative research on the other hand relies on “induction, discovery, theory/hypothesis generation,……..and qualitative analysis.” The researcher, not a quantitative instrument is the data collector. As such the researcher is able to generate new ideas and explanations throughout the course of the research. The advantage of this is that it allows for more interpretation of results based on specific occurrences in the research setting. The researcher is able to observe phenomenon and deduce rationale for events based on the specific research setting. These observations allow the researcher to make changes throughout the course of the study. While this method clearly has he advantage of adaptability it makes it difficult to generalize findings to other settings. Another disadvantage of qualitative research is that it takes more time to gather and analyze data. Since the researcher is the primary instrument of data gathering it is open to the bias of this individual. Therefore some would say that qualitative research has less credibility than quantitative research.
Mixed research is advocated by Johnson and Onwuegbuzie as a combination of quantitative and qualitative methods in a manner that best suits the research question. The benefit of this combination lies in the fact that one method may be able to uncover what the other cannot. Using both methods can reveal more information in the study of the research problem. For example a combination of qualitative and quantitative methods may be able to demonstrate what occurs when a specific instructional method is applied as well as why this change is seen and how the participants react to the method and/or change.
The disadvantage of mixed research is that it may be difficult for the researcher to effectively conduct both forms of study due to the nature of their training and philosophy. Therefore it will be necessary to employ a research team to apply mixed methods resulting in more time and expense in conducting the study.
In my area of study I can definitely see the benefits of Design Research and mixed methods. I am interested in the impact of PBL on increasing learning and critical thinking in undergraduate health science/nursing students. I am also interested in how technology may be utilized to enhance he PBL experience for these students. Therefore it seems to me that there are a number of things that would be important to discover in this quest. First it would be necessary to determine how the design of the PBL experience affects student learning. Can this form of inquiry based learning actually improve the students’ ability to transfer information to a real world situation and how does it need to be designed to do so? Does using technology in the design enhance the learning experience for the student? I am also interested in determining the quantitative affect that this type of instruction would have on student learning? Do test scores actually improve because of the learning design? Are students more motivated to “learn deeply” because of the learning design? As a novice in these areas, I believe that the answers to these questions lie in collecting both quantitative and qualitative data.