Professional Documents
Culture Documents
A CONCISE INTRODUCTION TO
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 2
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 3
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Mixed Methods
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
New software development approaches, such as Agile Programming and Extreme Programming, have in common the characteristic of putting social and human issues at the center of the development process. Concepts such as social norms, values, beliefs, symbolisms, representations, patterns of behavior, which were looked with suspicion in the past, are considered today as essential to the success of technological projects.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Certainty
Uncertainty
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 12
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
Research begins with rough Ideas that turn slowly into research questions.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
Research begins with rough Ideas that turn slowly into research questions. The Literature Review gradually builds up knowledge about the research ideas.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
Research begins with rough Ideas that turn slowly into research questions. The Literature Review gradually builds up knowledge about the research ideas. The Design is the plan to be followed in order to carry out the research. It must include strategies for the selection of the samples.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
Research begins with rough Ideas that turn slowly into research questions. The Literature Review gradually builds up knowledge about the research ideas. The Design is the plan to be followed in order to carry out the research. It must include strategies for the selection of the samples. The Data Collection and Organization phase is devoted to gathering the data for the research and organizing it, so that it can be properly analyzed. These are difficult tasks, since the volume of data collected in qualitative research can be enormous.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 17
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
The Analysis includes three concurrent flows of action: Data Reduction, which focuses, simplifies, and transforms raw data into more manageable forms; Data Display, which presents the data as organized and compressed assemblies of information that permit conclusions to be analytically drawn; and Conclusions & Verification, where the researchers review and finalize all their conclusions and make sure that they satisfy the requirements of validity.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 18
Ideas
Literature Review
Design
Data Collection
Analysis
Dissemination
Dissemination takes the form of very well written and detailed documents, so that other researchers can evaluate the analysis and conclusions obtained and decide if they trust the results and want to use them to feed their own research.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 20
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Case studies are the most common kind of qualitative method used in Information Sciences and Technologies research.
They let us study a phenomenon in its real context, specially when the boundaries between phenomenon and context are not clear. Typically, the researcher studies a case or variety of cases of real-world organizations where information sciences and technologies are being used and concludes about its impacts on the organizational context. Case studies can also be used for quantitative research, in which case they tend to follow a positivist approach. One of the best known books on case studies (Yin, 1994) corresponds to this option. Other authors, on the contrary, take constructivist and interpretivist approaches.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Ethnographic research is inspired by the practices of cultural and social anthropology, where the researcher integrates for a period of time the community where the study is taking place.
This practice is common, not just in Information Sciences and Technologies research, but also in Human-Computer Interaction, in projects that try to understand the behavior of the users, so that better interfaces can be developed. It is also being used to understand the behavior of Software Engineering teams (namely large, complex, distributed, and multinational teams) and improve their performance. The approach is very common when developing and assessing information systems. E.g., to understand how the 4200 workers of a company react to the setting up of an CRM solution so as to improve that solution and make sure that future solutions do not suffer from similar problems.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Grounded Theory is a research approach proposed the sociologists Barney Glaser and Anselm Strauss, who claim that research should depart from the ground. The researcher categorizes empirically collected data in order to build a general theory that fits the data. In essence, it is based on the generation of theory from data. This approach radically defies the traditional positivist approaches, which claim that the researcher must depart from a theory, establish hypotheses that conform to the theory, and than get to the field to confirm the hypotheses in light of the theory.
The models developed by using Grounded Theory are quite distinctive from the traditional ones in that they reveal a strong foundation on the concrete.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Action-Research is today one of the more promising qualitative research approaches in Information Sciences and Technologies research. In essence, it consists of repeatedly going through the cycle: Planning => Action => Reflection We start by making a plan of our action in a crude first approximation, we act following that plan, and we then reflect on the results obtained. From this reflection, we correct our previous plan, act in agreement with the new plan, and reflect on the results we have now obtained. The cycles go on, repeatedly, until we are happy with the results.
Action-research corresponds to what John Dewey called the Principle of Intelligent Action.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Design-based Research is a research method where knowledge is built in successive approximations while designing, building, and evaluating an artifact. The artifact may be almost anything: a piece of equipment, a software application, the solution to a social or technical problem, a theoretical framework, or even a whole theory.
In essence, it consists of repeatedly going through the cycle: Awareness of Problem => Suggestion => Development => Evaluation => Conclusion The successive improvements introduced in the artifact as it is put to test represent opportunities for consolidating the knowledge that emerges from its design and application.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 27
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Document Analysis covers a broad range of techniques devoted to the analysis and interpretation of the documents used as primary data sources.
The term document is understood very broadly, including not just texts, but also sound, photos, videos, and any materials that carry relevant messages. Typical varieties of document analysis include: Conversational Analysis Discourse Analysis Narrative Analysis Objective Hermeneutics
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Interviews are used to collect data from the subjects interactively, usually one-on-one. They are time consuming, but they are more flexible and adaptable than surveys. They can present various levels of structure: structured interviews semi-structured interviews unstructured interviews They are particularly useful to clarify the meaning of a phenomenon to the subjects and to obtain personal accounts about the development of a process in which the subjects are engaged. They are also useful to support the exploratory work that precedes a quantitative study and to clarify and enrich the results of quantitative studies.
When many people are interviewed simultaneously and participants are free to interact with each other, we talk about focus groups.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
In participant observation the researchers observe firsthand the activities of the subjects under study and collect data from this observation.
There are two basic forms of participant observation: overt covert
The technique works well when the activities observed are frequent, the groups observed are small, and there is little risk of disturbing the subjects. It is a time consuming technique, but it is generally more accurate than post-hoc self-reporting.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
In surveys the subjects complete a survey form without the intervention of the researcher. Surveys are particularly useful when the subject population is large (or distributed geographically), majority opinions are sought, and the subjects are motivated to respond. Surveys can include closed and open questions, but the number of open questions should be reduced to a minimum.
Special care must be taken to minimize the length of the survey, manage the choice of words and terminology, look after the balance of its structure, fully plan the strategies for its subsequent analysis, and test-pilot it thoroughly.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 33
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 35
research ideas
research findings
Research Process
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
research ideas
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
research findings
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
research findings
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
1. QUANTITATIVE vs QUALITATIVE METHODS 2. A TYPICAL QUALITATIVE RESEARCH APPROACH 3. QUALITATIVE RESEARCH METHODS 4. DATA COLLECTION TECHNIQUES 5. DATA ANALYSIS TECHNIQUES: CODING 6. TRIANGULATION AND MIXED METHODS RESEARCH 7. RELIABILITY AND VALIDITY
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 42
The inclusive trend, which argues that the credibility of qualitative research can only be widely accepted if the language of mainstream (quantitative) research is maintained, although operationalized to meet the new conditions and circumstances.
(Yin, 1994; Morse, Barret, Mayan, Olson, & Spiers, 2002, Creswell, 2009)
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Confirmability demonstrates that the inquiry is free of bias, values and prejudice, i.e. that the data interpretations and outcomes are rooted in contexts and persons apart from the researcher and are not mere products of the researchers imagination.
The researcher must document the procedures, so that others can check and recheck the data throughout the study. Techniques that may be used to strengthen confirmability include: prolonged engagement, persistent observation, peer debriefing, negative case analysis; and triangulation. After the study, a data audit or external audit should be conducted by a researcher not involved in the research process, to examine both the process and product of the research study.
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010 Research Methods 2009/2010 Slide 46
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
Gibbs (2007) suggests several reliability procedures: Checking transcripts for mistakes Check the persistence of the meaning of the codes Coordinate communication among coders Cross-check codes developed by different researchers
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010
REFERENCES: Berg, B. L. (2007). Qualitative Research Methods for the Social Sciences (6th Ed.). Pearson Education. Boehm, B.W. (1981). Software Engineering Economics. Englewood Cliffs, N.J.: Prentice-Hall. Creswell, J. W. (2007). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (3rd Ed.), Sage. Gibbs, G. R. (2007). Analyzing Qualitative Data. In U. Flick (Ed.). The Sage Qualitative Research Kit. Sage. Guba, E. G. (1981). Criteria for assessing the trustworthiness of naturalistic inquiries, Educational Communication and Technology Journal, 29 (2), 75-91. Guba, E. G., & Lincoln, Y. S. (1981). Effective evaluation: Improving the usefulness of evaluation results through responsive and naturalistic approaches. San Francisco, CA: Jossey-Bass. Guba, E. G., & Lincoln, Y. S. (1982). Epistemological and methodological bases of naturalistic inquiry. Educational Communication and Technology Journal, 30 (4), 233-252. Guba, E. G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Newbury Park, CA: Sage. Morse, J. M., Barret, M., Mayan, M., Olson, K., & Spiers, J. (2002). Verification strategies for establishing reliability and validity in qualitative research. International Journal of Qualitative Methods, 1(2), 1-19. Morse, J. M. (2003). Principles of Mixed Methods and Multimethod Research Design. In Tashakkori, A, & Teddlie, C. (Eds.). Handbook of Mixed Methods in Social and Behavioral Research. Sage. 189-208. Yin, R. K. (1994). Case Study Research: Design and Methods (2nd Ed.). Sage Yin, R. K. (2003). Case Study Research: Design and Methods (3rd Ed.). Sage
University of Coimbra, Ph.D. in Information Sciences & Technologies A. Dias de Figueiredo, 2010