Validity
The state or quality of being sound, just, & well founded
A quality criterion referring to the degree to which inferences made in a study are accurate + well-founded; in measurement, the degree to which an instrument measures what it is intended to measur
Trustworthiness
The degree of confidence qualitative researchers have in their data + analyses, assessed using the criteria of credibility, transferability, dependability, confirmability, & authenticity
Lincoln & Guba's Framework of Quality Criteria
4 criteria for developing
trustworthiness
of a qualitative inquiry:
1)
Credibility
2)
Dependability
3)
Confirmability
4)
Transferability
These criteria represent parallels to the positivists' criteria of internal validity, reliability, objectivity, & exte
Credibility
Confidence in the truth value of the data & interpretations of them
Involves 2 aspects:
1) Carrying out the study in a way that enhances the believability of the findings
2) Taking steps to
demonstrate
credibility to external readers
Dependability
Refers to the stability (reliability) of data over time + conditions
Question is: Would the study findings be repeated if the inquiry were replicated with the same/similar participants in the same/similar context?
Credibility can't be attained without dep
Confirmability
Refers to objectivity -- the potential for congruence b/w 2 or more independent people about the data's accuracy, relevance, or meaning
Est. that the data & data interpretations aren't just imagined by the inquirer -- the findings must reflect the partici
Transferability
Analogous to generalizability -- the extent to which qualitative findings can be transferred to or have applicability in other settings/groups
It is the investigator's responsibility to provide sufficient descriptive data that consumers can evaluate the a
Authenticity
The extent to which researchers fairly + faithfully show a range of diff. realities -- it conveys the feeling tone of participants' lives as they are lived
A text has authenticity if it invites readers into a vicarious exp. of the lives being described, &
Prolonged Engagement
The investment of sufficient time collecting data to have an in-depth understanding of the culture, language, or views of the people or group under study, to test for misinformation + distortions, & to ensure saturation of imp. categories
It is essential
Persistent Observation
The researchers' focus on the characteristics or aspects of a situation that are relevant to the phenomena being studied
Provides "depth
Reflexivity Strategies
Involves awareness that the researcher as an individual brings to the inquiry a unique background, set of values, & a social + professional identity that can affect the research process
Involves attending continually to the researcher's effect on the coll
Data & Triangulation Methods
Triangulation refers to the use of multiple referents to draw conclusions about what constitutes truth -- it can help capture a more complete, contexualized picture of the phenomenon under study
4 types of triangulation: (but only 2 types are relevant to
Data Triangulation
The use of multiple data sources for the purpose of validating conclusions
3 diff. types:
1)
Time triangulation
- collecting data on the same phenomenon or about the same people at diff. points in times (ex: diff. times of the day or diff. times of the ye
Method Triangulation
Involves using multiple methods of data collection about the same phenomenon
Qualitative researchers often use a rich blend of unstructured data collection methods (ex: interviews, observations, documents) to develop a comprehensive understanding of a phe
Audit Trail
A systematic collection of materials + documentation that would allow an independent auditor to come to conclusions about the data (est.
dependability
)
A trail might include the following:
- the raw data (interview transcripts)
- methodologic, theoretic,
Decision Trail
Articulates the researcher's decision rules for categorizing data & making analytic inferences -- it is a useful way to enhance dependability of the study
Member Check
Researchers give participants feedback about emerging interpretations & then obtain participants' reactions to assess + validate whether the researcher's interpretations are good representations of their realities -- it enhances
credibility
Can be carried
Investigator Triangulation
The use of 2 or more researchers to make data collection, coding, & analytic decisions -- through collaboration, investigators can reduce the possibility of biased decisions + idiosyncratic interpretations
Stepwise replication
- involves having a research
Theory Triangulation
Researchers use competing theories or hypotheses in the analysis + interpretation of their data -- researchers who develop alt. hypotheses while still in the field can test the validity of each bc qualitative studies have flexible designs
Theory triangula
Disconfirming Evidence
Data that challenges a categorization or explanation that has emerged early in the analysis -- the search for this evidence occurs through purposive or theoretical sampling methods
Depends on concurrent data collection + data analysis bc researchers can't
Negative Case Analysis
A process by which researchers revise their interpretations by including cases that appear to disconfirm earlier hypotheses
Goal: to continuously refine a hypothesis/theory until it accounts for ALL cases
Peer Debriefing
Involves sessions with peers to review + explore aspects of the inquiry -- it exposes researchers to the searching questions of others who are exp. in either the methods of constructivist inquiry, the phenomenon being studied, or both
Researchers might pr
Inquiry Audit
Involves a scrutiny of the data + relevant supporting documents by an external reviewer (enhances a study's
dependability + confirmability
)
Once the audit trail materials are assembled, the inquiry auditor proceeds to audit, in a fashion analogous to a f
Thick Description
A rich, thorough, & vivid description of the research context, the people who participated in the study, & the exp. + processes observed during the inquiry
Transferability can't occur unless investigators provide sufficient info. to permit judgments about
Lachrymal Validity
A criterion for evaluating research according to the extent to which the report can wring tears from its readers (don't do this)
Bloodless Findings
When researchers play it safe in writing up the research, reporting the obvious, & failing to apply any inductive analytic spin to the sequence, structure, or form of the findings
Researcher Credibility
Researchers ARE the data collecting instruments, as well as creators of the analytic process, & so their qualifications, exp., & reflexivity are relevant in est. confidence in the data
Trustworthiness is enhanced if the report contains info. about the res
Incubation
The process of LIVING the data, a process in which researchers must try to understand their meanings, find their essential patterns, & draw well-grounded, insightful conclusions
Reflexivity
Researchers' self-awareness & the ability to reflect on their own world view + perspectives