You are on page 1of 10

Health Communication

ISSN: 1041-0236 (Print) 1532-7027 (Online) Journal homepage: http://www.tandfonline.com/loi/hhth20

Believing in Expertise: How Authors’ Credentials


and Language Use Influence the Credibility of
Online Health Information

Franziska M. Thon & Regina Jucks

To cite this article: Franziska M. Thon & Regina Jucks (2017) Believing in Expertise: How Authors’
Credentials and Language Use Influence the Credibility of Online Health Information, Health
Communication, 32:7, 828-836, DOI: 10.1080/10410236.2016.1172296

To link to this article: https://doi.org/10.1080/10410236.2016.1172296

Published online: 28 Jul 2016.

Submit your article to this journal

Article views: 627

View related articles

View Crossmark data

Citing articles: 3 View citing articles

Full Terms & Conditions of access and use can be found at


http://www.tandfonline.com/action/journalInformation?journalCode=hhth20
HEALTH COMMUNICATION
2017, VOL. 32, NO. 7, 828–836
http://dx.doi.org/10.1080/10410236.2016.1172296

Believing in Expertise: How Authors’ Credentials and Language Use Influence the
Credibility of Online Health Information
Franziska M. Thon and Regina Jucks
Institute of Psychology for Education, University of Muenster

ABSTRACT
Today, many people use the Internet to seek health advice. This study examines how an author’s
expertise is established and how this affects the credibility of his or her online health information. In
a 2 (authors’ credentials: medical vs. nonmedical) × 2 (authors’ language use: technical vs. every day)
within-subjects design, 127 study participants, or “seekers,” judged authors’ expertise, benevolence, and
integrity as well as the credibility of their medical statements. In addition, we assessed seekers’
awareness of their own knowledge and behavior. Results revealed that users consciously rewarded
authors’ credentials and subconsciously punished technical language. Seekers were keenly aware of
authors’ credentials and perceived authors with medical credentials to have a higher level of expertise
and their information to be more credible. Technical language use negatively affected authors’ integrity
and the credibility of their health information, despite seekers being unaware of it. Practical implications
for health communication and implications for future research are outlined.

Introduction can be determined absolutely (e.g., 10 years of special train-


ing) or relatively (e.g., in contrast to laypersons) and refers
The Internet has become a curator of knowledge and a
primarily to top performance (e.g., athletes) or professional
bastion of shared experiences. More than 70% of adults
knowledge (e.g., academic professionals). Nowadays, anyone
rely on the Internet to acquire health information (Fox &
can accumulate a substantial amount of knowledge in the
Duggan, 2013) and solve health-related problems (see
medical field using the Internet (informed patients, Kivits,
Higgins, Sixsmith, Barry, & Domegan, 2011 for a literature
2004). However, the expertise that laypersons can establish
review). Easily available health information on the Internet
significantly differs from that of experts (for the limits of lay
can empower people (e.g., Bass et al., 2006). However, gate-
expertise in medicine, see Prior, 2003). Experts’ knowledge is
keeping mechanisms are often absent, and misinformation
not only deeper, but also differently structured (e.g., Bromme
spreads easily (Lewandowsky, Ecker, Seifert, Schwarz, &
& Jucks, 2001). It is more and more difficult for an individual
Cook, 2012; Metzger, Flanagin, & Zwarun, 2003). As a
to gain in-depth knowledge in more than one area, because
result, seekers of health information (hereinafter referred
knowledge areas are highly complex (Keil, 2010). The increas-
to as “seekers”) need to be wary as to who and what health
ing specialization of knowledge is leading to a greater division
information they trust.
of cognitive labor (see Bromme, Kienhues, & Porsch, 2010;
Trust is defined as the “willingness to be vulnerable to the
Keil, Stein, Webb, Billings, & Rozenblit, 2008). Consequently,
actions of another party” (Mayer, Davis, & Schoorman, 1995,
“people stay laypersons throughout their life regarding most
p. 712) and is the result of the advisor’s perceived trustworthi-
knowledge domains including domains that vitally affect their
ness and seekers’ own propensity to trust. When reading
private and civic life (e.g., health-related questions)” (Bromme
health information, seekers must assess the trustworthiness
& Thomm, 2016, p. 242). This bounded understanding
of their advisors, that is, the ability, benevolence, and integrity
(Bromme & Goldman, 2014) drives laypersons to seek health
of the advisor to provide credible health information (Mayer
advice from others online. Whether an advice giver is con-
et al., 1995). We focus on supposed expertise suggesting
sidered a trustworthy source of health information depends
ability as the determinative factor for trustworthiness in
on the assumption about their specialized knowledge and
online health communication (see also Toma & D’Angelo,
their pertinence for the respective area (e.g., medicine vs.
2015).
architecture; see Bromme & Thomm, 2016; Porsch &
We define expertise as a “group of skills, competencies, and
Bromme, 2010). However, in online health communication,
characteristics that enable a party to have influence within
expertise may be displayed and perceived in various ways.
some specific domain” (Mayer et al., 1995, p. 717). Expertise

CONTACT Franziska M. Thon f.thon@uni-muenster.de University of Muenster, Institute of Psychology for Education, Fliednerstraße 21, 48149 Muenster,
Germany.
© 2017 Taylor & Francis
HEALTH COMMUNICATION 829

How Seekers Perceive Authors’ Expertise in Online Health 2012). Credibility can be defined as trust in the correctness of
Communication information (Matthes & Kohring, 2003). An author’s expertise
is thereby one aspect that may positively affect this judgment.
Credentials as a Cue of Expertise
Various studies show a link between author credentials and
Authors’ expertise can be established through their creden-
higher credibility (e.g., Fogg et al., 2001; Sillence, Briggs,
tials. Expertise can be based on occupation, position, or
Fishwick, & Harris, 2004). Though, studies were based on
experience. Credentials, such as MD for medical doctors,
self-reports by the seekers and focused only on the presence
confirm qualification in a specialized area. Previous studies
or absence of information about author expertise. The current
in online health communication have examined credentials as
study expands upon previous research by experimentally
signs of expertise based on content analyses of existing online
examining the effect of different levels of expertise on cred-
information (e.g., Buis & Carpenter, 2009) or by comparing
ibility. Compared with most studies on credibility focusing on
professional sources with sources not providing any informa-
credentials only, we have added language as a second cue.
tion on their professional background (e.g., Hu & Sundar,
Numerous studies have shown that language has crucial
2010). There is little research on whether seekers regard
effects on the credibility of a message (e.g., Blankenship &
credentials as a means to determine an author’s area of
Holtgraves, 2005). Investigating both cues of expertise at once
expertise for providing health information.
will give important insights into their interplay on how health
information is perceived online.
RQ 1a: Do author credentials conveying a medical qualifica-
Language affects credibility depending on the author’s
tion positively affect perceived expertise of the author?
credentials. Credentials might be more salient and lead to
the expectation of a specific language use. Language expec-
tancy theory (Burgoon & Miller, 1985) describes how a source
Language as a Cue of Expertise can raise expectations toward a specific language use and
Authors’ expertise can be established through their language use. thereby influence judgments of its credibility. People had
Language cues can be highly valid for judging expertise, because “relatively rigid normative expectations of what was ‘appro-
they are hard to manipulate (see Donath, 1999). In a study priate’ or expected communication behavior. Such expecta-
investigating online health-related communication, Toma and tions were not unique to specific communicators, but to
D’Angelo (2015) found that long words helped participants in aggregates of like individuals” (Burgoon, Denning, &
distinguishing laypersons from experts. The authors argue that Roberts, 2002, p. 122). Depending on their social grouping,
long words demonstrate a sophisticated vocabulary and there- people are ascribed a bandwidth of expected and therefore
fore indicate expertise. Although these cues mark cognitive adequate communication behavior. Privileged groups have a
complexity and suggest a high level of education, they do not broader range of expected language use (Burgoon et al., 2002).
provide information on specific expertise. In the current study, Applying the theory to our study, authors’ credentials suggest-
we therefore focus on the technical language used by medical ing that someone is from a privileged group (i.e., a medical
professionals. Medical terms in the German language can be expert) should grant the author a greater bandwidth of ade-
expressed using everyday language (e.g., heart attack/ quate language use (i.e., technical as well as everyday lan-
Herzanfall) and technical language originating from Greek or guage). Authors with nonmedical credentials, by contrast,
Latin (e.g., myocardial infarction/Myokardinfarkt, see Jucks & should be granted a smaller range of expected language use
Paus, 2012). Both expressions are technical in that they are and be perceived as more credible when using everyday lan-
“meaningful entities needed to perform a task in the area of guage adequate for their level of expertise.
expertise” (Bromme, 1996, p. 184, translated). However, techni-
cal terminology may hint at more elaborate and differently RQ 2a: Do seekers judge health information by medical experts
structured knowledge (Jucks & Bromme, 2007; Jucks & Paus, as credible irrespective of the specific language used?
2012). Consequently, laypersons may not only perceive technical
terms as more difficult (Paus & Jucks, 2011), but also attribute RQ 2b: Do seekers judge health information provided by non-
their use to the high medical expertise of the author. medical experts as more credible when using everyday
language?
RQ 1b: Does the use of technical language lead to higher
perceived expertise of the author?

So far, we have discussed how an author’s credentials and The Role of Meta-Cognitive Judgments in Online Health
language use can influence seekers’ determination of the author’s Communication
expertise. These cues are important when seekers draw on them To successfully acquire health information online, seekers
to decide whether the author’s information is credible or not. must activate meta-cognitive processes regarding their own
knowledge and behavior (Mason & Boldrin, 2008). That is,
they need to be aware of how well they know a specific topic
How Seekers Perceive the Credibility of Online Health
(see meta-cognitive calibration, Pieschl, 2009) and monitor
Information
their search process in order to self-regulate knowledge acqui-
Judging the credibility of online health information is one of sition in health communication (see Brown, 1978; Flavell,
the most difficult tasks for laypeople (HLS-EU Consortium, 1979). The skill to accurately assess one’s own knowledge
830 F. M. THON AND R. JUCKS

and behavior is part of health-related self-management and online health communication. We investigate our research
feeds into the established parameters of successful online questions in the context of online health forums, because
health communication (see Sørensen et al., 2012). Hence, they are frequently used for locating health information and
seekers need to judge not only the credibility of the health for their strong influence on seekers’ behavioral intentions
information encountered (“Is this correct information?”), but (Hu & Sundar, 2010). We focused on young and well-edu-
also their own knowledge (“How certain am I that this infor- cated people as they most frequently seek health information
mation is correct?”) and monitor their seeking behavior online (Andreassen et al., 2007; Fox & Duggan, 2013).
(“What information do I base my judgment on?”). This is
especially relevant when seekers encounter potentially erro-
neous information.
Method
Seekers’ Judgments Regarding Their Knowledge Participants
In order to assess people’s accuracy regarding their own
The predominantly student participants were recruited online
knowledge, we need to examine seekers’ actual knowledge
via the faculty e-mailing lists and social network groups at a
(correctness of their credibility judgments) and compare it
large German university and were reimbursed with a 10€
with seekers’ judgment of their knowledge (certainty of their
Internet shop voucher. Only data from participants who com-
own knowledge). Seekers accurately judge their own knowl-
pleted the online experiment were analyzed. In total, 11 par-
edge if they are more certain when they judge health informa-
ticipants were excluded: 4 participants took one or several
tion correctly and less certain when they are wrong (see
longer breaks during the experiment (M = 2.9 h,
Pieschl, 2009).
SD = 2.6 h); 5 were using external research sources (despite
being instructed not to do so); 1 person did not speak suffi-
RQ 3: Does seekers’ correctness of credibility judgment match
cient German; and 1 person had technical problems. In total,
their level of certainty?
we analyzed data from 127 participants (78 females, 49 males)
aged 18 to 53 years (M = 22.64, SD = 4.59). All participants
However, our manipulation of language use may interfere
were native German speakers and well educated. The highest
with these judgments. Everyday language may enhance see-
academic qualifications achieved were PhD (2%), master
kers’ perceived familiarity and access to their own knowledge
(6%), bachelor (15%), university-entrance diploma (76%),
(seduction of easiness, Scharrer, Bromme, Britt, & Stadtler,
and secondary education diploma (2%). Participants were
2012) and therefore affect not only their correctness when
from various disciplines, namely, cultural studies (29%), nat-
judging the credibility of health information, but also their
ural sciences and engineering (26%), economics (16%), law
certainty when doing so. This may be the case, even if seekers
(11%), educational science (10%), and health sciences (11%,
are able to encode only parts of the medical term (e.g., “high,”
including nine participants specialized in the field of
“blood,” and “pressure”; see Jucks & Paus, 2012). Therefore,
medicine).
seekers may be more accurate and feel more certain when
judging health information conveyed in everyday language.

RQ 4: Does everyday language positively influence seekers’


Design and Material
certainty in and correctness of their credibility judgments?
We manipulated authors’ expertise for medical statements in
a 2 (credentials: medical experts vs. experts from a nonme-
Seekers’ Judgments Regarding Their Seeking Behavior dical area) × 2 (language: technical vs. every day) within-
Seekers need to monitor not only their own knowledge, but subjects design. We created a total of 30 statements, one-half
also their seeking behavior. Awareness about how one comes of which were true and one-half of which were false (see
to a credibility judgment is an important requirement for Appendix A). The statements and their classification as true
successful knowledge acquisition. Thus, an additional aim of or false represented the well-established knowledge in the
this research is to assess seekers’ meta-cognitive judgments medical field. We conveyed the experimental manipulation
regarding the information they believe they have based their of the author’s credentials through academic title and the
credibility judgment on (stated basis) and compare it with the area of expertise (e.g., “doctor of medicine, orthopedic” vs.
information they actually based their judgments on (actual “master of science, paleontologist”). We chose surnames
basis). drawn from a list of the 40 most common German sur-
names. No forenames were mentioned to avoid gendering.
RQ 5: To what extent does seekers’ actual basis match the Language was manipulated through word origin. Everyday
stated basis for their judgment? language referred to German language (e.g., heart attack/
Herzanfall), and technical language stemmed from Latin or
While the ability to find accurate information is of impor- Greek (e.g., myocardial infarction/Myokardinfarkt). Note
tance for seekers, establishing credibility is an important skill that, according to the entries in medical dictionaries, all
for scholars in health communication (Hannawa et al., 2014). manipulated words used medical terminology despite their
The current paper advances the understanding of the factors origin. The length of statements ranged between 6 and 18
affecting the establishment of credibility in interpersonal words (M = 11.10, SD = 2.51).
HEALTH COMMUNICATION 831

Procedure on 5-point scales ranging from 1 (strongly disagree) to 5


(strongly agree). The direct and indirect measures of credibil-
The experiment was performed using Enterprise Feedback
ity correlated significantly, r(127) ≥ 0.47, p ≤ 0.001. Due to the
Suite (EFS) Survey© (online survey software) and lasted
small effect sizes, we will analyze both measures separately.
approximately 30 min (M = 31.88 min, SD = 15.45 min).
Participants were informed that they were taking part in a
Correctness of Health Statements
study on health communication and would receive health-
As half of the statements were true and half were false, we
related statements as posted in online forums. In the first
analyzed the proportion of correct judgments in each of the
part of the study, participants received 20 statements in a
four conditions.
randomized order and were asked to judge the credibility of
each statement and to estimate certainty regarding their own
Certainty in Credibility Judgment
decisions. We then asked participants to write about how they
We asked participants to state how certain they were regard-
made their credibility judgments.
ing their credibility judgment on a 7-point scale ranging from
To investigate whether an author’s credentials and lan-
1 (very certain) to 7 (very uncertain).
guage are used as cues of expertise, we used 10 new state-
ments in the second part of the study. This time we asked
Belief about Credibility Judgment
participants to rate the authors’ expertise as well as their
Participants were asked in an open format to report how they
benevolence and integrity to get a comprehensive understand-
made their credibility judgment. The coding scheme was
ing of all three factors of trustworthiness. Moreover, we
developed based on the answers provided. Overall, answers
implemented a manipulation check for language, asking par-
occurred in three main categories: decision-making due to the
ticipants to rate the difficulty of several medical terms.
author’s credentials, the technicality of language used, and
In the third part of the study, participants indicated their
prior knowledge. Inter-rater reliability was sufficiently high
own propensity to trust and their personal demographic data.
in all three categories (0.64 ≤ Cohen’s κ ≥ 0.95).
To avoid medical misconceptions, participants were debriefed
and requested to carefully read corrected versions of the
medical statements. Participants could enter their e-mail Manipulation Check
address to receive reimbursement (this information was
Difficulty of Language
saved separately from experimental data and deleted after
Participants were asked to rate the difficulty of the medical
reimbursement). On the final page, participants were thanked
language. Five items addressed the aspects of perceived tech-
and dismissed.
nicality, complexity, and comprehensibility. However, internal
consistency was below the accepted standards (Cronbach’s
Dependent Variables α = 0.64), thus, we refrain from reporting the collected data.

Authors’ Trustworthiness
We applied the Muenster Epistemic Trustworthiness Control Measures
Inventory (METI; Hendriks, Kienhues, & Bromme, 2015) to Propensity to Trust
assess perceived expertise of the author. In addition, we As mentioned in the introduction, trust is influenced not only
assessed their benevolence and integrity to get the full picture by the expertise of a source, but by people’s own propensity to
on how authors are perceived. Fifteen items rated expertise trust others. Eight items from the revised NEO (Neuroticism,
(e.g., “qualified/unqualified,” Cronbach’s α = 0.90), benevo- Extraversion, Openness) personality inventory of the subscale
lence (e.g., “considerate/inconsiderate,” Cronbach’s α = 0.97), trust (NEO-PI-R: Ostendorf & Angleitner, 2004; see also
and integrity (e.g., “honest/dishonest,” Cronbach’s α = 0.92). Costa & McCrae, 1992) were implemented to assess partici-
All items were rated on 7-point scales ranging from 1 (very pants’ propensity to trust (e.g., “I believe that most people
trustworthy) to 7 (not trustworthy at all). generally have good intentions,” Cronbach’s α = 0.85) on 5-
point scales ranging from 1 (strongly disagree) to 5 (strongly
Credibility of Health Statements agree). Individual scores ranged from 1.38 to 4.88 with an
We deployed two measures of credibility in the study. On the average of M = 3.40 (SD = 0.68). Correlations between pro-
one hand, participants were asked very directly to indicate pensity to trust and the main dependent measures were not
whether the statement was true or false. Based on participants’ significant: credibility, r(127) = 0.05, p = 0.57; correctness, r
responses to all 20 statements, we analyzed the proportion of (127) = −0.02, p = 0.83; and certainty, r(127) = 0.004, p = 0.97.
statements each participant rated as true in each of the four Hence, propensity to trust was dropped from further analyses.
conditions from our 2 × 2 within-subjects design. On the
other hand, we asked participants to more indirectly judge Medical Knowledge
the credibility on four items regarding “trust in the correct- Participants were asked to indicate their medical knowledge on a
ness of information” (Matthes & Kohring, 2003). This mea- scale from 1 (bad) to 5 (good). On average, participants rated their
sure was developed in journalism research, but may provide prior medical knowledge as “medium” (M = 2.81, SD = 1.0).
additional insights due to the more detailed assessment of While some participants rated their medical knowledge as “good”
credibility on a Likert scale. Items (e.g., “The statement (9%) or “rather good” (10%), most participants rated it as “med-
reflects things, as they are,” Cronbach’s α = 0.93) were rated ium” (36%) or “rather bad” (40%). Only 4% of the participants
832 F. M. THON AND R. JUCKS

rated their medical knowledge to be “bad.” These data are also


reflected by the sample characteristics including both people with
and without medical training. Thus, we believe that our sample is
heterogeneous with regard to medical knowledge and training,
and therefore is representative of the general public.

Results
Unless indicated otherwise, we conducted 2 (credentials: med-
ical experts vs. experts from a nonmedical area) × 2 (language:
technical vs. every day) repeated measures analyses of var-
iance (ANOVA). All statistical tests were two tailed, and alpha
was set at 5% except when noted otherwise. For descriptive
results of all quantitative variables, see Appendix B. Figure 1. Percent of credible statements.

Author’s Trustworthiness of technical language, as indicated by a very large and significant


We wanted to find out whether medical credentials and the use main effect of language, F(1, 126) = 46.01, p < 0.001, η2 = 0.27.
of technical language affect perceived author expertise (RQ No further effects were found, all F(1, 126) ≤ 1.66, p ≥ 0.20.
1a + 1b). The analysis for epistemic trustworthiness showed a Overall, the percentage of participants correctly judging the
large and highly significant main effect of author’s credentials medical statements ranged from 25% to 94% per item.
on expertise, F(1, 115) = 93.02, p < 0.001, η2 = 0.45, benevolence
F(1, 115) = 162.59, p < 0.001, η2 = 0.59, and integrity, F(1,
115) = 55.72, p < 0.001, η2 = 0.33. All effects indicated that Certainty in Credibility Judgment
authors with medical credentials were considered as more trust- We examined whether everyday language affected participants’
worthy. Furthermore, we found a medium main effect of lan- certainty in their own decision (RQ 4). The analysis showed that
guage on the subscale integrity, F(1, 115) = 7.45, p = 0.007, participants were more certain in their judgment when state-
η2 = 0.06, indicating that authors’ perceived integrity was higher ments used everyday language, as indicated by a very large and
when using everyday language. highly significant main effect of language, F(1, 126) = 266.17,
p < 0.001, η2 = 0.68. Interestingly, we also found a significant
Credibility of Health Statements medium main effect of credentials, F(1, 126) = 10.73, p = 0.001,
η2 = 0.08, indicating that participants were more certain when
We questioned how an author’s credentials and language the author had medical credentials. No interaction was found, F
use influence the credibility of online health information (1, 126) = 1.02, p = 0.31 (see Figure 2).
(RQ 2a + 2b). The analysis of the direct measure of cred- In addition, we analyzed whether participants’ certainty
ibility showed a large main effect of credentials, F(1, matched the correctness of their answers (RQ 3). Therefore,
126) = 25.75, p < 0.001, η2 = 0.17, indicating that partici- we compared certainty for correct and incorrect answers.
pants found medical authors’ statements to be more credible Overall, we found that certainty for correct answers was sig-
than statements from nonmedical authors. We further nificantly higher (M = 3.27, SD = 0.67) than for incorrect
found a significant main effect of language, F(1, answers (M = 2.72, SD = 0.72), t(108) = 8.79, p < 0.001. To
126) = 8.35, p = 0.01, η2 = 0.06. However, this main effect determine whether the matching was affected by our manip-
was due to the significant disordinal interaction between
credentials and language, F(1, 126) = 7.96, p = 0.01,
η2 = 0.06. Authors with nonmedical credentials were per-
ceived as more credible when using everyday language, t
(126) = 3.7, p < 0.001, whereas language did not affect the
credibility of medical authors (see Figure 1). On the indirect
measure of credibility, we found the same large main effect
of credentials, F(1, 126) = 52.52, p < 0.001, η2 = 0.29, as well
as a large main effect of language, F(1, 126) = 47.73,
p < 0.001, η2 = 0.28, indicating that statements with every-
day language were believed to be more correct. No interac-
tion was found, F(1, 126) = 1.35, p = 0.25.

Correctness of Health Statements


We questioned whether everyday language affected participants’
correctness (RQ 4). Participants were better at detecting whether
a statement was true when everyday language was used instead Figure 2. Certainty of credibility judgments.
HEALTH COMMUNICATION 833

ulation, we conducted separate 2 × 2 repeated measures be signs of expertise that can help seekers determine cred-
analyses for both correct and incorrect responses. Note that ibility in online health communication.
the datasets for the following analyses were smaller, because
participants had to have at least one correct answer and one
Cues of Expertise in Online Health Communication
incorrect answer in each of the four conditions in order to be
included in the data analysis. Both analyses of trust for cor- An author’s credentials are an important cue of expertise in online
rectly and incorrectly answered items showed a highly signif- health communication. As expected (RQ 1a), seekers perceived a
icant main effect of language, F(1, 113) = 132.35 p < 0.001, medical expert as having a greater expertise to give health-related
η2 = 0.54 and F(1, 49) = 75.37, p < 0.001, η2 = 0.61. insights. Interestingly, medical experts were also perceived as
Furthermore, we found a significant main effect of credentials having higher benevolence and integrity. This positive effect
for correct answers, F(1, 113) = 4.73 p = 0.03, η2 = 0.04, and may be due to physician’s requirement to take the Hippocratic
incorrect answers, F(1, 49) = 9.64, p < 0.01, η2 = 0.16. The oath. These results demonstrate that laypeople place high levels of
interaction between language and credentials did not attain trust in traditional cues, as is true in the offline world. However, as
significance in the analysis of either correct or incorrect the famous quote says: “On the Internet, nobody knows that
answers, F(1, 113) = 0.05, p = 0.82 and F(1, 49) = 3.4, you’re a dog” (Steiner, 1993). Anybody can call himself an expert
p = 0.07, respectively. in an online environment. Thus, unverified credentials may be
misleading. Based on our results, we strongly recommend that
online health information websites should make source cues
Belief about Credibility Judgment salient and, if possible, verifiable. Future research should focus
When asked how participants had reached their decision, 82% strongly on the difficult prospect of social verification in online
of participants stated that their prior knowledge had influ- health forums, where control from authorities is impractical.
enced their decision-making. Sixty-five percent mentioned the Contrary to our expectations (RQ 1b), technical language did
author’s credentials. Among these, 39% reported that state- not affect the perception of the author’s expertise. While seekers
ments from authors with medical credentials were more cred- might use complex language to distinguish health advice from
ible. By contrast, only 12% of the participants mentioned that experts and laypersons (Toma & D’Angelo, 2015), the results of
the technicality of language played a role in their decision- our study suggest that the use of technical language in itself will
making. However, only two participants stated a positive link not help authors establish themselves as experts in online health
between technical language and credibility, while the remain- communication. Instead, the results of our study show that
ing participants linked language to their own knowledge. That comprehensibility is key. Authors using everyday language
is, they perceived technical words to be harder to understand, were perceived as having higher integrity. Integrity refers to
leading to greater insecurity in their judgments. being sincere, honest, just, or fair (see Mayer et al., 1995).
Authors can be fair only if the audience is able to understand
their information (see also Clark & Murphy, 1982; Fussell &
Matching of Belief and Actual Basis for Judgment Krauss, 1989). Similarly, terming the positive effect of compre-
hensible language the “seduction of easiness,” Scharrer et al.
We asked to what extent the seekers’ own-stated basis for (2012) emphasized that people’s ability to comprehend informa-
credibility judgment matches the actual basis for their judgment tion will affect their judgment. This leads us to the question of
(RQ 5). A 2 × 2 repeated measures analysis including only how authors’ credentials and language use affected the credibility
participants who mentioned having used credentials showed a of their health information.
significant main effect of credentials on credibility, F(1,
67) = 53.92, p ≤ 0.001, η2 = 0.45, as well as a significant main
effect of language, F(1, 67) = 4.27, p = 0.04, η2 = 0.06, and a The Credibility of Health Information: An Interaction of
significant interaction, F(1, 67) = 5.91, p = 0.02, η2 = 0.08. All Cues
effects indicate the same direction as those including all parti- Seekers strongly believe health information provided by
cipants. By contrast, the analysis of participants who did not experts. Our results showed that seekers judged health infor-
mention credentials as a criterion for credibility judgment mation as more credible when provided by an author with
revealed that their credibility judgments did not differ signifi- medical credentials. As expected (RQ 2a), medical experts
cantly in relation to author credentials, F(1, 58) = 0.08, p = 0.78. were granted a greater range of acceptable communication
However, we did find a significant main effect of language behavior. That is, their health information was judged as
pointing in the same direction, F(1, 58) = 4.03, p = 0.049, credible, regardless of the technicality of language they used.
η2 = 0.07. No interaction was found, F(1, 58) = 2.36, p = 0.13. By contrast, health information from nonmedical experts was
more credible when the authors used everyday language (RQ
2b). These results are in line with the theory of language
Discussion
expectancy (Burgoon & Miller, 1985) in that doctors were
In this paper, we examined people’s perceptions of expertise given license to use technical as well as everyday language.
and credibility when seeking online health information. On the other hand, authors who were not medical profes-
Drawing on the concept of the cognitive division of labor, sionals were judged as not entitled to use technical language.
we outlined that seekers are highly dependent on expert Our results suggest that experts should provide unambiguous
advice. We proposed that credentials and language use could credentials to gain the trust of seekers, especially when using
834 F. M. THON AND R. JUCKS

technical language. Overall, the results of our study point to while the indirect measure gave seekers the possibility to
the positive effect of everyday language in online health com- differentiate between levels of credibility on a scale of one to
munication. Everyday language not only positively affects the five. Although both measures were related, the interaction
author’s integrity, but also enhances the credibility of health between authors’ credentials and language use was limited to
information. Note that the effect of everyday language on the direct measure, and therefore can reflect credibility only
credibility was stronger when seekers judged the credibility under forced decision-making.
on a Likert scale, compared with the dichotomous forced
choice measure. This difference may be due to providing
Conclusion
participants a greater range of responses when applying a
Likert scale measure. Health information seekers consciously viewed credentials to
infer an author’s medical expertise and to judge the credibility
of online health information. By contrast, technical language
Meta-Cognitive Judgments in Online Health
use negatively affected authors’ integrity and the credibility of
Communication
their health information, especially for nonmedical authors.
Seekers’ judgments regarding their own knowledge were fairly While seekers accurately assessed their own medical knowl-
accurate (RQ 3). Seekers’ correctness matched their level of edge, which reflects that seekers monitored their learning
certainty, that is, they were more certain when they judged the process, they deficiently monitored their seeking behavior
credibility of the health information correctly and they were when the cue was less salient (i.e., language use). However,
less certain when they were wrong. These results reflect that the skills to accurately assess one’s knowledge and behavior
participants accurately monitored their learning process. This are important requirements of people’s health-related self-
is an important requirement for successful knowledge acqui- management. Supporting seekers to establish successful self-
sition in health communication. management strategies, including consciously monitoring
As expected, participants were better and more certain in their seeking strategy, is an important future challenge for
judging health information conveyed in everyday language health and education policy, as well as for practitioners.
(RQ 4). This may reflect the ability to better access their Future research should focus on the subconscious impact of
own knowledge. The use of everyday language makes health language in online health communication.
information more comprehensible and enhances seekers’ abil-
ity to judge the validity of the information. Clear comprehen-
sible communication puts the seeker in the best position to Funding
obtain necessary health information. These results may apply This research was supported by a grant awarded to the second author
to health information in other media as well. Thus, we advise within the German Research Foundation’s (DFG) Research Training
Group GRK 1712: Trust and Communication in a Digitized World. We
health information providers to provide easy-to-understand
thank Jonathan Harrow for language editing.
health information and understandable explanations when
using technical terms.
Regarding study participants’ judgment of their own seek- References
ing ability, the results of our study showed that monitoring
Andreassen, H., Bujnowska-Fedak, M., Chronaki, C., Dumitru, R.,
performance depends on the cue (RQ 5). While seekers used Pudule, I., Santana, S., & Wynn, R. (2007). European citizens’ use of
authors’ credentials purposefully and knowingly to determine E-health services: A study of seven countries. BMC Public Health, 7,
health information credibility, their judgment was affected by 53. doi:10.1186/1471-2458-7-53
authors’ language use without being aware of it. In contrast to Bass, S. B., Ruzek, S. B., Gordon, T. F., Fleisher, L., McKeown-Conn, N.,
other cues in online health communication, language use may & Moore, D. (2006). Relationship of Internet health information use
with patient behavior and self-efficacy: Experiences of newly diag-
be less important. Our results not only emphasize the impor- nosed cancer patients who contact the National Cancer Institute’s
tance of language use, but also point to the need for training Cancer Information Service. Journal of Health Communication, 11,
seekers to monitor their own seeking behavior. 219–236. doi:10.1080/10810730500526794
Blankenship, K. L., & Holtgraves, T. (2005). The role of different markers
of linguistic powerlessness in persuasion. Journal of Language & Social
Limitations of the Current Study Psychology, 24, 3–24. doi:10.1177/0261927X04273034
Bromme, R. (1996). Fachbegriffe [Technical terms]. In G. Strube, B.
Since we used clear and unambiguous cues and presented no Becker, C. Freska, U. Hahn, G. Palm, & K. Opwis (Eds.),
distractions, our study might not account for sleeper effects (see Wörterbuch der Kognitionswissenschaft [Dictionary of the cognitive
Eagly & Chaiken, 1993). Although we presented a commonly science] (pp. 184). Stuttgart, Germany: Klett-Cotta.
encountered situation, there was very little distracting informa- Bromme, R., & Goldman, S. R. (2014). The public’s bounded under-
standing of science. Educational Psychologist, 49, 59–69. doi:10.1080/
tion compared with the real-world setting. Several previous stu- 00461520.2014.921572
dies have demonstrated that sources are not always considered or Bromme, R., & Jucks, R. (2001). Wissensdivergenz und Kommunikation:
are even forgotten later on (e.g., Eysenbach & Köhler, 2002). Lernen zwischen Experten und Laien im Netz [Knowledge divergence
These effects could be even more pronounced when people use and communication: Learning between experts and laypersons on the
various online sources to seek health information. net]. In F. W. Hesse & H. F. Friedrich (Eds.), Partizipation und
Interaktion im virtuellen Seminar [Participation and interaction in
We used two measures of credibility, which revealed the virtual seminar] (pp. 81–103). Münster, Germany: Waxmann.
slightly different results. The direct measure forced seekers Bromme, R., Kienhues, D., & Porsch, T. (2010). Who knows what and
to decide whether the given information was correct or not, who can we believe? Epistemological beliefs are beliefs about
HEALTH COMMUNICATION 835

knowledge (mostly) to be attained from others. In L. D. Bendixen & F. Jucks, R., & Bromme, R. (2007). Choice of words in doctor–patient
C. Feucht (Eds.), Personal epistemology in the classroom: Theory, communication: An analysis of health-related internet sites. Health
research, and implications for practice (pp. 163–193). Cambridge, Communication, 21, 267–277. doi:10.1080/10410230701307865
England: Cambridge University Press. doi:10.1017/ Jucks, R., & Paus, E. (2012). What makes a word difficult? Insights into
CBO9780511691904.006 the mental representation of technical terms. Metacognition &
Bromme, R., & Thomm, E. (2016). Knowing who knows: Laypersons’ Learning, 7, 91–111. doi:10.1007/s11409-011-9084-6
capabilities to judge experts’ pertinence for science topics. Cognitive Keil, F. C. (2010). The feasibility of folk science. Cognitive Science, 34,
Science, 40, 241–252. doi:10.1111/cogs.12252 826–862. doi:10.1111/j.1551-6709.2010.01108.x
Brown, A. L. (1978). Knowing when, where, and how to remember: A Keil, F. C., Stein, C., Webb, L., Billings, V. D., & Rozenblit, L. (2008).
problem of metacognition. In R. Glaser (Ed.), Advances in instruc- Discerning the division of cognitive labor: An emerging understanding
tional psychology (Vol. 1, pp. 77–165). Hillsdale, NJ: Lawrence of how knowledge is clustered in other minds. Cognitive Science: A
Erlbaum. Multidisciplinary Journal, 32, 259–300. doi:10.1080/03640210701863339
Buis, L. R., & Carpenter, S. (2009). Health and medical blog content and Kivits, J. (2004). Researching the ‘informed patient’. Information,
its relationships with blogger credentials and blog host. Health Communication & Society, 7, 510–530. doi:10.1080/1369118042000305629
Communication, 24, 703–710. doi:10.1080/10410230903264014 Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J.
Burgoon, M., Denning, V. P., & Roberts, L. (2002). Language expectancy (2012). Misinformation and its correction: Continued influence and
theory. In J. P. Dillard & M. Pfau (Eds.), The persuasion handbook: successful debiasing. Psychological Science in the Public Interest, 13,
Developments in theory and practice (pp. 117–136). Thousand Oaks, 106–131. doi:10.1177/1529100612451018
CA: Sage. Mason, L., & Boldrin, A. (2008). Epistemic metacognition in the context
Burgoon, M., & Miller, G. R. (1985). An expectancy interpretation of of information searching on the web. In M. S. Khine (Ed.), Knowing,
language and persuasion. In H. Giles & R. Clair (Eds.), The social and knowledge and beliefs: Epistemological studies across diverse cultures
psychological contexts of language (pp. 199–229). London, England: (pp. 377–404). New York, NY: Springer.
Erlbaum. Matthes, J., & Kohring, M. (2003). Operationalisierung von vertrauen in
Clark, H. H., & Murphy, G. L. (1982). Audience design in meaning and journalismus [Operationalization of trust in journalism]. Medien &
reference. Advances in Psychology, 9, 287–299. Kommunikationswissenschaft, 51, 5–23. doi:10.5771/1615-634x-2003-1-5
Costa, Jr., P. T., & McCrae, R. R. (1992). Revised NEO personality Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995). An integrative
inventory (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) pro- model of organizational trust. Academy of Management Review, 20,
fessional manual. Odessa, FL: Psychological Assessment Resources. 709–734. doi:10.5465/AMR.1995.9508080335
Donath, J. S. (1999). Identity and deception in the virtual community. In Metzger, M. J., Flanagin, A. J., & Zwarun, L. (2003). College student web
M. A. Smith, P. Kollock, & I. Heywood (Eds.), Communities in cyber- use, perceptions of information credibility, and verification behavior.
space (pp. 29–59). London, England: Taylor & Francis. Computers & Education, 41, 271–290. doi:10.1016/s0360-1315(03)
Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Fort 00049-6
Worth, TX: Harcourt Brace Jovanovich. Ostendorf, F., & Angleitner, A. (2004). NEO-PI-R – NEO
Eysenbach, G., & Köhler, C. (2002). How do consumers search for and Persönlichkeitsinventar nach Costa und McCrae - Revidierte Fassung
appraise health information on the World Wide Web? Qualitative (PSYNDEX Tests Review) [Costa and McCrae’s revised NEO person-
study using focus groups, usability tests, and in-depth interviews. ality inventory]. Göttingen, Germany: Hogrefe.
British Medical Journal, 324, 573–577. doi:10.1136/bmj.324.7337.573 Paus, E., & Jucks, R. (2011). Depressive or just in a bad mood?
Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new Laypersons’ assumptions about their knowledge of medical vocabu-
area of cognitive-developmental inquiry. American Psychologist, 34, lary. Studies in Communication Sciences, 11, 51–70.
906–911. doi:10.1037/0003-066X.34.10.906 Pieschl, S. (2009). Metacognitive calibration - an extended conceptuali-
Fogg, B. J., Marshall, J., Laraki, O., Osipovich, A., Varma, C., Fang, N., & zation and potential applications. Metacognition & Learning, 4, 3–31.
. . .Treinen, M. (2001). What makes web sites credible? A report on a doi:10.1007/s11409-008-9030-4
large quantitative study. In M. Beaudouin-Lafon & R. J. Jacob (Eds.), Porsch, T., & Bromme, R. (2010). Which science disciplines are perti-
Proceedings of CHI 2001 (pp. 61–66). Seattle, WA: ACM Press. nent? – Impact of epistemological beliefs on students’ choices. In K.
Fox, S., & Duggan, M. (2013). Health online 2013. Washington, D.C.: Gomez, L. Lyons, & J. Radinsky (Eds.), Learning in the disciplines:
Pew Research Center’s Internet & American Life Project. Proceedings of the 9th International Conference of the Learning
Fussell, S., & Krauss, R. M. (1989). The effects of intended audience on Sciences (Vol. 1, pp. 636–642). Chicago, IL: International Society of
message production and comprehension: Reference in a common the Learning Sciences.
ground framework. Journal of Experimental Social Psychology, 25, Prior, L. (2003). Belief, knowledge and expertise: The emergence of the
203–219. doi:10.1016/0022-1031(89)90019-X lay expert in medical sociology. Sociology of Health & Illness, 25(3),
Hannawa, A. F., Kreps, G. L., Paek, H.-J., Schulz, P. J., Smith, S., & Street, 41–57. doi:10.1111/1467-9566.00339
Jr., R. L. (2014). Emerging issues and future directions of the field of Scharrer, L., Bromme, R., Britt, M. A., & Stadtler, M. (2012). The seduc-
health communication. Health Communication, 29, 955–961. tion of easiness: How science depictions influence laypeople’s reliance
doi:10.1080/10410236.2013.814959 on their own evaluation of scientific information. Learning &
Hendriks, F., Kienhues, D., & Bromme, R. (2015). Measuring laypeople’s Instruction, 22, 231–243. doi:10.1016/j.learninstruc.2011.11.004
trust in experts in a digital age: The muenster epistemic trustworthi- Sillence, E., Briggs, P., Fishwick, L., & Harris, P. (2004). Trust and
ness inventory (METI). PLoS ONE, 10, e0139309. doi:10.1371/journal. mistrust of online health sites. In Proceedings of the SIGCHI
pone.0139309 Conference on Human Factors in Computing Systems (pp. 663–670).
Higgins, O., Sixsmith, J., Barry, M. M., & Domegan, C. (2011). A New York, NY: ACM Press.
literature review on health information-seeking behaviour on the web: Sørensen, K., Van Den Broucke, S., Fullam, J., Doyle, G., Pelikan, J.,
A health consumer and health professional perspective. Stockholm, Slonska, Z., & Brand, H. (2012). Health literacy and public health: A
Sweden: ECDC. doi:10.2900/5788 systematic review and integration of definitions and models. BMC
HLS-EU Consortium. (2012). Comparative report of health literacy in Public Health, 12, 80. doi:10.1186/1471-2458-12-80
eight EU member states. The European Health Literacy Survey HLS- Steiner, P. (1993, July 5). On the Internet, nobody knows you’re a dog
EU. Retrieved from http://www.health-literacy.eu [Cartoon]. The New Yorker, 69, 61.
Hu, Y., & Sundar, S. S. (2010). Effects of online health sources on Toma, C. L., & D’Angelo, J. D. (2015). Tell-tale words: Linguistic cues used
credibility and behavioral intentions. Communication Research, 37, to infer the expertise of online medical advice. Journal of Language &
105–132. doi:10.1177/0093650209351512 Social Psychology, 34, 25–45. doi:10.1177/0261927X14554484
836 F. M. THON AND R. JUCKS

Appendix A
Correct Responses for Medical Statements (Translated From German)

Correct % Correct
Items response responses
In lower back pain/lumbago, everyday movements lead to sudden pain in the upper spine. False 32
Being overweight/obesity can lead to high blood pressure and calcification of the veins and arteries of the heart. True 94
Thyroiditis can be followed by a range of different symptoms, depending on the cause. True 77
Excessive alcohol consumption can lead to high blood sugar levels/hyperglycemia. False 45
People who are heavily overweight suffer more often from breathing arrest/apnea. True 75
High blood pressure/hypertension usually causes discomfort from the very beginning and can therefore be treated at an early False 66
stage.
The most common cause for a runny nose/rhinitis is an acute cold or allergies. True 76
Headaches and pressure in the forehead and cheeks are often mistaken for symptoms of a sinus infection/sinusitis. False 44
The most common symptom of appendicitis is stomachache, especially on the left side of the lower abdomen. False 28
If gout is untreated, it can lead to kidney stones and other kidney damage. True 65
The most important part of reanimation/resuscitation is mouth-to-mouth breathing. False 61
Heart attacks/myocardial infarctions are one of the most common causes of death in industrial societies. True 69
Every stroke/cerebrovascular infarction is an emergency and needs to be treated immediately. True 80
Nose bleeding/epistaxis often results in serious medical conditions. False 69
After contagion, it usually takes only a few days before warts/verrucae develop. False 37
The cause of shingles/herpes zoster is an infection with varicella zoster virus (VZV). True 40
Middle ear inflammation/otitis media is particularly frequent in 6- to 10-year-old children. False 25
Common symptoms of an acute tonsillitis are a sore throat and difficulties in swallowing. True 87
The retina is a highly specialized layer of tissue consisting of neurons interconnected by synapses. True 82
Surgical correction of shortsightedness/myopia is usually performed with lens implants. False 58
Note. Medical language in everyday language before the slash and in technical language after the slash. Note that English does not always have an equivalent for the
German everyday expression.

Appendix B
Descriptive Results of Quantitative Variables

Experimental condition
Medical credentials Nonmedical credentials
Dependent variable Technical language Everyday language Technical language Everyday language
Credibility (of health statements)
Proportion of credible statements 0.70 (0.25) 0.71 (0.23) 0.52 (0.27) 0.64 (0.21)
Trust in the correctness of information 3.00 (0.63) 3.28 (0.71) 2.45 (0.65) 2.82 (0.69)
Correctness (of health statements) 0.53 (0.24) 0.66 (0.22) 0.55 (0.26) 0.70 (0.25)
Certainty (of credibility judgment) 2.62 (0.97) 3.67 (0.67) 2.49 (0.95) 3.45 (0.66)
Trustworthiness (of the author)
Expertise 2.94 (0.83) 2.87 (0.76) 3.79 (0.99) 3.70 (0.88)
Benevolence 2.19 (0.87) 2.29 (0.92) 4.07 (1.53) 4.24 (1.34)
Integrity 2.99 (0.84) 2.89 (0.82) 3.59 (0.92) 3.38 (0.91)

You might also like