The influence of graphic warning labels on efficacy beliefs and risk perceptions: a qualitative study with low-income, urban smokers
© The Author(s). 2016
Received: 8 October 2015
Accepted: 1 July 2016
Published: 27 July 2016
Health communication theories indicate that messages depicting efficacy and threat might promote behavior change by enhancing individuals’ efficacy beliefs and risk perceptions, but this has received little attention in graphic warning label research. We explored low socioeconomic status (SES) smokers’ perceptions of theory-based graphic warning labels to inform the development of labels to promote smoking cessation.
Twelve graphic warning labels were developed with self-efficacy and response efficacy messages paired with messages portraying high, low, or no threat from smoking. Self-efficacy messages were designed to promote confidence in ability to quit, while response efficacy messages were designed to promote confidence in the ability of the Quitline to aid cessation. From January – February 2014, we conducted in-depth interviews with 25 low SES adult men and women smokers in Baltimore, Maryland, U.S. Participants discussed the labels’ role in their self-efficacy beliefs, response efficacy beliefs about the Quitline, and risk perceptions (including perceived severity of and susceptibility to disease). Data were analyzed through framework analysis, a type of thematic analysis.
Efficacy messages in which participants vicariously experienced the characters’ quit successes were reported as most influential to self-efficacy beliefs. Labels portraying a high threat were reported as most influential to participants’ perceived severity of and susceptibility to smoking risks. Self-efficacy messages alone and paired with high threat were seen as most influential on self-efficacy beliefs. Labels portraying the threat from smoking were most motivational for calling the Quitline, followed by labels showing healthy role models who had successfully quit using the Quitline.
Role model-based efficacy messages might enhance the effectiveness of labels by making smokers’ self-efficacy beliefs about quitting most salient and enhancing the perceived efficacy of the Quitline. Threatening messages play an important role in enhancing risk perceptions, but findings suggest that efficacy messages are also important in the impact of labels on beliefs and motivation. Our findings could aid in the development of labels to address smoking disparities among low SES populations in the U.S.
The implementation of pictorial labels warning about the health consequences of smoking on cigarette packaging, called graphic warning labels, is an important element of global tobacco control policy [1, 2]. Graphic warning labels are more effective than text-only labels at promoting smoking cessation behaviors, including increased calls to a national Quitline and quit attempts [3–5]. They can be a prominent source of health information to promote changes in attitudes, beliefs, knowledge, intentions to quit, and behaviors such as quit attempts [4, 6–10].
Despite the growing evidence of the superior effectiveness of graphic to text-only warning labels, limited research has examined the content of labels that is most persuasive for smokers, other than formatting characteristics such as real photographs versus cartoons [4, 11–15]. Much of the development of label content has relied on fear appeals using vivid depictions of the negative consequences of smoking . Research has shown that fear and other strong negative affective responses (such as worry) to labels are associated with cognitive reactions (e.g., believability), greater risk perceptions, lower desire to smoke, positive feelings towards quitting, intentions to quit, and future self-reported quitting behaviors [9, 16, 17]. Strong emotional reactions are associated with improved memory of labels and increased neurological responses to labels [18, 19]. However, there is considerable variability in how smokers and nonsmokers rate the effectiveness of highly vivid labels . Other researchers have raised concerns that these highly threatening messages may cause a defensive reaction that will continue or increase smoking, particularly among those with low confidence to take protective action [21, 22]. There is need to further study the content of warning labels to determine what elements are most persuasive for cessation and do not lead to defensive reactions.
The application of the extended parallel process model (EPPM) to labels can be highly useful to understand the apparent contradictory findings of highly vivid labels’ effects on smoking behaviors, and to aid in the development of persuasive labels. According to EPPM, labels would be most effective when portraying both a threat that arouses fear as well as the efficacy of a recommended action to mitigate the threat [23, 24]. The threat message—characterized by severity of and susceptibility to a health condition—motivates action through fear. However, the efficacy message—characterized by the effectiveness of the recommended action to reduce risk (response efficacy) and the individual’s ability to perform the action (self-efficacy)—determines whether the individual will engage in fear control behaviors (defined as coping behaviors to reduce fear such as avoidance) or danger control behaviors (defined as adoption of the recommended action). A meta-analysis found an interactive effect between threat and efficacy, such that threat was associated with positive behavior change only when efficacy was high, and vice versa . Indeed, threat with low efficacy may be associated with negative behavioral outcomes, suggesting the importance of efficacy information on labels [21, 25, 26]. A more recent study did not find evidence of this “boomerang” effect of graphic warning labels on quit attempts among smokers with low self-efficacy , but efficacy beliefs appear to have an important moderating effect on reactions to labels and subsequent quit attempts [27, 28].
These studies do not shed light on how labels could be used to increase efficacy beliefs, and thereby enhance the persuasiveness of the message. Few studies have examined the effect of labels on self-efficacy and response efficacy beliefs, and we could find none that used evidence-based theory to develop and explore perceptions of efficacy messages on graphic warning labels. The limited evidence has shown very little impact of existing labels on increasing smokers’ self-efficacy beliefs [17, 26, 29–31]. This might be due to the lack of development of efficacy messages . An experimental study found that graphic warning labels had no effect on changing self-efficacy beliefs compared to text-only labels ; however, the text (“Studies have shown that tobacco can be harder to quit than heroin or cocaine”) might be more likely to decrease self-efficacy than increase it. All warning labels include a Quitline telephone number for cessation help, but limited research has examined the influence of labels on perceived effectiveness for quitting. Waters et al.  found that U.S. adolescent and adult nonsmokers and smokers had low confidence in the efficacy of the Quitline when viewing it on a graphic warning label. Response efficacy messages designed for labels might increase confidence in the Quitline. In sum, our knowledge is limited about the types of messages on graphic warning labels that can promote self-efficacy and response efficacy beliefs to encourage cessation.
Following Bandura’s work , we identified three types of self-efficacy messages for this study: (1) mastery experiences; (2) vicarious experiences; and (3) social persuasion. In mastery experiences, individuals build their self-efficacy by performing a task successfully. These tasks must be attainable and can be small steps on the road to a significant behavior change, but they require perseverance to overcome obstacles in order to build resilient self-efficacy. Although the labels cannot provide that experience directly to smokers, mastery experience labels were designed to suggest small, attainable behaviors in which smokers could engage to help build efficacy, such as delaying smoking. The vicarious experience (or social modeling) approach occurs when individuals see others who are similar to themselves succeed in completing a task through perseverant effort and are rewarded for that effort. Observing modeling increases individuals’ expectations that they can also perform the behavior and will have a positive outcome. Vicarious experience labels were designed to tell the story of a character, such as how a character quit smoking. In social persuasion, individuals are persuaded that they have the skills and capability to perform the behavior through greater, perseverant effort, even in the face of obstacles. Social persuasion labels encouraged the person to exert greater effort towards the goal, such as affirming their power to quit.
Investigating threat and efficacy messages on graphic warning labels might be particularly important among low socioeconomic status (SES) populations given the evidence that these groups are less able to access health information than high SES groups [35–37]. Cultural and literacy factors influence how information is accessed, processed, and used by groups [35, 38]. Graphic warning labels would provide ubiquitous access to health information for smokers who carry cigarette packs, regardless of SES, but the effectiveness of specific content might differ by socioeconomic indicators [11, 39]. Moreover, low SES smokers may perceive that they do not have the resources to quit or would be unable to quit in the face of cognitive barriers such as stress. Labels could provide information to enhance their efficacy to quit and overcome these challenges. This is imperative, given that low SES individuals are more likely to be current smokers and less likely to quit or make a quit attempt [40–43]. To address health equity gaps, further research is needed on low SES smokers’ perceptions of graphic warning labels and their threat and efficacy content.
Our previous qualitative research with this population of low-income, urban smokers found that labels identified as highly motivational influenced risk perceptions, generated affective reactions such as fear and concern, had hopeful messages, or used role models for quitting . This study extends our previous work by looking more specifically at the pathway by which the labels might influence motivation to quit through risk perceptions and efficacy beliefs, guided by EPPM. We look at the threat and efficacy messages of the labels to explore their role in risk perceptions and efficacy beliefs. We developed efficacy messages based on health communication and behavioral theories and explored perceptions of labels with a threat message, an efficacy message, and a threat + efficacy message. Our aim was to examine what types of threat and/or efficacy messages might be the most promising for changing risk perceptions and efficacy beliefs in this high priority population of smokers.
Participants were recruited from a population of current smokers who completed a survey for the Tobacco Influences in the Drug Environment (TIDE) study, which aimed to identify communication channels that promote tobacco use and cessation among low-income smokers in Baltimore, Maryland. TIDE recruitment took place in low-income neighborhoods through street outreach and word-of-mouth by trained staff from the Lighthouse Studies at Peer Point. This population was chosen because of its high smoking prevalence. In Baltimore, smoking prevalence is highest among those with the lowest income (35 %, <$15,000 annual income) and education (34 %, less than college degree) , and smoking prevalence is as high as 58 % in some groups . TIDE inclusion criteria were being 18 years or older, having smoked ≥100 cigarettes in lifetime, and having smoked cigarettes in the past 30 days.
All TIDE participants were eligible for our qualitative study. Participants were chosen using purposive sampling by gender and age group (18–39 and ≥40 years) to capture variations among younger and older smokers as well as among men and women who might have different health concerns. All TIDE participants approached for the qualitative study agreed to participate.
The first author (E.L.M.) conducted in-depth interviews in a private office at the Lighthouse from January to February 2014. The interviews lasted 1–2 h and were audio recorded. Participants were shown 12 graphic warning labels in random order and asked about their cognitive and affective reactions to each label (see Appendix for interview guide). They were then asked to select which labels showed the highest level of harm from smoking (perceived severity), showed a health effect likely to happen to them if they did not quit or made them worry the most about their smoking (perceived susceptibility), made them feel confident that they could quit if they wanted to (self-efficacy belief), and would motivate them to call the Quitline (response efficacy belief). Data on age, gender, race, marital status, education, employment status, income, smoking frequency, and quitting behavior were also collected.
Participants provided written informed consent prior to the interview and were compensated $25. The Johns Hopkins University Bloomberg School of Public Health Institutional Review Board approved the study.
Characteristics of the threat level and efficacy messages on graphic warning labels
Self-efficacy: Vicarious experience
Negative health effects of smoking for smokers
Self-efficacy: Mastery experience
Negative health effects of smoking for smokers
Negative health effects of smoking for smokers
Response efficacy: Quitline’s helpfulness for quitting
Negative health effects of smoking for smokers
Negative health effects of smoking for others
Self-efficacy: Mastery experience
Negative health effects of smoking for others
Response efficacy: Quitting to improve health
Negative health effects of smoking for others
Self-efficacy: Social persuasion
Negative health effects of smoking for others
Response efficacy: Quitting to improve health
Benefits of quitting for smokers
Self-efficacy: Vicarious experience
Benefits of quitting for smokers
Self-efficacy: Social persuasion
Benefits of quitting for others
Response efficacy: Quitline’s helpfulness for quitting
Benefits of quitting for others
Following EPPM , labels were developed with different threat and efficacy messages. The threat message varied on the level of threat portrayed, i.e., high, low, and none. Based on categorization used previously , labels with a vivid picture of the negative effects of smoking were categorized as portraying a high threat level, whereas labels with a nonvivid picture of the negative effects were categorized as low threat. Labels with a picture relating to a positive message about quitting were categorized as no threat. In addition, the threat message varied by the type of health effect (e.g., cancer, secondhand smoke effects). Three types of self-efficacy messages were designed (as described above): mastery experiences, vicarious experiences, and social persuasion. Response efficacy messages addressed the effectiveness of quitting on improving health and calling the Quitline in aiding cessation. Efficacy messages were combined with different threat levels to explore how labels with varying combinations of threat and efficacy influence efficacy beliefs. Labels varied on their portrayal of health effects of smoking to smokers and others and of benefits of quitting for smokers and others .
An initial set of eight labels was developed using the methods and classifications described above. A meeting was held to discuss the labels with staff of the Lighthouse Studies at Peer Point, which is a community-based research center that works with low SES populations with a high burden of injection drug use and HIV . The Lighthouse staff have a significant amount of expertise and experience working with this population, and so their input on the labels was highly valuable as a first step for label development. During the meeting, the staff discussed and compared the labels on the ability to grab attention, how understandable the message was, the layout and design (including the level of threat portrayed), the possible behavioral effects of the labels on the population, and suggested improvements. Using the feedback, 12 labels were revised or developed. They were pilot tested with three participants through in-depth interviews. Based on the results, further revisions were made to pictures and text to enhance clarity and threat and efficacy messages; revised labels were piloted with another two participants. The 12 labels were then finalized.
In Atlas.ti v7, the transcribed interviews were coded by the first author (E.L.M.) with a coding scheme that was developed using a combined deductive and inductive approach with input from two co-authors (J.E.C. and C.E.K.). Analytic memoing was conducted to reflect on emerging themes or issues, including deviant cases. Deviant cases were exceptions to the narrative that were noted and described to test the emerging findings. The framework method was used for analysis of the coded transcripts, which is a thematic analysis using a matrix structure to systematically reduce the data . Following this method, codes were grouped into broader categories to begin the process of data abstraction, such as a category for efficacy-related codes. Next, data were charted into the framework matrix to provide accurate summaries by participant, category, and label. For example, responses were summarized for the codes within the response efficacy category for each participant and label. Broader themes were developed by comparing codes and categories within and across cases with special attention to deviant cases. To enhance rigor and transparency , the data were summarized by case within the matrix, thus keeping the data within the rich context of each case. The matrix structure facilitated the identification of patterns and included references to specific transcript lines to easily ascertain the evidence supporting the themes.
Characteristics of the study population have been reported elsewhere . In brief, the 25 participants were on average 45 years old, 22 were African American, and 13 were women. Most had completed high school/GED (n = 11) or less (n = 12), earned an income < $10,000 during the previous year (n = 16), were retired or unable to work for health reasons (n = 16), and were either single (n = 12) or married/partnered (n = 12). Twenty-three reported smoking every day in the previous 30 days, and 11 reported smoking <1 pack per day. Over half had ever tried to quit, 11 had made ≥1 quit attempts in the previous 12 months, and eight were currently trying to quit.
Reactions to efficacy messages
Participants were asked about their reactions to social persuasion, mastery experience, and vicarious experience self-efficacy messages on the labels (Table 1). Many participants responded favorably to social persuasion messages, designed to persuade individuals that they had the ability to quit. Participants stated these messages were credible and helpful: “[If] you want to be around your kids and stuff, you need to quit. It gives you a lot of hope… I feel good just seeing you’ve got the power to quit, like you can do it. Like saying they did it and they’re happy now” (man, 31 years old). For several participants, the message reminded them of their ability to quit, thus influencing their self-efficacy beliefs. Several other participants reported that these messages were not helpful or credible, citing difficulties in overcoming nicotine addiction.
Most participants reacted negatively to mastery experience messages, designed to suggest small behavioral steps towards cessation that individuals could master to increase their self-efficacy. One main reason was their lack of credibility – they reported that the behavioral step would not be effective for cessation. In addition, participants did not think they had the ability to master the behavioral step and would need additional help; in other words, they had low self-efficacy. For example, when asked about a message suggesting the delay of the day’s first cigarette to facilitate cessation, one woman (46 years old) stated: “No. I don’t think so. I ain’t got that happening… when I get up in the morning I have a cigarette. Then in like a good, I ain’t even going to say a half an hour, probably 15–20 min I go smoke another one.” Several participants stated that the mastery experiences were helpful and they might try the behavioral steps.
Many participants reacted positively to vicarious experience messages, which were designed to tell the stories of characters who quit. Participants reported that the characters’ quit methods would be helpful for quitting, and often added methods, such as removing ashtrays, enforcing smoke-free home policies, and using nicotine replacement therapy. Moreover, they described the characters as role models to admire and emulate: “That one about Michael quitting before he set his quit date, he looks at his quit date and get rid of all his cigarettes. I think I can do that. When I really, really feel like it need to be done which is now, I think I can do it” (man, 47 years old).
However, several participants stated that vicarious experience messages were not helpful because the quit method was ineffective. Underlying this statement for several participants seemed to be a belief that they did not have the ability to use that method successfully, that is, low self-efficacy: “No. I don't think that's true… I generally had to have something to help remove those urges, to stop those urges from being strong… yeah, you ain't just going to just stay busy and stop smoking. That's not going to happen” (woman, 55 years old). This participant not only questioned the validity of the quit method but also her ability to use it without succumbing to her urges. The characters failed to be adequate role models of cessation for several participants.
Reactions to the response efficacy messages about quitting were mixed. One label discussed the efficacy of quitting for improving children’s health. All but one participant stated that the message was true. Although they stated the message was helpful for smokers, many participants discussed the need to stop smoking in front of children, rather than the need to quit all together. The other label discussed the efficacy of quitting on reducing the smoker’s risk of heart attacks and cancer. Most participants stated that they believed the message, particularly about cancer risk. However, doubts were raised about the credibility of reducing their risk of heart attacks and how long it takes for their risk to decrease. Several participants doubted that quitting would improve their health. They discussed other risk factors that they believed to be as or more important than smoking, including diet, physical activity, and being “just prone to these diseases.”
Most participants knew little about the Quitline, such as the services it provides, the cost of the services, and if it is automated. A few participants had previous experience with the Quitline or knew someone who had used it. Two labels discussed the Quitline aiding cessation. Positive and negative reactions about the credibility and helpfulness of the messages were almost evenly split. Reasons for positive reactions included that the Quitline could provide necessary help and support from former smokers, access to free services nearby, and the knowledge that others were able to quit using the Quitline. Participants were not always certain that the Quitline fulfilled these criteria, but reported that it would be helpful if it did. Reasons for negative reactions included that the services provided would not be sufficient for quitting, a desire for face-to-face communication (rather than via telephone), and the Quitline would not help unless the person had a strong desire to quit.
Role in self-efficacy beliefs
Frequency of selection of graphic warning labels for risk perceptions and efficacy beliefs (n = 25)
Quitline response efficacy
Cravings can stop you from quitting… because if you got these strong cravings and you know that you really want it, you ain't going to stop. You ain't going to stop… You got your mind set on quitting but then here comes something else that make you [say], “oh, I need a cigarette” (man, 39 years old).
One participant reported that none of the labels affected her self-efficacy because she already had high self-efficacy.
We also explored how participants’ perceptions might have been influenced by the portrayal of a high threat (i.e., containing vivid pictures), low threat or no threat from smoking-related conditions. When a label contained a self-efficacy message, participants most often reported that labels with no threat, followed by high threat, influenced their self-efficacy beliefs. Participants reported that high threat labels showed the negative effects from smoking and motivated them to quit to avoid those conditions and improve their overall health. In contrast, participants stated that no threat labels showed characters who were role models for quitting and showed the effectiveness of quitting on improving health. They also stated that the labels made them more confident to overcome obstacles to quitting (e.g., cravings) and the self-efficacy text was motivating.
Role in response efficacy beliefs about the quitline
Participants were asked which labels would motivate them to call the Quitline (Table 2). They most often reported being motivated by labels that portrayed the threat of smoking to themselves, including the condition looked severe or “scary”, concern and fear about their own vulnerability to that disease, a desire to avoid the disease, and the credibility of the message.
In addition to threatening labels, one of the labels most frequently identified as motivational for calling the Quitline was the label depicting a happy couple with a response efficacy message about the Quitline and a message about the benefits of quitting for others (label #12). Participants described how the label showed that the Quitline works and gives smokers their best chance to quit. They described how the couple in the picture used the Quitline to quit smoking, and wanted to be happy and healthy like the characters: “Yeah, the Quitline helped make them stronger, and they were able to move on, possibly help others” (man, 44 years old).
Seven participants reported that none of the labels motivated them to call the Quitline. They described how the Quitline would not work for them, they have no need for it, or they did not believe that it has helped others. One participant stated that she does not need it and has sufficient strength to quit on her own. Another woman previously used the Quitline to quit and is planning to use it again; therefore, the labels provided no additional motivation.
Role in risk perceptions
Participants were asked which labels influenced their perceived severity of and susceptibility to smoking-related conditions (Table 2). They most often reported that the labels portraying a high threat influenced their perceived severity of and susceptibility to smoking, followed by low threat labels. Labels depicting a threat to self were more influential than labels depicting a threat to others. All participants perceived high severity from at least one high threat label. The picture was most often the reason for the label’s influence, and other major reasons included negative emotional reactions (e.g., scared, anxious) and the clear provision of information. Some participants reported these labels as influential because they contained new information and because of the potential long-term health outcomes (i.e., diminished quality of life, irreparable physical damage, and death).
Participants reported that high and low threat labels influenced their perceived susceptibility because they were concerned about these conditions and wanted to prevent them, or they perceived high severity of the conditions. Other major reasons stated were that they have, or know someone who has, a similar condition, and the labels stimulated them to contemplate how much physical damage smoking had caused to their bodies: “You wonder how close you is to being like these people. You might don’t even know it” (man, 47 years old). Several participants also selected labels showing conditions that they stated were inevitable if they continued to smoke.
In a notable case, a woman (39 years old) qualified her selections by stating that smoking cigarettes is not the main cause of these conditions. She was the only participant to say that none of the labels made her feel susceptible and to doubt that smoking harms children. Indeed, she often criticized the labels’ credibility and expressed frustration and anger at the perceived misinformation: “It’s all different kind of lung diseases out there and it don’t come from tobacco. So I don’t know where they getting this crap from, but I think they need to redo their research all over again.” She and some other participants described the inevitability of disease even if they quit because of other exposures, such as environmental toxins and secondhand smoke.
Our study explored perceptions of graphic warning labels among adult low-income smokers in Baltimore, MD. Using health communication and behavioral theories [24, 34], we developed several types of efficacy and threat messages and explored the perceived influence of the labels on risk perceptions (perceived severity and susceptibility), self-efficacy beliefs (confidence to quit), and response efficacy beliefs (effectiveness of the Quitline). Our study is novel in its use of behavioral and communication sciences to develop and study graphic warning labels on tobacco packs for a high priority population of smokers.
We found that, when asked which labels influenced their self-efficacy beliefs, low income smokers selected most often labels with efficacy messages and a non-threatening image (i.e., showing the benefits of quitting for self and others), followed by a high-threatening image. Reasons included enhanced feelings of confidence from self-efficacy messages, vivid pictures, and desires to avoid disease and be healthy. This finding illustrates the complex interplay between risk perceptions and efficacy beliefs in the influence of graphic warning labels. Research has shown that, in general, higher threat messages are more persuasive and accepted than lower threat messages only among individuals with high self-efficacy [50, 51]. One study found that labels increased intentions to quit only among smokers with stronger quitting self-efficacy beliefs . Our research is the first to show that theory-driven self-efficacy messages on graphic warning labels, even in the absence of threat, can play a role in low income smokers’ confidence to quit.
Public health practitioners have recommended the development of labels with efficacy messages [32, 52]. While previous studies have found limited impact of labels on efficacy beliefs [4, 26, 29, 30], their findings might be due to the lack of development of theory-driven self-efficacy messages. To fill this gap, we developed three types of self-efficacy messages (i.e., social persuasion, mastery experience, and vicarious experience) and two types of response efficacy messages (i.e., about quitting and the Quitline) and explored reactions to these messages and their role in efficacy beliefs. We found that participants’ self-efficacy beliefs seemed to be most influenced by vicariously experiencing the quit successes and benefits of quitting of the characters pictured on the labels. Mastery experiences appeared to have little or no effect, which might be due to the difficulty of conveying these experiences on a label. According to Bandura, mastery experiences involve actually enacting a behavior and experiencing a successful outcome, not merely observing the behavior of others, which is challenging to portray on a label.
Observing others perform actions and the consequences of those actions is one way that individuals learn, and observing the behaviors of role models in the media can not only teach new skills but also enhance self-efficacy to perform those behaviors . For example, the use of role models has been shown to increase self-efficacy and intentions to perform breast self-examinations , rehabilitation self-efficacy and outcomes following knee surgery , and smoking cessation during pregnancy . Our study is the first in the published literature to suggest that low income smokers might vicariously experience the quit successes and benefits of quitting among characters on graphic warning labels, which might lead to increasing self-efficacy.
Narrative communication, which describes events and characters to promote a particular message, is an effective means to engage the audience in vicariously experiencing characters’ behaviors and outcomes, thus overcoming message resistance and promoting acceptance . However, studies on the use of testimonials on graphic warning labels, which are narratives of real smokers’ experiences with smoking-related conditions, have shown mixed results regarding their perceived effectiveness [4, 15, 20, 47, 57]. Testimonial labels might be most effective among smokers with greater self-efficacy  and low educational attainment . Overall, research on testimonial labels is limited because it only examined individuals suffering from smoking-related conditions, rather than their quit successes. Our study shows that low income smokers also vicariously experience characters’ quit successes, which might be an important pathway for labels to enhance quitting self-efficacy. However, the characters were not adequate role models for all participants. Research is needed to develop and test graphic warning labels with appropriate and realistic role models for cessation success using a narrative format.
Our findings also show the challenges to improving perceptions of the Quitline’s utility for cessation. In 2007 about half of the U.S. population was aware of the Quitline but only 9 % of aware smokers had called, suggesting that factors other than awareness are important influences . Increasing knowledge of the Quitline’s services in this population of low-income, urban smokers might be one step towards improved response efficacy beliefs about the Quitline, but is not sufficient motivation to call. Our text-based response efficacy messages had limited success in influencing efficacy beliefs about the Quitline. The response efficacy label that had the most success informed the audience that many others had used the Quitline and showed a picture of a healthy, happy couple who had used it. These messages appealed to our study population at least in part due to the role modeling exhibited by the characters, aspiration to be healthy and happy like the characters, and knowledge that it has worked for many others (i.e., perceived norms). Similar to other research , our participants expressed beliefs that they had no need for assistance, the Quitline would not be effective, and the telephone modality would not work. Overall, the cognitive factors that predict Quitline calls are unclear . Evidence suggests that smokers prioritize lay knowledge of the effectiveness of assisted vs. unassisted cessation over expert medical knowledge and ascribe value and self-worth to quitting without assistance . Messages should be developed for labels that tap into these cultural and personal values. For example, testimonials from former smokers, their initial misgivings about the Quitline, and how it helped them could be useful package inserts. Combined with formatting to increase the salience of Quitline number and message , this approach might be the most effective strategy to improve perceived efficacy and use of the cessation service.
In addition, our study explains a pathway through which labels might influence cessation among low-income smokers—by enhancing perceived severity of and susceptibility to smoking-related conditions. When asked which labels affected their risk perceptions the most, participants selected high threat labels, followed by low threat labels, because of the vivid picture, negative affective reactions, and information provided. These findings are consistent with other evidence that suggests vivid depictions of the physical effects from smoking are most effective in changing smoking-related attitudes and behaviors [4, 9, 11, 29, 47, 57]. However, we also found that low threat labels frequently evoked affective and cognitive responses, and the use of these labels might be important for low income smokers who would be unmotivated by (or avoid) high threat labels. Individuals who perceive a high level of risk but lack self-efficacy might view their susceptibility to diseases as inevitable and take no preventive action [63, 64]. Indeed, we found evidence of fatalistic attitudes among some participants, which might have influenced their reactions to the labels. They might avoid labels portraying a high threat if they lack self-efficacy. Moreover, research has shown that, when confronted with distressing pictures, individuals pay less attention to the persuasive text accompanying the picture . Indeed, when asked why labels with a high threat picture and efficacy text made them feel self-efficacious, our participants focused much of their initial discussion on the threatening picture, rather than the text. To reach a wide range of smokers, labels portraying a range of threat levels might be useful, particularly if text accompanies pictures. Smokers might focus more on the text after acclimation to a distressing picture through repeated exposure over time, but further research is needed to test this hypothesis.
While our study highlights important findings that can assist the development of theory-based graphic warning labels, transferability of the findings to rural or high SES smokers might be limited. Moreover, we are unable to determine if perceptions of threat and efficacy messages on labels would be similar among high SES smokers. These findings should be explored further in qualitative studies and tested in experimental studies with low and high SES smokers to determine the effects and perceptions of efficacy-based labels by SES. Although the small sample size (N = 25) might appear to limit the findings, we reached saturation in the responses we received, which is a common criterion for sample size determination in qualitative research. We qualitatively identified and explored several threat and efficacy messages that might influence low income smokers’ risk perceptions and efficacy beliefs, which can be tested in an experimental design. In addition, the cross-sectional design precludes evaluation of the labels’ impact on cessation-related attitudes and behaviors. Participants’ reporting of their perceptions of the labels and labels’ influence on their beliefs has value in elucidating the thought processing and decision-making that occurs when faced with a novel health warning message, but our study cannot make definitive conclusions on the translation into behavior change. Lastly, the labels were explored in a research facility, and so further study of the labels within real-world settings, in which smokers’ interactions with the packs can be observed or measured, would be beneficial.
Despite these limitations, the use of well-established theories to develop and explore warning labels might contribute to the theoretical generalizability of the findings and to methods for developing future labels. The theory used in this study (EPPM) provided a useful lens to investigate the influence of labels on individuals’ risk perceptions and self-efficacy beliefs. However, it would be useful for future work among low SES populations to expand to other individual and environmental characteristics that might affect the influence of labels in this population, such as social norms and perceptions of risk from smoking relative to other risks in their environment like drug use, violence, and food insecurity. Indeed, current warning labels emphasize addiction as the main reason for smoking without consideration of the social and cultural context . Consideration of this greater context is particularly important for low SES populations who face greater barriers to cessation [41, 42].
Erosion of label effectiveness over time means that new labels need to be developed and implemented periodically . Our novel findings suggest new ways to design labels with efficacy and threat messages to enhance the acceptance and impact of labels. In particular, narratives that allow smokers to vicariously experience characters’ quit successes might be effective. Self-efficacy and response efficacy messages on labels can play a role in efficacy beliefs, either by influencing them or making previously held beliefs salient. Moreover, our findings could aid in the development of graphic warning labels to address smoking disparities among low SES populations.
We thank Drs. Melissa Davey-Rothwell and Amy Knowlton and the Lighthouse staff for their insight and assistance throughout the study. We are very grateful to the following agencies for allowing us to use their images for the graphic warning labels in the study: Commonwealth of Australia, Department of Health and Ageing; the Brazilian National Cancer Institute; Health Canada; and the Food and Drug Administration, Center for Tobacco Products. We also sincerely thank the participants for their time.
The data collection was supported by the National Institute on Drug Abuse at the National Institutes of Health and the Food and Drug Administration Center for Tobacco Products (grant numbers R01DA032217-04 and R01DA032217-04S); and by the National Institute of Allergy And Infectious Diseases at the National Institutes of Health, The Johns Hopkins Center for AIDS Research (grant number 1P30 AI094189). The agencies were not involved in any technical aspect of the study, the writing of the manuscript, or the decision to submit the manuscript for publication. None of the authors have any competing interests in the manuscript.
Research reported in this publication was supported by NIDA/NIH and FDA Center for Tobacco Products (CTP). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the Food and Drug Administration.
ELM specified the research question, designed the qualitative study, collected and analyzed the interviews, and drafted the manuscript. JEC made substantial contributions to the research design. JEC and CEK contributed to the data analysis. All authors contributed to the interpretation of the data and provided intellectually important contributions and revisions to the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- World Health Organization. WHO report on the global tobacco epidemic, 2011: Warning about the dangers of tobacco. Geneva: WHO Press; 2011. http://whqlibdoc.who.int/publications/2011/9789240687813_eng.pdf. Accessed May 5, 2014.Google Scholar
- World Health Organization. Article 11: Packaging and labelling of tobacco products, WHO Framework Convention on Tobacco Control. Geneva: WHO Press; 2003.Google Scholar
- Azagba S, Sharaf MF. The effect of graphic cigarette warning labels on smoking behavior: Evidence from the Canadian experience. Nicotine Tob Res. 2013;15(3):708–17. doi:10.1093/ntr/nts194.PubMedView ArticleGoogle Scholar
- Hammond D. Health warning messages on tobacco products: A review. Tob Control. 2011;20(5):327–37. doi:10.1136/tc.2010.037630.PubMedView ArticleGoogle Scholar
- Miller CL, Hill DJ, Quester PG, Hiller JE. Impact on the Australian Quitline of new graphic cigarette pack warnings including the Quitline number. Tob Control. 2009;18(3):235–7. doi:10.1136/tc.2008.028290.PubMedPubMed CentralView ArticleGoogle Scholar
- Bansal-Travers M, Hammond D, Smith P, Cummings KM. The impact of cigarette pack design, descriptors, and warning labels on risk perception in the U.S. Am J Prev Med. 2011;40(6):674–82. doi:10.1016/j.amepre.2011.01.021.PubMedPubMed CentralView ArticleGoogle Scholar
- Borland R, Wilson N, Fong GT, Hammond D, Cummings KM, Yong HH, et al. Impact of graphic and text warnings on cigarette packs: Findings from four countries over five years. Tob Control. 2009;18(5):358–64. doi:10.1136/tc.2008.028043.PubMedPubMed CentralView ArticleGoogle Scholar
- Cantrell J, Vallone DM, Thrasher JF, Nagler RH, Feirman SP, Muenz LR, et al. Impact of tobacco-related health warning labels across socioeconomic, race and ethnic groups: Results from a randomized web-based experiment. PLoS One. 2013;8(1):e52206. doi:10.1371/journal.pone.0052206.PubMedPubMed CentralView ArticleGoogle Scholar
- Kees J, Burton S, Andrews JC, Kozup J. Understanding how graphic pictorial warnings work on cigarette packaging. J Public Policy Mark. 2010;29(2):265–76. doi:10.1509/jppm.29.2.265.View ArticleGoogle Scholar
- Miller CL, Quester PG, Hill DJ, Hiller JE. Smokers’ recall of Australian graphic cigarette packet warnings & awareness of associated health effects, 2005–2008. BMC Public Health. 2011;11:238. doi:10.1186/1471-2458-11-238.PubMedPubMed CentralView ArticleGoogle Scholar
- Thrasher JF, Arillo-Santillan E, Villalobos V, Perez-Hernandez R, Hammond D, Carter J, et al. Can pictorial warning labels on cigarette packages address smoking-related health disparities? Field experiments in Mexico to assess pictorial warning label content. Cancer Causes Control. 2012;23 Suppl 1:69–80. doi:10.1007/s10552-012-9899-8.PubMedPubMed CentralView ArticleGoogle Scholar
- Mays D, Niaura RS, Evans WD, Hammond D, Luta G, Tercyak KP. Cigarette packaging and health warnings: The impact of plain packaging and message framing on young smokers. Tob Control. 2015;24(e1):e87-92. doi:10.1136/tobaccocontrol-2013-051234.
- Zhao X, Nan X, Yang B, Iles IA. Cigarette warning labels: Graphics, framing, and identity. Health Educ. 2014;114(2):101–17. doi:10.1108/HE-06-2013-0024.View ArticleGoogle Scholar
- Hammond D. Tobacco packaging and labeling policies under the U.S. Tobacco Control Act: Research needs and priorities. Nicotine Tob Res. 2012;14(1):62–74. doi:10.1093/ntr/ntr182.PubMedView ArticleGoogle Scholar
- Huang L-L, Thrasher JF, Reid JL, Hammond D. Predictive and external validity of a pre-market study to determine the most effective pictorial health warning label content for cigarette packages. Nicotine Tob Res. 2016;18(5):1376–81.Google Scholar
- Emery LF, Romer D, Sheerin KM, Jamieson KH, Peters E. Affective and cognitive mediators of the impact of cigarette warning labels. Nicotine Tob Res. 2014;16(3):263–9. doi:10.1093/ntr/ntt124.PubMedView ArticleGoogle Scholar
- Hammond D, Fong GT, McDonald PW, Brown KS, Cameron R. Graphic Canadian cigarette warning labels and adverse outcomes: Evidence from Canadian smokers. Am J Public Health. 2004;94(8):1442–5. doi:10.2105/ajph.94.8.1442.PubMedPubMed CentralView ArticleGoogle Scholar
- Wang AL, Romer D, Elman I, Turetsky BI, Gur RC, Langleben DD. Emotional graphic cigarette warning labels reduce the electrophysiological brain response to smoking cues. Addict Biol. 2015;20(2):368–76. doi:10.1111/adb.12117.PubMedView ArticleGoogle Scholar
- Wang AL, Lowen SB, Romer D, Giorno M, Langleben DD. Emotional reaction facilitates the brain and behavioural impact of graphic cigarette warning labels in smokers. Tob Control. 2015;24(3):225–32. doi:10.1136/tobaccocontrol-2014-051993.PubMedPubMed CentralView ArticleGoogle Scholar
- Hammond D, Reid JL, Driezen P, Boudreau C. Pictorial health warnings on cigarette packs in the United States: An experimental evaluation of the proposed FDA warnings. Nicotine Tob Res. 2013;15(1):93–102. doi:10.1093/ntr/nts094.PubMedView ArticleGoogle Scholar
- Peters GJY, Ruiter RAC, Kok G. Threatening communication: A critical re-analysis and a revised meta-analytic test of fear appeal theory. Health Psychol Rev. 2013;7(SUPPL1):S8–S31. doi:10.1080/17437199.2012.703527.PubMedPubMed CentralView ArticleGoogle Scholar
- Ruiter CR C, Kok G. Saying is not (always) doing: Cigarette warning labels are useless. Eur J Public Health. 2005;15(3):329. doi:10.1093/eurpub/cki095.
- Witte K. Putting the fear back into fear appeals: The extended parallel process model. Commun Monogr. 1992;59(4):329–49. doi:10.1080/03637759209376276.
- Witte K, Allen M. A meta-analysis of fear appeals: Implications for effective public health campaigns. Health Educ Behav. 2000;27(5):591–615. doi:10.1177/109019810002700506.PubMedView ArticleGoogle Scholar
- Ruiter RA, Kessels LT, Peters GJ, Kok G. Sixty years of fear appeal research: current state of the evidence. Int J Psychol. 2014;49(2):63–70. doi:10.1002/ijop.12042.PubMedView ArticleGoogle Scholar
- Romer D, Peters E, Strasser AA, Langleben D. Desire versus efficacy in smokers’ paradoxical reactions to pictorial health warnings for cigarettes. PLoS One. 2013;8(1):e54937. doi:10.1371/journal.pone.0054937.PubMedPubMed CentralView ArticleGoogle Scholar
- Thrasher JF, Swayampakala K, Borland R, Nagelhout G, Yong H-H, Hammond D et al. Influences of self-efficacy, response efficacy, and reactance on responses to cigarette health warnings: A longitudinal study of adult smokers in Australia and Canada. Health Commun. 2016:1–10. doi:10.1080/10410236.2015.1089456
- Fathelrahman AI, Omar M, Awang R, Borland R, Fong GT, Hammond D, et al. Smokers’ responses toward cigarette pack warning labels in predicting quit intention, stage of change, and self-efficacy. Nicotine Tob Res. 2009;11(3):248–53.PubMedPubMed CentralView ArticleGoogle Scholar
- Berg CJ, Thrasher JF, Westmaas JL, Buchanan T, Pinsker EA, Ahluwalia JS. College student reactions to health warning labels: Sociodemographic and psychosocial factors related to perceived effectiveness of different approaches. Prev Med. 2011;53(6):427–30. doi:10.1016/j.ypmed.2011.09.006.PubMedPubMed CentralView ArticleGoogle Scholar
- Schneider S, Gadinger M, Fischer A. Does the effect go up in smoke? A randomized controlled trial of pictorial warnings on cigarette packaging. Patient Educ Couns. 2012;86(1):77–83. doi:10.1016/j.pec.2011.03.005.PubMedView ArticleGoogle Scholar
- Gallopel-Morvan K, Gabriel P, Le Gall-Ely M, Rieunier S, Urien B. The use of visual warnings in social marketing: The case of tobacco. J Bus Res. 2011;64(1):7–11. doi:10.1016/j.jbusres.2009.09.012.View ArticleGoogle Scholar
- Cismaru M, Lavack AM. Tobacco warning labels and the protection motivation model: Implications for Canadian tobacco control policy. Can Public Pol. 2007;33(4):477–86. doi:10.3138/cpp.33.4.477.View ArticleGoogle Scholar
- Waters EA, McQueen A, Caburnay CA, Boyum S, Sanders Thompson VL, Kaphingst KA, et al. Perceptions of the U.S. National Tobacco Quitline Among Adolescents and Adults: A Qualitative Study, 2012–2013. Prev Chronic Dis. 2015;12:E131. doi:10.5888/pcd12.150139.
- Bandura A. On the functional properties of perceived self-efficacy revisited. J Manage. 2012;38(1):9–44. doi:10.1177/0149206311410606.Google Scholar
- Beacom AM, Newman SJ. Communicating health information to disadvantaged populations. Fam Community Health. 2010;33(2):152–62. doi:10.1097/fch.0b013e3181d59344.PubMedView ArticleGoogle Scholar
- Viswanath K, Finnegan Jr JR. The knowledge gap hypothesis: Twenty-five years later. In: Burleson BR, Kunkel A, editors. Communication yearbook. Thousand Oaks, CA: Sage Publications, Inc; 1996. p. 187–227.Google Scholar
- Viswanath K, Breen N, Meissner H, Moser RP, Hesse B, Steele WR, et al. Cancer knowledge and disparities in the information age. J Health Commun. 2006;11 Suppl 1:1–17. doi:10.1080/10810730600977517.PubMedView ArticleGoogle Scholar
- Kreuter MW, McClure SM. The role of culture in health communication. Annu Rev Public Health. 2004;25:439–55. doi:10.1146/annurev.publhealth.25.101802.123000.PubMedView ArticleGoogle Scholar
- Thrasher JF, Villalobos V, Szklo A, Fong GT, Perez C, Sebrie E, et al. Assessing the impact of cigarette package health warning labels: A cross-country comparison in Brazil, Uruguay and Mexico. Salud Publica Mex. 2010;52 Suppl 2:S206–15. doi:10.1590/s0036-36342010000800016.
- Centers for Disease Control and Prevention. Quitting smoking among adults --- United States, 2001–2010. MMWR Morb Mortal Wkly Rep. 2011;60(44):1513–9.Google Scholar
- Barbeau EM, Krieger N, Soobader MJ. Working class matters: Socioeconomic disadvantage, race/ethnicity, gender, and smoking in NHIS 2000. Am J Public Health. 2004;94(2):269–78. doi:10.2105/AJPH.94.2.269.PubMedPubMed CentralView ArticleGoogle Scholar
- Gilman SE, Abrams DB, Buka SL. Socioeconomic status over the life course and stages of cigarette use: Initiation, regular use, and cessation. J Epidemiol Community Health. 2003;57(10):802–8. doi:10.1136/jech.57.10.802.PubMedPubMed CentralView ArticleGoogle Scholar
- Jamal A, Homa DM, O'Connor E, Babb SD, Caraballo RS, Singh T, et al. Current cigarette smoking among adults - United States, 2005–2014. MMWR Morb Mortal Wkly Rep. 2015;64(44):1233–40. doi:10.15585/mmwr.mm6444a2.PubMedView ArticleGoogle Scholar
- Mead EL, Cohen JE, Kennedy C, Gallo J, Latkin CA. The role of theory-driven graphic warning labels in motivation to quit: a qualitative study on perceptions from low-income, urban smokers. BMC Public Health. 2015;15:92. doi:10.1186/s12889-015-1438-6.PubMedPubMed CentralView ArticleGoogle Scholar
- Baltimore City Health Department. Baltimore city community health survey 2009: Summary results report. 2010. http://health.baltimorecity.gov/sites/default/files/2010_03_26_CHS_Summary_Results_Report.pdf. Accessed October 23 2014.
- LaVeist T, Thorpe Jr R, Mance G, Jackson J. Overcoming confounding of race with socio-economic status and segregation to explore race disparities in smoking. Addiction. 2007;102 Suppl 2:65–70. doi:10.1111/j.1360-0443.2007.01956.x.PubMedView ArticleGoogle Scholar
- Hammond D, Thrasher JF, Reid JL, Driezen P, Boudreau C, Santillan EA. Perceived effectiveness of pictorial health warnings among Mexican youth and adults: A population-level intervention with potential to reduce tobacco-related inequities. Cancer Causes Control. 2012;23 Suppl 1:57–67. doi:10.1007/s10552-012-9902-4.PubMedPubMed CentralView ArticleGoogle Scholar
- Tobin KE, Kuramoto SJ, Davey-Rothwell MA, Latkin CA. The STEP into Action study: A peer-based, personal risk network-focused HIV prevention intervention with injection drug users in Baltimore, Maryland. Addiction. 2011;106(2):366–75. doi:10.1111/j.1360-0443.2010.03146.x.
- Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117. doi:10.1186/1471-2288-13-117.PubMedPubMed CentralView ArticleGoogle Scholar
- Block LG, Punam AK. Effects of self-efficacy and vividness on the persuasiveness of health communications. J Consum Psychol. 1997;6(1):31–54. doi:10.2307/1480521.View ArticleGoogle Scholar
- Popova L. Scaring the snus out of smokers: Testing effects of fear, threat, and efficacy on smokers’ acceptance of novel smokeless tobacco products. Health Commun. 2014;29(9):924–36. doi:10.1080/10410236.2013.824063.PubMedView ArticleGoogle Scholar
- Strahan EJ, White K, Fong GT, Fabrigar LR, Zanna MP, Cameron R. Enhancing the effectiveness of tobacco package warning labels: A social psychological perspective. Tob Control. 2002;11(3):183–90. doi:10.1136/tc.11.3.183.PubMedPubMed CentralView ArticleGoogle Scholar
- Bandura A. Social cognitive theory of mass communication. In: Bryant J, Zillman D, editors. Media Effects: Advances in Theory and Research. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum; 2001. p. 121–53.Google Scholar
- Anderson RB, McMillion PY. Effects of similar and diversified modeling on African American women's efficacy expectations and intentions to perform breast self-examination. Health Commun. 1995;7(4):327–43. doi:10.1207/s15327027hc0704_3.View ArticleGoogle Scholar
- Maddison R, Prapavessis H, Clatworthy M. Modeling and rehabilitation following anterior cruciate ligament reconstruction. Ann Behav Med. 2006;31(1):89–98. doi:10.1207/s15324796abm3101_13.PubMedView ArticleGoogle Scholar
- Secker-Walker RH, Solomon LJ, Geller BM, Flynn BS, Worden JK, Skelly JM, et al. Modeling smoking cessation: Exploring the use of a videotape to help pregnant women quit smoking. Women Health. 1997;25(1):23–35. doi:10.1300/J013v25n01_02.PubMedView ArticleGoogle Scholar
- Thrasher JF, Carpenter MJ, Andrews JO, Gray KM, Alberg AJ, Navarro A, et al. Cigarette warning label policy alternatives and smoking-related health disparities. Am J Prev Med. 2012;43(6):590–600. doi:10.1016/j.amepre.2012.08.025.PubMedPubMed CentralView ArticleGoogle Scholar
- Kaufman A, Augustson E, Davis K, Finney Rutten LJ. Awareness and Use of Tobacco Quitlines: Evidence from the Health Information National Trends Survey. J Health Commun. 2010;15(0 3):264–78. doi:10.1080/10810730.2010.526172.
- Burns EK, Deaton EA, Levinson AH. Rates and Reasons: Disparities in Low Intentions to Use a State Smoking Cessation Quitline. Am J Health Promot. 2011;25(sp5):S59-S65. doi:10.4278/ajhp.100611-QUAN-183.
- Solomon LJ, Hughes JR, Livingston A, Naud S, Callas PW, Peters EN, et al. Cognitive barriers to calling a smoking quitline. Nicotine Tob Res. 2009;11(11):1339–46. doi:10.1093/ntr/ntp143.PubMedPubMed CentralView ArticleGoogle Scholar
- Smith AL, Carter SM, Chapman S, Dunlop SM, Freeman B. Why do smokers try to quit without medication or counselling? A qualitative study with ex-smokers. BMJ Open. 2015;5(4):e007301. doi:10.1136/bmjopen-2014-007301.
- Hoek J, Gendall P, Eckert C, Rolls K, Louviere J. A comparison of on-pack Quitline information formats. Tob Control. 2016;25(2):211-7. doi:10.1136/tobaccocontrol-2014-051820.
- Maibach E, Murphy DA. Self-efficacy in health promotion research and practice: Conceptualization and measurement. Health Educ Res. 1995;10(1):37–50. doi:10.1093/her/10.1.37.View ArticleGoogle Scholar
- Rimal RN, Real K. Perceived risk and efficacy beliefs as motivators of change. Hum Commun Res. 2003;29(3):370–99. doi:10.1111/j.1468-2958.2003.tb00844.x.Google Scholar
- Brown SL, Richardson M. The effect of distressing imagery on attention to and persuasiveness of an antialcohol message: A gaze-tracking approach. Health Educ Behav. 2012;39(1):8–17. doi:10.1177/1090198111404411.PubMedView ArticleGoogle Scholar
- Haines-Saah RJ, Bell K, Dennis S. A qualitative content analysis of cigarette health warning labels in Australia, Canada, the United Kingdom, and the United States. Am J Public Health. 2014;105(2):e61–e9. doi:10.2105/AJPH.2014.302362.View ArticleGoogle Scholar