Communication— A Process, Not A Product
Key Steps for Programs With Limited BCC Budgets
Family planning programs with limited budgets for BCC still can carry out strategic BCC programs. All BCC programs, regardless of budget, should follow certain key steps in the program process, such as defining the intended audience and objectives and pretesting materials. BCC programs can carry out these key steps easily, quickly, and inexpensively even if resources are limited.
1. Define the intended audience. Programs can often use existing research to help define the audience, such as statistics from the Ministry of Health or national surveys. Programmers might also have to depend on their own knowledge of and experience with the community if they do not have the resources to conduct further formative research.
2. Define objectives. What does the program want to accomplish with its BCC materials and activities? For example, does the program want to bring people into a clinic? Does it want people to buy contraceptives at pharmacies? Different audiences and objectives will require different messages and channels.
3. Develop the key message point. What is the key message point that the program wants to convey to the audience?
4. Choose the communication channels. Which channels will best reach the audience? Small programs may decide to use the help of the news media as much as possible to spread their message. Programs should not overlook other possible channels, however, such as radio public service announcements or outreach through community-based volunteers.
5. Ensure good-quality materials. BCC programs may want to hire an ad agency, graphic designer or illustrator, or some other creative professional to develop a good-quality product. If materials are not good enough to catch the audience’s attention, the program effort will be wasted.
6. Pretest materials. Pretesting can be informal. For example, programs can obtain feedback about materials by asking members of the intended audience what they think of the materials, whether it be in a clinic waiting room, at a local market, or even on a neighborhood street. Informed pretesting is better than no pretesting at all. Before launching the materials, programs should revise them based on feedback obtained during pretesting.
Sources: Aguilar 2007 (2) and National Cancer Institute 2001 (136)
|
Successful BCC programs follow a systematic process. For programs addressing individual behavior, the process usually consists of four or five major steps. Different organizations have different names for these steps. Still, they all involve analysis, strategic design, development and pretesting of messages and materials, implementation and monitoring, and evaluation1* (30, 74, 79, 137, 139, 189, 196, 201, 225). The process guides planning and implementation (see Spotlight: Ethiopian Radio Serial Follows Process to Success). Following a proven process helps programs to work efficiently and to avoid mistakes. Programs with limited BCC budgets can adapt the steps to suit their scope (136) (see box, right). For help with following the steps in this process, see the tools in the companion INFO Reports: “Tools for Behavior Change Communication” (see Tools Available for BCC Programs).
Other models and processes focus more on affecting social change in a community, so as to improve the health and welfare of all its members (47, 60, 87). These models follow a different process. They focus on participatory communication that enables people and communities to define who they are, what they want, and how they can achieve the desired change (47). Key principles include empowering individuals and communities and engaging people in making decisions that improve their lives (see Participatory Approaches Empower Communities). Objectives and outcomes also differ from the conventional BCC model. For example, social change models value the communication process, such as expanding dialogue and debate and increasing community leadership, not only as a means to achieve health or community development outcomes. They also value the participatory communication process as an end in itself (47, 60).
The gap between BCC for individual behavior change and BCC for social change is narrowing (60, 128, 211). The conventional BCC model for individual behavior change has evolved in a participatory direction and some conventional BCC programs address both individual behavior change and social change (see Participatory Approaches Empower Communities). Similarly, participatory programs involve some elements of information transfer from programmers to communities in order to achieve underlying behavior change objectives (128, 211).
Step 1 : Analysis
Analysis provides the foundation for the BCC program. Analysis involves defining the health problem, the intended audience, and communication needs. Some of this information will already be available. For example, the Ministry of Health usually collects information about the extent and severity of health problems. Epidemiological data help to identify the primary audience of the program—that is, who is at risk of or is suffering from the health problem (136, 139, 201). To gain insight into the health problem, potential solutions, and the audience, programs can contact other organizations who are addressing the problem through communication and other approaches. These organizations can explain what they have learned and what remains to be done (136).
|
Analysis provides the foundation for the BCC program.
|
Programs often also conduct their own in-depth audience research. Formative research (also called formative evaluation) provides that understanding. Formative research takes place before any program design or implementation. It collects information about the audience; their knowledge, attitudes, and beliefs about health; and the factors that affect their health behavior. Formative research also can discover the intended audience’s media habits (for example, how much they listen to the radio and at what times of day). Research can assess the audience’s access to information, services, social support, and other resources (16, 68, 136). Thus it helps programs to address their audiences effectively. Formative research also contributes to the conceptual framework. The conceptual framework describes how the BCC program expects to influence health behavior (see Step 2).
A thorough analysis of the audience identifies different groups of people based on such characteristics as age, sex, place of residence, values, and stage of behavior change (see illustration). Most BCC programs customize messages to suit subgroups of people who have similar needs, preferences, and characteristics (30, 139, 201). This audience segmentation can help to make programs more efficient and effective. It is efficient because it allows the program to direct its limited resources to those most in need or most likely to change. It is effective because message content, form, and style can be tailored more closely to the needs and abilities of more cohesive groups (5). Of course, when a medium such as radio reaches large populations, even a well-defined subgroup can amount to millions of people.
In addition, analysis identifies secondary audiences—that is, people who influence the health behaviors of the primary audience (136, 139, 201). Examples include family, friends, and local opinion leaders. The program may need different messages to reach these secondary audiences.
The analysis step also involves assessing communication resources (30, 79, 136, 201). For example, can other organizations collaborate and share costs? What communication channels best reach the intended audience? What are the capabilities of the local media industry, such as broadcasting, printing, advertising, and audience research? Are qualified communication professionals available?
Step 2: Strategic Design
Strategic design creates the roadmap for the program. Information collected from formative research, along with relevant behavioral theories, guides strategic design. During strategic design the program establishes objectives, develops the conceptual framework, selects indicators, chooses communication channels, develops the creative brief (a document used to inform, or “brief,” the creative team), and builds an implementation plan.
Establish “SMART” objectives. Objectives should be SMART—that is, specific, Measurable, Appropriate, Realistic, and Timebound (see Figure 2, below). Objectives describe the intermediate steps that must be taken to achieve end goals (158). They help the program to choose which activities to undertake and to decide what outcomes to pursue and measure (136). Outcomes are the intended results or benefits for the audience during or after exposure to a program (18, 207).
BCC programs often define three levels of objectives:
- Communication objectives describe sought-after improvements in the indirect influences on behavior, such as knowledge, attitudes, or social norms (see Theories Inform Behavior Change Communication). For example, a communication objective could focus on reducing barriers to contraceptive use in the community.
- Behavior change objectives refer to the intended changes in actual behavior. A behavior change objective might focus on increasing contraceptive use among the intended audience.
- Together, communication and behavior change objectives contribute to the overall program objective. Program objectives refer to anticipated results of the overarching health program in terms of outcomes, such as decreasing the fertility rate among women of reproductive age (56, 138).
Figure 2: Defining SMART Objectives

Sources: National Cancer Institute 2001 (136), O'Sullivan 2003 (139), and United Nations Children's Fund and World Health Organization 2000 (201)
|
Figure 3: Elements of a BCC Conceptual Framework

Sources: Storey 2007 (183)
|
Develop a conceptual framework. A conceptual framework shows how program activities are expected to contribute to objectives. Such frameworks outline the logical sequence of steps to achieve results (20, 66).
Figure 3, above, illustrates the conceptual framework for a program to reduce unintended or mistimed pregnancies and to increase birth spacing intervals to the recommended time frame of three to five years (169). One communication objective might be to increase knowledge of modern contraceptive methods among women ages 15 to 49 by 20% over the next five years. A related behavior change objective might be to increase use of modern contraceptives among this group of women by 10% over the next five years. To reach behavior change and program objectives, the BCC program needs to consider “contextual variables,” which relate to underlying social, political, and economic conditions (see Figure 3) (183). These underlying conditions, identified in the formative research, along with relevant theory, inform the specific communication activities to undertake.
|
Strategic design creates the roadmap for the program.
|
Communication interventions take place in three mutually supportive domains: the social-political environment, the service delivery system, and among individuals and communities (see “Domains for Communication Interventions” in Figure 3). These efforts are intended to produce “initial outcomes” at different levels: the social and political environment, service delivery systems, the community, and the individual. At the level of the individual, communication activities are expected to improve knowledge, change attitudes, and influence other factors (see “Initial Outcomes” in Figure 3). Changes in these initial outcomes lead to increased adoption of the desired behaviors, including increased use of modern contraceptives (see “Behavioral Outcomes” in Figure 3). In turn, behavior change leads to achieving the overall program objectives, such as reducing unintended or mistimed pregnancies and increasing birth spacing intervals (see “Sustainable Health Outcomes” in Figure 3).
Select indicators. Conceptual frameworks also aid in the selection of appropriate indicators (66, 92). An indicator measures a single aspect of a program that contributes to meeting objectives (20, 66). For example, evaluators might choose to track the number of audience members who attend particular community mobilization events. This indicator assesses outreach activities. Evaluators try to choose indicators that are valid (measure the topic or issue that they are meant to reflect), reliable (produce consistent results when repeated over time), specific (measure a single topic or issue), sensitive (responsive to change), and operational (measurable) (19, 139).
Choose communication channels. Findings from formative research guide the choice of communication channels. Formative research can identify which channels best reach the audience and which channels the audience considers most credible concerning health topics. Combining the three types of channels—mass media, interpersonal communication, and/or community channels—can help maximize the effect of BCC programs (see Egyptian Project Combines Channels to Reach Families). To choose the appropriate mix of channels, the communication team should consider which channels will best deliver the message to the intended audience within the available budget.
Beyond choosing the three types of channels, BCC programs also need to select specific channels and devise activities. For example, which radio stations best reach youth in the cities? Information and communication technologies (ICTs) enable people to interact and participate in the BCC campaign, but which ones can the audience use (see Technology Shapes Behavior Change Communication)? Programs can choose from a variety of formats, materials, and venues within each type of communication channel (see Table 1).
Develop a creative brief. The creative brief is a document that the communication team develops and shares with people and organizations involved in development of messages and materials, such as advertising agencies, public relations firms, or writers and designers. It provides all staff with the same direction for developing messages and materials. The creative brief includes a profile of the intended audience, audience actions expected (behavior change objectives), and the resulting benefits that the audience will appreciate. The creative brief should also include the key message points that will be conveyed in all messages, activities, and channels (136, 139). (For help with developing a creative brief, see Model for a Creative Brief.)
Model for a Creative Brief
- Intended Audiences Be specific about who the program wants to reach. The primary audience consists of people that the BCC program wants to motivate to practice a healthy behavior. These usually are the people who are at risk of or who are suffering from a particular health problem. Secondary audiences are people who influence the health behaviors of the primary audience, such as family, friends, and opinion leaders.
- Objectives State what the intended audience should do after they hear and/or see the message. Objectives should be SMART:
- Specific (indicate who or what is the focus of the effort and what type of change is intended),
- Measurable (indicate a quantity, such as the percentage change expected),
- Appropriate (be sensitive to audience needs and preferences and to social norms and expectations),
- Realistic (decide what can be achieved reasonably under existing conditions and with available resources), and
- Timebound (state clearly the time period for achieving the behavior changes).
- Obstacles State the obstacles that can prevent the audience from making the desired change. These might be beliefs, cultural practices, peer pressure, or misinformation, for example. Audience research and relevant behavioral theories can help identify these factors. Focusing on decreasing such barriers to behavior change can help with designing more effective programs.
- Key Benefits State the benefits of the desired behavior for the intended audience. These often appear in the program’s messages.
- Channels State which channels and products will carry the messages— for example, television, radio, newspapers, Internet Web sites, posters, flyers, telephone hotlines, peer or client counseling, community meetings, or live entertainment.
- Key Message Points Identify the core information that will be included in all communication, including advertising slogans, counseling messages, and community activities.
Sources: National Cancer Institute 2001 (136) and O’Sullivan 2003 (139)
|
Planning Documents That Help Guide Implementation
During strategic design of BCC programs, staff should prepare several planning documents to help guide implementation of the program. These include:
1. Creative brief, which provides guidance for developing all program activities and materials. It describes:
- Intended audiences
- Communication and behavior change objectives
- Obstacles to behavior change
- Benefits of the desired behavior
- Channels that will carry the messages
- Key message points (see Model for a Creative Brief)
2. Conceptual framework, which helps clarify how the program intends to reach objectives. This visual depiction shows the logical order of the program steps that will lead to intended outcomes (see Develop a conceptual framework).
3. Implementation plan, which comprises:
4. Monitoring and evaluation plans, which describe:
- What aspects of the program will be monitored
- How and how often the program will be monitored
- Research design for evaluation
- What indicators will be measured
- What methodology will be used to determine whether changes in outcomes can be linked to the BCC program (see Build an implementation plan)
|
Build an implementation plan. The next step is an implementation plan, covering partners’ roles and responsibilities, activities, timeline, budget, and management. At this stage the program also should plan for monitoring and evaluation (also called process evaluation and summative evaluation, respectively). (For a summary of all the documents that should have been prepared by the end of this step, see Planning Documents That Help Guide Implementation.) Monitoring and evaluation should be planned for in every BCC program from the beginning, starting with formative research to inform the analysis stage, and then developed and used throughout the planning and implementation process. A monitoring plan should describe what aspects of the program will be monitored, how and how often, and what indicators will be used (66).
Monitoring enables managers to determine if the program is on track and to account for budget expenditures (see Step 4). An evaluation plan describes the research design, indicators, and methods used to determine if changes in outcomes have taken place and can be linked to the BCC program (see Step 5) (66).
There are a number of types of evaluation designs (see Examples of Evaluation Designs). The choice depends on the nature of the BCC program, the funds and expertise available for the evaluation, the duration of the program, and the information needs of stakeholders and decision-makers (136). Ideally, evaluations include measurements at the start and completion of a BCC program, so that they can be compared. Evaluation design should measure exposure to various BCC activities (66, 138). Developing a strong evaluation plan may require help from an evaluation expert who is familiar with research design, sampling, and advanced statistical analysis.
As a rule of thumb, it is advisable to allocate approximately 10% of a BCC program budget to monitoring and evaluation. A monitoring and evaluation budget may exceed 10%, however, particularly for pilot programs intended to determine whether the program is worth replicating or scaling up (142). For small programs with relatively small budgets, 10% represents a limited amount (142). Evaluation conducted on such a small scale usually cannot be expected to detect significant program results. Thus, the funds may be better spent on program activities and low-cost monitoring (94, 106, 142).
Step 3: Development and Pretesting
The analysis, conducted in Step 1, and the strategic plan, created in Step 2, guide the development of concepts, messages, and materials. The program should tailor its messages based on the audience’s position in the stages of behavior change (228). For example, research may find that most people are already aware of and concerned about the desired behavior, but they have not yet tried it. They may need messages that focus on the benefits of behavior change. Research may find, instead, that most people are already motivated to change their behavior. Then messages may need to provide practical information, such as where to obtain supplies and how to use them (see illustration).
For example, a study in southwestern Uganda found that adolescent girls were aware of HIV but underestimated their risk of infection. They distrusted condoms. Generally, they lacked a formal, culturally appropriate source of sexual and reproductive health information. Surveys of the community found that people were aware of the vulnerability of adolescent girls to HIV and other STIs. Also, people wanted adolescents to know more about reproductive health risks. Therefore, program staff worked with the community to revitalize and update a traditional channel of communication for adolescent girls about sex and marriage, the senga (meaning father’s sister). With training, sengas delivered messages about HIV and family planning that were both accurate and culturally appropriate. They also gave young women traditional information about sex and marriage (130–132).
Choose type of appeal and tone. Programs can use a number of different types of appeals in their messages, such as informing, entertaining, persuading, educating, or empowering (201). For example, entertainment-education approaches can educate and motivate people as they entertain them (175) (see Spotlight: Ethiopian Radio Serial Follows Process to Success). Messages also can vary in tone—for example, using humor or fear. Fear appeals both motivate behavior change and cause defensiveness and resistance to change. Which response dominates depends on whether the message proposes effective and feasible action to avoid the threat (222, 223).
Obtain creative talent. To develop effective materials, the program needs creative talent. This talent could come from within the organization. It also could come through partnerships or contracts with other organizations, such as advertising agencies, public relations firms, or NGOs with staff trained in communication (79, 136). The program should use the creative brief developed in Step 2 to explain the communication strategy to the creative staff and help them to understand the objectives and what the program has learned about the intended audience. A profile of a typical audience member can also help the creative staff to develop materials that are relevant and appealing to the audience. (For guidelines on managing the work of an ad agency, which can be adapted for working with other creative professionals, see the publication, “How to Select and Work With an Advertising Agency,” at http://www.jhuccp.org/pubs/fg/2/2.pdf.)
Pretest messages and materials. During pretesting, typical members of the intended audience see or hear preliminary versions of the campaign materials. Then they are asked questions such as: What message does the TV spot convey? Are the characters in the radio drama believable? Is the information in the brochure easy to understand? What is attractive about the piece? What is unattractive about it? Is anything offensive? Answers to these and other questions may indicate the need for changes. Revisions may be minor or substantial, but the pretesters’ reactions should not be ignored (228).
There is no substitute for pretesting with the intended audience. Review by colleagues or experts will not reliably predict audience reaction. For example, in the Accelerating Contraceptive Use Project in Afghanistan, pretesting with community leaders at one site found that pictures in condom instructions would be unacceptable. In the two other sites pictures were acceptable if used only in counseling (88, 115).
Step 4: Implementation and Monitoring
During this step the manager of the BCC program makes sure that each program component is developed as planned and that each product reaches the correct destination on time. Implementation can typically involve distributing print materials, broadcasting radio and television messages, or conducting community meetings or individual counseling sessions (30).
When launching the program, program managers can engage the media to obtain maximum news coverage of the program. News coverage often is people’s first source of information (155). Kickoff events and press conferences are good ways to get the news media’s attention.
|
News coverage often is people’s first source of information.
|
For example, Egypt’s Communication for Healthy Living project hosted group weddings that attracted hundreds of newlywed couples. Extensive news coverage of these receptions in national radio, television, and newspapers spread the message of the Sahatek, Sarwetek (“Your Health, Your Wealth”) campaign throughout Egypt (38, 81). specific messages focused on safe pregnancy and delivery, postpartum care, neonatal and infant care, and birth spacing. Developing an ongoing relationship with the news media helps ensure continuing coverage of the program.
Monitoring occurs during program implementation. It enables managers to track program activities, outputs, reach, and costs (16, 66, 159). For example, programs may monitor the quality, timing, frequency, and audience size of radio and television announcements or dramas. Programs may track print runs and distribution of print materials. They may conduct site visits—for example, to check if clinics have program materials and use them properly.
Tools Available for BCC Programs
For help with planning and carrying out the steps in the BCC program process, see the tools in the companion INFO Report issue, "Tools for Behavior Change Communication." The tools include:
- Checklist of the steps and activities of the BCC program process
- Example of an audience profile
- Table of the major cost areas for BCC programs
- Checklist for ensuring good-quality communication materials
- Tips for working with the news media
- Table of types of evaluation for BCC programs and of sample indicators
For information on developing entertainment-education formats, see the other INFO Reports issue, "Entertainment-Education for Better Health"
|
Program managers and evaluators can collect data from such sources as log books of TV or radio stations, program activity forms, and clinic registries (136). How often data are collected depends partly on how easy they are to collect. Existing data collection systems, such as service statistics, can be convenient. Usually, however, the program also must develop new data collection processes—for example, organizing staff to monitor television and radio broadcasts (66).
Program managers also should monitor the immediate reactions of the audience whenever possible. Program managers can create listener groups or conduct focus groups or short surveys to determine audience members’ understanding of and reactions to messages (11, 161, 209). That information helps managers and evaluators identify obstacles and opportunities and make midcourse corrections (see Spotlight: Ethiopian Radio Serial Follows Process to Success).
Step 5: Evaluation
Evaluation assesses program achievements and how well the program has met its objectives (66). It can measure the extent to which observed changes in outcomes can be linked to communication activities. That is, have audience members changed in the ways described by the communication and behavior change objectives? And is the BCC program responsible for these changes?
To assess whether the BCC program accounts for the observed change in outcomes, evaluators consider eight criteria: (1) observation of change in the outcome; (2) degree of relationship (correlation) between exposure to the program and the observed outcome; (3) evidence that exposure occurred before the observed change in the outcome; (4) lack of evidence suggesting that the observed change is due to other factors; (5) observation of a large, abrupt change over time in the outcome in the absence of other major influences; (6) evidence of a causal connection (consistent with theory); (7) evidence that the impact increases as the level or duration of exposure increases (dose response), and (8) consistency with findings of previous research (19, 59, 142). The more criteria that evaluation findings meet, the greater the confidence that the BCC program is responsible for the observed outcomes (142). A strong evaluation design will plan from the start to check many of these criteria.
|
Evaluation can facilitate sustainability and scale-up by identifying key factors that contributed to success.
|
Evaluations can provide valuable evidence to decision-makers, demonstrating that BCC programs contribute to health outcomes and justifying future investments (66, 92). A dissemination plan helps ensure that key stakeholders and decision-makers learn about program results. Different people prefer different formats for presentation of results. For example, busy policy makers usually appreciate a policy brief. A program manager may want a detailed report. Researchers tend to favor journal articles. The public and members of the audience may most appreciate a participatory presentation and discussion, with time for questions and answers (139, 142).
Information from evaluation often serves as part of the formative research findings for design of the next program. By identifying key factors that contributed to success, evaluation can facilitate sustainability and scale-up (54).
* Some processes include monitoring with evaluation rather than with implementation. This report includes monitoring with implementation because monitoring focuses on processes and tracking the production of materials during the implementation stage, whereas evaluation occurs at the end of the program.
Technology Shapes Behavior Change Communication
Information and communication technologies (ICTs) offer new opportunities for health communication. Mobile phones, the Internet, and handheld computers or personal digital assistants (PDAs) can offer the low cost per-person-reached that is typical of broadcast media. In contrast to these one-way media, however, the new technologies offer the possibility of dialogue and individually tailored communication. Already, these technologies have helped to raise awareness of health issues, encouraged people to seek support and accurate information, increased dialogue within communities, motivated behavior change, and increased demand for services (34, 119, 186).
|

Left photo: Freedom HIV/AIDS uses mobile phone games to raise awareness of HIV/AIDS among Indian youth. Mobile phones and other information and communication technologies offer new interactive opportunities for health communication, and they cost little per person reached. © 2007-2008 ZMQ Software Systems
Right photo: Web sites are popular among youth because they provide information both interactively and privately. The “loveLife” Web site in South Africa teaches adolescents about reproductive health.
|
Many “digital divides” persist—between North and South, within regions of the South, and between urban and rural areas, men and women, young and old, and high-income and low-income (28, 78, 95). These technologies are spreading rapidly, however. In the developing world the number of mobile phone subscribers increased from 46 per 1,000 people in 2000 to 258 per 1,000 people in 2005 (93). Also, telecenters, cybercafés, community kiosks, and other community access points are bringing computers and the Internet to much of the world’s population. For example, Mexico’s Internet subscription rate is only 2% of households but almost 70% of the population has access to the Internet, if they want it, through commercial or government- sponsored Internet cafés (95, 124). As the number of public ICT facilities grows, so does the opportunity to reach people with health information through the Web and stand-alone computers (119).
Mobile phones cannot yet offer as much content as computers, but they are widely used and they go almost everywhere. Health programs have used mobile phones to deliver health messages, to remind people to take medicines or oral contraceptives, and to provide follow-up and counseling for people with HIV/AIDS or other chronic diseases such as tuberculosis and diabetes (102). For example, the Freedom HIV/AIDS Initiative offers four mobile phone games that promote HIV/AIDS awareness among Indian youth. SafetyCricket, HIV Quiz, The Messenger, and Red Ribbon Chase were downloaded over seven million times in 2006 (151, 182, 229).
By comparison, Web-based and other computer-based ICTs offer users more participation in health communication. Users can search for specific information, play educational games, and take courses and quizzes. They can seek social support, share feelings and concerns anonymously, and obtain answers to sensitive questions through e-mail messages, Web sites, and social media such as e-forums, blogs, and chat rooms. Increasing numbers of Web sites provide health information and messages to general audiences or to specific groups of users. They seek to promote healthy behaviors, enable informed decision-making, and enhance self-efficacy to seek health care services (24, 167, 186).
For example, in 2006 the Jordan Health Communication Partnership launched the first Arabic-language health portal on the Web, at www.sehetna.com. The Sehetna (“Our Health”) site offers accurate health information on a variety of topics tailored for all age groups, from adolescents to the elderly. It also features health news, physician directories, and the opportunity to submit questions to an “Ask the Expert” feature. The site has averaged over 12,000 unique users each month since its launch in April 2006 (13, 57, 206).
Young people especially like Web-based applications because they provide information interactively and privately. For example, numerous Web sites offer reproductive health information to adolescents. They include “Auntie Stella” in Zimbabwe (http://www.auntiestella.org/), “@dolescencia” in Mexico (http://www.adolescencia.uanl.mx/), “teenpath.net” in Thailand (http://www.teenpath.net), and “loveLife” in South Africa (http://www.lovelife.org.za/youth/) (24, 149, 171).
In addition to the Internet, health communication programs also use CD-ROMs and computer software. Settings range from primary care facilities to classrooms (107, 112, 119, 186). These tools avoid problems with Internet access. In two states of India, for example, multimedia computer software in ICT centers helps migrant workers learn how to avoid HIV infection. It provides information about HIV, sexual and reproductive health, and migrants’ legal issues. Over the first three years 12,000 people obtained information at 28 ICT centers. The centers began with support from the United Nations Development Programme and now run under the supervision of the state governments (202).
|
Examples of Evaluation Designs
Evaluation studies can help others learn what happened, why, when, where, and with what effect (139). Because they must invest resources wisely, policy makers, program managers, and donors need to know which programs work and which do not (209). Also, reports of evaluation findings enhance understanding of and support for BCC (136). Cumulatively, evaluation studies published in peer-reviewed journals can be a particularly persuasive tool to encourage continued efforts in BCC (86).
To design and implement good BCC evaluations, program managers should plan for evaluation in collaboration with key stakeholders. They should ensure that evaluation is an integral part of the program from start to finish. Evaluation should also be based both on a conceptual framework and objectives that draw on formative research and behavioral theory (139, 209). Good evaluations use practical and rigorous methods—that is, they are appropriate to the situation, take measurements at multiple points in time, compare groups exposed to the program with groups that are not exposed, and use multiple data sources to compare and cross-check the consistency of the evidence produced (86, 139, 209).
Some examples of evaluation designs for BCC programs include (16, 64, 136, 209):
- Pretest-posttest separate sample design. Evaluators collect information before the start of a BCC program from a randomly selected sample of members of the intended audience. After the end of a BCC program, evaluators collect information from a second, randomly selected sample of members of the intended audience.
- Pretest-posttest nonequivalent control group design. Evaluators select a “treatment” group—that is, people exposed to the BCC program —and a control group that is not. The two groups are not selected randomly. They are similar but not equivalent. Evaluators collect information from members of both groups (but not necessarily from the same individuals) before and after the BCC program. This design typically uses groups that have already been formed such as schools or well-defined communities.
- Panel design. Evaluators collect information from the same members of the intended audience at multiple times. This design allows evaluators to determine who changed their behavior, how much their behavior changed, and to link program exposure to these observed changes.
- Time series design. This design relies on a large number of data collection points over time to identify trends observed before and after the BCC program. Time series designs often make use of routinely collected data, such as sales or service statistics. Time series can be used for evaluating full-coverage programs, where it is not possible to find an unexposed group.
|
|