Steps for Doing Quantitative Research
Rhetorical research methods have been being developed since the Classical Period. As the transition was made to seeing communication from a social scientific perspective, scholars began studying communication using the methods established from the physical sciences. Thus, quantitative methods represent the steps of using the Scientific Method of research.
- Decide on a focus of study based primarily on your interests. What do you want to discover or answer?
- Develop a research question(s) to keep your research focused.
- Develop a hypothesis(es). A hypothesis states how a researcher believes the subjects under study will or will not communicate based on certain variables. For example, you may have a research question that asks, “Does the gender of a student impact the number of times a college professor calls on his/her students?” From this, you might form two hypotheses: “Instructors call on female students less often then male students.” and “Instructors call on students of their same sex.”
- Collect data in order to test hypotheses. In our example, you might observe various college classrooms in order to count which students professors call on more frequently.
- Analyze the data by processing the numbers using statistical programs like SPSS that allow quantitative researchers to detect patterns in communication phenomena. Analyzing data in our example would help us determine if there are any significant differences in the ways in which college professors call on various students.
- Interpret the data to determine if patterns are significant enough to make broad claims about how humans communicate? Simply because professors call on certain students a few more times than other students may or may not indicate communicative patterns of significance.
- Share the results with others. Through the sharing of research we continue to learn more about the patterns and rules that guide the ways we communicate.
The term quantitative refers to research in which we can quantify, or count, communication phenomena. Quantitative methodologies draw heavily from research methods in the physical sciences explore human communication phenomena through the collection and analysis of numerical data. Let’s look at a simple example. What if we wanted to see how public speaking textbooks represent diversity in their photographs and examples. One thing we could do is quantify these to come to conclusions about these representations. For quantitative research, we must determine which communicative acts to count? How do we go about counting them? Is there any human communicative behavior that would return a 100% response rate like the effects of gravity in the physical sciences? What can we learn by counting acts of human communication?
Suppose you want to determine what communicative actions illicit negative responses from your professors. How would you go about researching this? What data would you count? In what ways would you count them? Who would you study? How would you know if you discovered anything of significance that would tell us something important about this? These are tough questions for researchers to answer, particularly in light of the fact that, unlike laws in the physical sciences, human communication is varied and unpredictable.
Nevertheless, there are several quantitative methods researchers use to study communication in order to reveal patterns that help us predict and control our communication. Think about polls that provide feedback for politicians. While people do not all think the same, this type of research provides patterns of thought to politicians who can use this information to make policy decisions that impact our lives. Let’s look at a few of the more frequent quantitative methods of communication research.
Types of Quantitative Methods
There are many ways researchers can quantify human communication. Not all communication is easily quantified, but much of what we know about human communication comes from quantitative research.
- Experimental Research is the most well-established quantitative methodology in both the physical and social sciences. This approach uses the principles of research in the physical sciences to conduct experiments that explore human behavior. Researchers choose whether they will conduct their experiments in lab settings or real-world settings. Experimental research generally includes a control group (the group where variables are not altered) and the experimental group(s) (the group in which variables are altered). The groups are then carefully monitored to see if they enact different reactions to different variables.
To determine if students were more motivated to learn by participating in a classroom game versus attending a classroom lecture, the researchers designed an experiment. They wanted to test the hypothesis that students would actually be more motivated to learn from the game. Their next question was, “do students actually learn more by participating in games?” In order to find out the answers to these questions they conducted the following experiment. In a number of classes instructors were asked to proceed with their normal lecture over certain content (control group), and in a number of other classes, instructors used a game that was developed to teach the same content (experimental group). The students were issued a test at the end of the semester to see which group did better in retaining information, and to find out which method most motivated students to want to learn the material. It was determined that students were more motivated to learn by participating in the game, which proved the hypothesis. The other thing that stood out was that students who participated in the game actually remembered more of the content at the end of the semester than those who listened to a lecture. You might have hypothesized these conclusions yourself, but until research is done, our assumptions are just that (Hunt, Lippert & Paynton).
Case In Point
Quantitative Methods In Action
Wendy S. Zabada-Ford (2003) conducted survey research of 253 customers to determine their expectations and experiences with physicians, dentists, mechanics, and hairstylists. Her article, “Research Communication Practices of Professional Service Providers: Predicting Customer Satisfaction and Loyalty” researched the perceptions of customers’ personalized service as related to their expectations in order to predict their satisfaction with the actual service they received. In this study, the goal was to be able to predict the behavior of customers based on their expectations before entering a service-provider context.
Michael T. Stephenson’s (2003) article, “Examining Adolescents’ Responses to Anti-marijuana PSAs” examined how adolescents respond to anti-marijuana public service announcements in the U.S. On the surface, this study may fit into the “understanding” part of the continuum of intended outcomes. However, this research can be used to alter and change messages, such as PSAs, to produce behavioral change in the culture. In this case, the change would be to either keep adolescents from smoking marijuana, or to get them to stop this behavior if they are currently engaged in it.
- Survey Research is used to ask people a number of questions about particular topics. Surveys can be online, mailed, handed out, or conducted in interview format. After researchers have collected survey data, they represent participants’ responses in numerical form using tables, graphs, charts, and/or percentages. On our campus, anonymous survey research was done to determine the drinking and drug habits of our students. This research demonstrated that the percentage of students who frequently use alcohol or drugs is actually much lower than what most students think. The results of this research are now used to educate students that not everyone engages in heavy drinking or drug use, and to encourage students to more closely align their behaviors with what actually occurs on campus, not with what students perceive happens on campus. It is important to remember that there is a possibility that people do not always tell the truth when they answer survey questions. We won’t go into great detail here due to time, but there are sophisticated statistical analyses that can account for this to develop an accurate representation of survey responses.
- Content Analysis. Researchers use content analysis to count the number of occurrences of their particular focus of inquiry. Communication researchers often conduct content analyses of movies, commercials, television shows, magazines, etc., to count the number of occurrences of particular phenomena in these contexts to explore potential effects. Harmon, for example, used content analysis in order to demonstrate how the portrayal of blackness had changed within Black Entertainment Television (BET). She did this by observing the five most frequently played films from the time the cable network was being run by a black owner, to the five most frequently played films after being sold to white-owned Viacom, Inc. She found that the portrayal, context and power of the black man changes when a white man versus a black man is defining it. Content analysis is extremely effective for demonstrating patterns and trends in various communication contexts. If you would like to do a simple content analysis, count the number of times different people are represented in photos in your textbooks. Are there more men than women? Are there more caucasians represented than other groups? What do the numbers tell you about how we represent different people?
- Meta-Analysis. Do you ever get frustrated when you hear about one research project that says a particular food is good for your health, and then some time later, you hear about another research project that says the opposite? Meta-analysis analyzes existing statistics found in a collection of quantitative research to demonstrate patterns in a particular line of research over time. Meta-analysis is research that seeks to combine the results of a series of past studies to see if their results are similar, or to determine if they show us any new information when they are looked at in totality. The article, Impact of Narratives on Persuasion in Health Communication: A Meta-Analysis examined past research regarding narratives and their persuasiveness in health care settings. The meta-analysis revealed that in-person and video narratives had the most persuasive impacts while written narratives had the least (Shen, Sheer, Li).
Outcomes of Quantitative Methodologies
Because it is unlikely that Communication research will yield 100% certainty regarding communicative behavior, why do Communication researchers use quantitative approaches? First, the broader U.S. culture values the ideals of quantitative science as a means of learning about and representing our world. To this end, many Communication researchers emulate research methodologies of the physical sciences to study human communication phenomena. Second, you’ll recall that researchers have certain theoretical and methodological preferences that motivate their research choices. Those who understand the world from an Empirical Laws and/or Human Rules Paradigm tend to favor research methods that test communicative laws and rules in quantitative ways.
Even though Communication research cannot produce results with 100% accuracy, quantitative research demonstrates patterns of human communication. In fact, many of your own interactions are based on a loose system of quantifying behavior. Think about how you and your classmates sit in your classrooms. Most students sit in the same seats every class meeting, even if there is not assigned seating. In this context, it would be easy for you to count how many students sit in the same seat, and what percentage of the time they do this. You probably already recognize this pattern without having to do a formal study. However, if you wanted to truly demonstrate that students communicatively manifest territoriality to their peers, it would be relatively simple to conduct a quantitative study of this phenomenon. After completing your research, you could report that X% of students sat in particular seats X% of times. This research would not only provide us with an understanding of a particular communicative pattern of students, it would also give us the ability to predict, to a certain degree, their future behaviors surrounding space issues in the classroom.
Quantitative research is also valuable for helping us determine similarities and/or differences among groups of people or communicative events. Representative examples of research in the areas of gender and communication (Berger; Slater), culture and communication (McCann, Ota, Giles, & Caraker; Hylmo & Buzzanell), as well as ethnicity and communication (Jiang Bresnahan, Ohashi, Nebashi, Wen Ying, Shearman; Murray-Johnson) use quantitative methodologies to determine trends and patterns of communicative behavior for various groups. While these trends and patterns cannot be applied to all people, in all contexts, at all times, they help us understand what variables play a role in influencing the ways we communicate.
While quantitative methods can show us numerical patterns, what about our personal lived experiences? How do we go about researching them, and what can they tell us about the ways we communicate? Qualitative methods have been established to get at the “essence” of our lived experiences, as we subjectively understand them.
