Combining Qualitative and Quantitative Research for the Best Results

This blog post provides a basic overview of qualitative and quantitative research tools, outlining the benefits and drawbacks of each. It goes on to explain how the two can be combined via a qualitative survey to reliably collect and effectively present data. It also explains how to analyze rich, qualitative data using mixed methods.

Qualitative vs. quantitative

Qualitative research and quantitative research are different paths that can be taken to answer similar questions. It simply depends on the angle of your qualitative and quantitative research methods for the project.

While quantitative research methods typically lend themselves more towards statistical analysis than qualitative research methods do, it is possible to convert quantitative data analysis methods to be used for qualitative research. Meaning neither method is better than the other. They're both essential for understanding people and behaviors.

However, with advances in natural language understanding and browser-based technology, new platforms are coming online, like Loops, which give you the best of both - the speed and scale of a quantitative study with the depth and discovery usually obtained from qualitative surveys.

What is qualitative research?

In the simplest terms, qualitative research seeks to understand the 'why', like "Why do people feel this way about X, Y, and Z?". Qualitative surveys can teach you about people's feelings, and depending on your research design/research objective, it can offer insight into certain behaviors and the emotional stance of your target audience through thematic analysis.

The resulting data from qualitative methods isn't as easy to structure or layout as quantitative survey data, and it is often recorded as speech, video, or captured text. It's written in the target audience's own words. These unstructured responses are because qualitative survey questions are deliberately open-ended to encourage exploration of peoples' perspectives and nuanced human behaviors through discourse analysis. The more open ended the qualitative survey questions are, the more qualitative data you can potentially collect.

Because of this, qualitative data comes in many shades of gray, and is therefore difficult to analyze or group, however the resulting insights are often rich with new ideas and hidden opportunities for improvement.

Insights aren't normally derived from gathering numerical data but rather from analyzing participant feedback, like from user research interviews, observations of a user performing tasks, or from focus groups. These insights are clustered together to either prove or disprove a hypothesis.

Qualitative methods can be costly and time consuming, but the benefits are worth it when you need to unlock what makes people tick at an emotional level.

What are the basics for running an effective qualitative research project?

A clear goal for your qualitative study - what are you trying to identify by conducting research this way? What's your hypothesis? This should guide how you draft your research survey questions, and how you plan to collate your data and structured observations.

Recruitment of participants - it makes sense to only recruit those who match your target audience, or display certain behaviors, right? However, they all must display the same traits or behaviors in order for the data to be valid.

The right environment - somewhere where participants feel comfortable talking openly. This can be in person or via a digital platform, solo or as a group.

A way to collect data - have you considered social research methods? Semi-structured interviews? What about online surveys? It's also crucial to understand the importance of methods to collect qualitative data, as this will provide deeper insights into participant behaviors and motivations.

Data synthesizing resources - you will need to convert your unstructured data into clear and easy-to-digest results. Without help, this complex step will require a lot of manual effort and researcher intuition in order to sift through all the qualitative data. However, there are software based solutions which use machine learning to speed up the process, but you'll need to shop around as data quality can vary.

The ability to ask solid open-ended questions will take you a long way in qualitative studies, as will simply asking "Why?" a lot.

Being as familiar as possible with the topic of discussion is key, as is having an empathetic ear. Putting your participants at ease will increase the quality of your data, which should make it easier to draw conclusions later on.

6 examples of qualitative research methods:

Focus groups are small discussion groups in which people talk about a product with open ended questions. For example, 10 people in a moderated setting discussing pain points and new ideas related to using a new smart TV model.

Field studies are real time, in-person observations (e.g. observing how customers interact with staff in a retail setting.)

Surveys can provide quick, succinct, to-the-point feedback, and can be repeated later during your research to compare how participant sentiments and feelings may have changed. An online survey has the benefit of being able to be drafted and set live within minutes.

Diary studies are when participants keep written records of their personal experience during the study. This is narrative research and is sometimes referred to as an ethnographic. Narrative research is a particularly interesting qualitative method because it often reveals the clearest and most reliable data. This is due to factors native to this type of qualitative inquiry. Namely the combination of the privacy of the written medium, which helps prevent outside influences affecting the data, and the diary format, which allows for a new level of complexity to the insights to be gathered. However, this does inevitably come with the drawback of increased difficulty in the qualitative data analysis of this particular group.

User interviews help you find out what participants think face-to-face. They answer your questions and provide insight and inspiration.

Social listening is great for quick and easy observation of larger groups. Social media listening platforms can provide many variations of both quantitative and qualitative approaches to gathering insights on areas that interest you. The catch? You cannot ask questions, but the upside is big data at your fingertips with minimal effort and time spent.

Disadvantages of qualitative research

Cost and time of qualitative data analysis

Qualitative research methods are not always feasible thanks to the long timelines and high costs involved. This is why it's often qualitative methods that are commonly reserved for high-value data collections, while quantitative research and mixed methods research is more common for other cases.

Participant recruitment

Not only can conducting your qualitative research take time, but setting it up can too.

Finding the right participant pool can be time consuming as you first need to find them, but also screen them to ensure they're the right fit for your social research methodology. If you already have access to existing customers, this can be a good option, assuming you'll be allowed access.

Human factors

Like with any scientific research or strategy in any study, there are always multiple variables at play.

It can be hard to do qualitative research consistently when you are the one who asks questions. You might repeat a study, but might not capture the data in the same way. Qualitative researchers are not robots, and even something like being unconsciously impatient because you're hungry can compromise the data collection and analysis.

Subjectivity

The qualitative research process is subjective. This means that the interpretation of data by qualitative researchers can be influenced by personal feelings and beliefs, which may not always provide an accurate representation of reality for all people in a particular group, or situation.

Advantages of qualitative research

Depth

Qualitative research allows you to explore complex phenomena and gain rich insight because of generally smaller participant numbers, the common use of open ended questions, and the ability to drill down into interesting areas as they appear.

Discovery

The conversational nature of qualitative surveys throw up personal, cultural, or social nuances such as issues and attitudes around gender, race, class, etc. that may never have been on the agenda, but are nonetheless very important behavioral considerations.

What is quantitative research?

Quantitative research is best known as quantifying participant responses into numerical data followed by statistical analysis of the data collected. Quantitative research examples include typical statistical methods of analysis like bar charts, percentages, tables.

It's a great way for researchers to get a clear idea of what large groups of individuals think, how they behave, identify causal relationships and generalize results from a larger sample population. Methods to collect quantitative data, such as conducting quick polls and surveys in online communities, are crucial for gathering in-depth insights and exploring behavior based on qualitative findings.

What basics do I need to run effective quantitative research?

A measurable hypothesis - before you start, you need to know what your quantitative research relies on. It relies on first defining a measurable hypothesis, so that you can ensure that your quantitative data collection process is going to work.

Large sample size - typically speaking, if you're doing a survey, you want 300+ respondents so that your results are statistically significant.

Data collection method - this depends on the data you want to gather. The most flexible approach is to create a survey, but there are also more sophisticated tools like usability testing platforms, which allow you to identify how respondents interact with products.

Analysis resources - many online platforms will do the analysis for you and allow you to create visualizations and reports. However, don't forget about trusty old Excel.

What skills and experience should someone have for conducting quantitative research?

You really don't need to have done any specific educational research on quantitative research study. It essentially comes down to your understanding of basic statistical techniques and scientific methods. Things like analysis software (e.g. Excel), and the ability to interpret numerical data through a standard analysis process to build narratives and craft structured observations/insights from this data.

3 examples of quantitative research methods:

Survey research is a simple and incredibly powerful data collection and analysis method because it enables you to expedite data collection and understand the opinions of thousands of people within a small research timeframe.

Website analytics allow you to see what your site visitors are doing. It's possible to know how far users get through your content and where they leave, informing changes for future readers.

Usability testing is an important step in product development. It helps ensure your final solution will meet user needs and expectations, while also uncovering any potential problems before you make large time and monetary investments.

Disadvantages of quantitative research

Rigid insights

A quantitative method can provide insight into the 'what' and the 'how', but not necessarily the 'why'. This is due to the lack of open-ended questions and one-way dialogue. Quantitative research relies on various methods like frequency analysis and other techniques to identify trends and patterns from existing data.

Lacks deeper learning

In its pursuit of concrete, statistical data, quantitative research can lead researchers to overlook broader themes and relationships. Staring at the little numbers, analyzing numerical data, can risk missing the bigger picture.

Requires careful foresight

You'll need a specific question for your research, but it can be hard to rely on subjectivity as the basis for what data should be collected.

Advantages of quantitative research

Scale

This kind of research can be conducted very reliably because there is a set quantitative research design, meaning data and circumstances can be easily replicated time and time again.

Rapid analysis

Interpretation of data can be straightforward and less open to judgment, and with the right software, you could be presented with the results of your quantitative research within a matter of hours.

What is the difference between qualitative and quantitative research in terms of sample size?

Sample numbers are often much bigger in quantitative research. Here are some examples of research participant numbers for both qualitative methods and quantitative methods:

A/B test - 1000 minimum, but ideally 10,000

Survey - 300 minimum

Focus group - 10 minimum

User interviews - 10 minimum per person

Usability test - 5 minimum

Why use both research methods?

Mixed methods research is a combination of open ended qualitative data collection methods and numerical quantitative survey data, which ensures that the limitations of one process is balanced by the strengths of the other. Conducting mixed methods research involves several steps and procedures, such as defining the research question, collecting both qualitative and quantitative data, and integrating the results to draw comprehensive conclusions.

For example, follow up questions in a qualitative survey can counteract the rigidness of quantitative data. The integration of quantitative and qualitative data through methods like joint displays and triangulation is crucial to gain a more nuanced understanding of the research question. Using both qualitative and quantitative data allows researchers to produce insights that go beyond what can be acheived by analyzing each type of data separately.

How do you conduct a qualitative survey?

The traditional way of creating qualitative surveys (simplified):

1. Find a suitable tool e.g. Google Forms (free and very flexible).

2. Build a text based questionnaire / form.

3. Test your test (e.g. gather feedback from colleagues to find any blind spots in your questions).

4. Revise your questionnaire / form content based on the feedback.

5. Recruit quality respondents and send.

Loops is the new way to combine qualitative and quantitative research

A key difference between Loops and traditional qualitative surveys is that Loops uses visual inputs and annotations to collect numerical data from what is essentially non numerical data. This is because these often deliver clearer answers and highly actionable insight.

1. Adding visual inputs engages your respondents and increases response rates - too much text is overwhelming and creates survey fatigue.

2. Build questions using a combination of likert scale and open ended question types - the perfect balance of 'what' and 'why'.

3. You can choose your audience - our platform connects you to over 110 million people so that you can specify the ideal participants.

4. Each participant answers each question by annotating the visual stimulus. This UX makes it easy for them to comment and easy for you to understand (low cognitive overhead).

5. You capture 1000s of comments from respondents on your research stimulus (qualitative data) and use natural language understanding to translate it all into easy to understand stats (quantitative data).

6. Measure the 'what' (numerical data) against the 'why' (open-ended data) with direct-from-audience feedback.

Our exciting hybrid research method provides new ways to target participants and explore their attitudes with speed, scale, depth, and discovery.