Total Survey Design
Total Survey Design is a podcast for explaining the complexities of survey design. This podcast serves a diverse audience, including small business owners, nonprofits, industry professionals, academics, and students. Each season features 10 to 20 concise episodes, each lasting 5 to 20 minutes, covering topics from survey utility to sample sizes, and question design to total survey error. Episode content includes insightful discussions, expert interviews, and special event coverage to enhance your survey skills and understanding.
Episodes
In this episode I sat down with Thom to talk about surveys. We talked about his time at the Social and Economic Sciences Research Center, working with Don Dillman on various projects including the 2000 U.S. Census, some of his favorite projects, my dissertation survey, the application of the Tailored Design Method on a wide variety of cultures, and much more.
Find us online at: instagram.com/totalsurveydesign/
ht...
In this episode, we do a small retrospective on the first season. We also look ahead to see what is to come. We also give a call to action, seeking your support to ensure that this project continues to exist into the future.
If you would like to support us, you can do so by visiting our Ko-fi page at:
https://ko-fi.com/totalsurveydesign
Thank you.
In this episode, we explore essential considerations for crafting effective surveys. We begin by emphasizing the importance of defining the purpose of your survey, which serves as a guide through each step of its creation. We discuss how understanding your main goal—whether it's measuring customer satisfaction or academic variables—shapes your questions and improves data quality. Additionally, we highlight the significance of...
In this episode, we discuss the target population. We emphasize the importance of a well-defined target population, in context of the goal of your survey, and in relation to your sampling frame. We offer examples of target populations of various studies, and offer suggestions for the types of variables that you may want to consider when thinking about your target population.
In this episode, we interview James McCall, a survey methodologist at Westat. James shares what first drew him to surveys, and what drove him into a career of surveys. We talk about his role as a survey methodologist in industry. We discuss cognitive testing, data scripts, and other elements of the art and science of survey design. We also discuss our pet-peeves, such as matrix questions, check-all-that-apply questions, pre-testing...
In this episode, we explore the key design elements of effective surveys, emphasizing the importance of user-friendly experiences and reliable data collection. But first, in our free talk segment we discuss the compensation structure of the YouGov platform.
Then, we highlight practical tips like strategic question ordering, clear language use, and consistent visual design. Additionally, the episode discusses behavioral asp...
In this episode, we introduce a new free talk segment, where we discuss and celebrate Seon Yup's new job as chief survey methodologist at Kansas State University. We then explore why many people distrust surveys and some things we can do to regain their trust. We discuss key issues like sensitive topics, the impact of interviewer identity, and the prevalence of poorly designed surveys that fail to effect change. We also provid...
In this episode, we explore the costs associated with conducting surveys. We start by debunking the common misconception that surveys are free, highlighting the significant expenses involved in various survey methods—from internet to mixed-mode surveys which are needed to collect useful data. We explore the astronomical costs of large-scale efforts like the U.S. Census, which can reach billions, and contrast these with more modest ...
In our second episode focusing on sample design, we dive into the intricacies of creating a sampling frame. We explain what a sampling frame is and why it's crucial for ensuring your survey reaches the right target population. We discuss the four key elements of an ideal sampling frame: comprehensiveness, accuracy, specificity, and accessibility. Additionally, we highlight real-world examples and practical tips for researchers...
This episode is the second in a series of writing good survey questions, where we dive deep into the intricacies of response options for survey questions, a crucial component often overlooked in survey design. We explore the significance of well-constructed response options in enhancing data quality and the pitfalls of poorly designed ones that can lead to confusion. Our focus will primarily be on closed-ended questions, discussing...
In this episode, we delve into the art of crafting effective survey questions. We discuss the importance of clear and precise wording, avoiding biases, and the impact of question formats on data quality. Learn practical tips for designing questions that yield accurate and meaningful data, whether for academic research, market analysis, or feedback collection. Join us as we explore examples and demonstrate how to refine a simple que...
This episode is a tribute and commemoration of Don Dillman, who is known for his contributions to survey methodology, particularly the development of the Tailored Design Method (TDM) for conducting surveys. The episode reflects on his work as a professor and a mentor, his impact on our careers, and his legacy. Our unscripted conversation includes personal anecdotes, discussions on his methodologies, and a reflection on Don's i...
In this episode of the Total Survey Design Podcast, we explore the four main sources of survey error through the engaging story of Mario, a local pizzeria owner aiming to conduct an ethical survey. We delve into coverage error, sampling error, measurement error, and non-response error, explaining how each can distort survey results. By using Mario's quest to honestly determine if his pizzeria is the best in town, we illustrate...
In this episode of the Total Survey Design Podcast, we explore the fascinating concept of sample size and its impact on survey accuracy. Discover why just about 1000 responses can represent the views of millions, debunking common misconceptions about survey sampling. We'll dive into the key parameters for calculating sample size, such as margin of error, confidence level, predicted variance, and target population size. Learn h...
In this episode, hosts Seon Yup Lee and Azdren Coma explore the ways surveys can mislead us, inspired by the book "How to Lie with Maps." They discuss common survey pitfalls, from bad question design to poor sampling, and provide real-world examples, such as misleading questions in political surveys and biased sampling in product ratings. This episode, the first in a series, aims to uncover the frequent errors in surveys ...
In this episode of the Total Survey Design Podcast, Seon Yup and Azdren dive into the utility of surveys and their vital role in understanding public opinion and decision-making. They share examples, like A&W's marketing mishap with their third-pound burger, and the importance of surveys in evaluating high-cost programs. From business insights to educational improvements, surveys offer invaluable data that can guide better...
In this debut episode of "Total Survey Design," hosts Azdren Coma and Seon Yup Lee introduce listeners to the intricacies and importance of surveys. Exploring the basics of survey creation and analysis, they discuss their professional backgrounds and the podcast's goals, including helping various audiences—from small business owners to academics—master survey design. They outline the upcoming season, highlighting top...
Listen to this episode to get a preview of everything that the Total Survey Design podcast is all about.
Find us online at: instagram.com/totalsurveydesign/
https://taplink.cc/totalsurveydesign
Contact us at: totalsurveydesign@gmail.com
Popular Podcasts
Daniel Jeremiah of Move the Sticks and Gregg Rosenthal of NFL Daily join forces to break down every team's needs this offseason.
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
Listen to 'The Bobby Bones Show' by downloading the daily full replay.
Ding dong! Join your culture consultants, Matt Rogers and Bowen Yang, on an unforgettable journey into the beating heart of CULTURE. Alongside sizzling special guests, they GET INTO the hottest pop-culture moments of the day and the formative cultural experiences that turned them into Culturistas. Produced by the Big Money Players Network and iHeartRadio.
The Clay Travis and Buck Sexton Show. Clay Travis and Buck Sexton tackle the biggest stories in news, politics and current events with intelligence and humor. From the border crisis, to the madness of cancel culture and far-left missteps, Clay and Buck guide listeners through the latest headlines and hot topics with fun and entertaining conversations and opinions.