Survey location affects results accuracy generally true
âI dislike shows where they "asked 100 people" because they don't tell you which 100 people it was. If I'm told they were asking people outside Lidl or something, that's going to affect my guessesâ
Summary
Surveys that sample only about 100 people are prone to high statistical uncertainty, and without information on who those respondents are, the results can be misleading. Knowing the demographic or situational context of the sample (e.g., shoppers outside a specific store) is essential for interpreting the findings correctly. Therefore, the concern about undisclosed sample composition affecting guesses is wellâfounded.
Sources 60 searched
- Unrepresentative big surveys significantly overestimated US vaccine uptake | Nature
As noted before, none of the surveys use the CDC benchmark to adjust or assess estimates of vaccine uptake. Table 2 illustrates some consequences of these design choices. AxiosâIpsos samples mimic the actual breakdown of education attainment among US adults even before weighting, whereas those of Census Household Pulse and DelphiâFacebook do not.
- A Critical Assessment of Bias in Survey Studies Using ... - PMC
Checking your browser before accessing pmc.ncbi.nlm.nih.gov · Click here if you are not automatically redirected after 5 seconds
- Thirty-three myths and misconceptions about population data
Checking your browser before accessing pmc.ncbi.nlm.nih.gov · Click here if you are not automatically redirected after 5 seconds
- Assessing Poll Validity | Bloustein Center for Survey Research
There is no universal rule to determine what makes a poll âvalid.â However, all public reports of survey findings should include reference to the following: · The key things to look for are sample size and corresponding margin of error (be cautious of results when the margin of error exceeds ...
- Improved and Updated Questions - USU Office of Research
for demographic questions, both research participants · and those reading about research will be able to see · themselves represented (Betz, 2020). Asking participants · to select options that do not represent them can lead to · frustration, marginalization, and also not knowing how · to respond (Hughes et al., 2016). This frustration can · decrease the number of participants willing to answer · certain questions or even take surveys (Hughes et al.,
- When to Ask (or Not Ask) Demographic Questions - Ithaka S+R
While not all survey takers share the anxieties outlined above, by including only essential demographic questions, such as those hypothesized to impact results or those that are central to the purpose of the survey, we can help ease participantsâ concerns, increase response rates, and ultimately improve the usefulness of the data collected.
- Impact of demographic survey questions on response rate and measurement: A randomized experiment | Published in Survey Practice
While results may vary by survey mode, population, and topic, among other survey design factors, our results give confidence that the inclusion of these important questions in a mail survey does not bias our data.
- Sample size and uncertainty when predicting with polls: the shortcomings of confidence intervals | Published in Survey Practice
We propose that the impreciseness of the confidence interval can be partially overcome by asking a different question of the polling data: Given the percentage breakdown of poll results and its sample size, what is the probability that candidate M would receive more votes than candidate S, in the upcoming election. We should expect that M would win since she is apparently preferred by the electorate, but at what probability: close to certainty (probability close to 100%) or to the uncertainty of a coin toss (close to 50%).
- Surveys and polling - SciLine
How many people were surveyed? The fewer respondents, the higher the statistical uncertainty in results. Generally speaking, 100 respondents is the minimum sample size necessary for a reportable result.