This tool is donation based and free. 🙏 We're looking for donations to keep it running — $360/year covers our server costs.

$18 of $360 · 5%
Donate
This fact check is over a month old. Newer information may be available — consider rechecking.

Survey location affects results accuracy generally true

“I dislike shows where they "asked 100 people" because they don't tell you which 100 people it was. If I'm told they were asking people outside Lidl or something, that's going to affect my guesses”
Generally accurate
Confidence: High Checked on June 9, 2026

Summary

Surveys that sample only about 100 people are prone to high statistical uncertainty, and without information on who those respondents are, the results can be misleading. Knowing the demographic or situational context of the sample (e.g., shoppers outside a specific store) is essential for interpreting the findings correctly. Therefore, the concern about undisclosed sample composition affecting guesses is well‑founded.

Recheck this fact Runs a fresh check with up-to-date sources

Sources 60 searched

nature.com
  • Unrepresentative big surveys significantly overestimated US vaccine uptake | Nature

    As noted before, none of the surveys use the CDC benchmark to adjust or assess estimates of vaccine uptake. Table 2 illustrates some consequences of these design choices. Axios–Ipsos samples mimic the actual breakdown of education attainment among US adults even before weighting, whereas those of Census Household Pulse and Delphi–Facebook do not.

pmc.ncbi.nlm.nih.gov
bcsr.rutgers.edu
  • Assessing Poll Validity | Bloustein Center for Survey Research

    There is no universal rule to determine what makes a poll ‘valid.’ However, all public reports of survey findings should include reference to the following: · The key things to look for are sample size and corresponding margin of error (be cautious of results when the margin of error exceeds ...

research.usu.edu
  • Improved and Updated Questions - USU Office of Research

    for demographic questions, both research participants · and those reading about research will be able to see · themselves represented (Betz, 2020). Asking participants · to select options that do not represent them can lead to · frustration, marginalization, and also not knowing how · to respond (Hughes et al., 2016). This frustration can · decrease the number of participants willing to answer · certain questions or even take surveys (Hughes et al.,

sr.ithaka.org
  • When to Ask (or Not Ask) Demographic Questions - Ithaka S+R

    While not all survey takers share the anxieties outlined above, by including only essential demographic questions, such as those hypothesized to impact results or those that are central to the purpose of the survey, we can help ease participants’ concerns, increase response rates, and ultimately improve the usefulness of the data collected.

surveypractice.org
sciline.org
  • Surveys and polling - SciLine

    How many people were surveyed? The fewer respondents, the higher the statistical uncertainty in results. Generally speaking, 100 respondents is the minimum sample size necessary for a reportable result.

This fact check is free and donation-based. $1 powers ~30 fact-checks.

Donate $1 to support fact-checking

Check another fact