Evaluating Sources & Fact Checking: Crash Course Scientific Thinking #6

Key Concepts

• Primary Source: The original, firsthand account of research conducted by the scientists themselves.
• Secondary Source: A report or interpretation of research created by someone who did not conduct the study (e.g., consultants).
• Tertiary Source: Summaries of primary and secondary sources, often written by non-scientists (e.g., news articles).
• Misinformation: Incorrect or misleading information, often resulting from honest mistakes.
• Disinformation: Intentionally false or misleading information designed to deceive.
• Lateral Reading: A fact-checking technique involving opening new tabs to verify the credibility of a source against other reputable outlets.
• SIFT Method: A digital literacy framework for evaluating information (Stop, Investigate, Find, Trace).

1. The Anatomy of a Science News Story

Science news often functions like an iceberg: the public sees only the "tip" (the headline), while the actual research exists below the surface. The video uses the example of the claim that humans ingest a "credit card’s worth of plastic" (5g) per week.

• The Chain of Information: The study originated from researchers at the University of Newcastle (Primary Source), was interpreted by the WWF (Secondary Source), and was then reported by CNN (Tertiary Source).
• Distortion: The original study provided a range of 0.1g to 5g of plastic ingestion. The WWF, an advocacy group, highlighted only the upper limit (5g) to create urgency for their mission. News outlets then amplified this single, extreme figure to generate clicks.

2. Understanding Motives and Goals

Evaluating the credibility of information requires understanding the goals of the publisher:

• Advocacy Groups (e.g., WWF): Their goal is to preserve nature; they may emphasize extreme data points to drive public concern and support for their lobbying efforts.
• News Organizations: Their goal is often to maximize engagement (clicks). Headlines that present a range (0.1g–5g) are less "clickable" than sensationalist claims about eating credit cards.

3. The SIFT Methodology

To navigate the internet, the video recommends the SIFT framework developed by Mike Caulfield:

1. S (Stop): When a headline triggers a strong emotional response, pause before sharing or reacting.
2. I (Investigate the Source): Determine who is publishing the information. Use lateral reading—checking media bias charts or other reputable sources to see if the publisher is generally trustworthy.
3. F (Find Better Coverage): Check if other reputable outlets are reporting the same findings. If they disagree or provide more context, treat the original source with skepticism.
4. T (Trace Claims to Original Context): Always click through to the primary source. In the microplastics example, tracing the claim revealed the "credit card" figure was merely the high end of a wide range, not the average.

4. Critical Takeaways

• Primary Sources are Paramount: Always prioritize the firsthand account of the researchers over news summaries.
• Beware of Generative AI: Tools like ChatGPT do not pass the SIFT test and should not be treated as reliable primary sources.
• Context Matters: A statistic taken out of context—even if technically "true" as an upper limit—can be fundamentally misleading.
• Reliability vs. Bias: Even reputable organizations can misrepresent data to serve an agenda. Critical thinking must be applied regardless of the source's general reputation.

Conclusion

The video concludes that while no method is foolproof, the SIFT method and lateral reading are essential "shields" against the tide of misinformation. By shifting from passive consumption to active "sifting," individuals can distinguish between sensationalized narratives and accurate scientific reporting. The ultimate goal is to recognize that reputation and motive are the most critical factors in determining the trustworthiness of any scientific claim.