Critical Evaluation of Sources

The questions every source has to answer before it earns a place in your literature

Reading is not the same as evaluating

Many PhD researchers read fast — but accept too easily. The critical question is not "do I understand this paper?" It's "should I trust this paper to do work in my thesis?"

That trust is earned by answering three questions before any source enters your literature.

💬 Before we go further

When you read a paper this week, did you ask yourself "is this argument actually defensible?" — or did you absorb it because it was published?

Most early-stage PhDs default to acceptance because the paper is in print. Critical evaluation is the move that makes you a researcher, not a reader.

The three questions

  1. What is the claim, and how strong is the evidence for it?
  2. What does the source assume that you might not?
  3. What does the source NOT cover that you'd expect — and why?
💬 Quick reflection

Of those three, which one do you find hardest to answer when reading? Most researchers answer #2 or #3 — assumptions and silences are harder to see than claims.

A worked example

📄 Source

Putnam, R. (2000). Bowling Alone. Argues American civic life has declined since the 1960s, evidenced by falling participation in voluntary associations (bowling leagues, PTA, civic clubs).

💬 Try the three questions on Putnam

1. What's the claim and how strong is the evidence?
2. What does Putnam assume that you might not?
3. What does Putnam NOT cover that you'd expect?

Speak each one aloud before clicking the reveal.

1. Claim and evidence: The decline narrative is supported by survey data on traditional associations — strong on those metrics, weaker on the assumption that traditional associations are the right indicator of civic life.

2. Assumption to challenge: Putnam treats face-to-face civic engagement as the gold standard. He assumes online communities, identity-based organising, or informal mutual aid don't count. A 21st-century researcher might disagree.

3. What's missing: Almost no engagement with race or class as variables. The data is largely undifferentiated middle-class America. A researcher on diaspora or marginalised communities would flag this immediately.

Notice: each answer is specific. "It's biased" is not evaluation. "He treats face-to-face engagement as the gold standard and ignores online and informal forms" — that is.

✍ Now you try

Pick a paper you've read this week. Apply the three questions. Write one sentence per question. Be specific — name the assumption, name the silence.

⚡ The shift

Reading without evaluation produces summaries. Reading WITH evaluation produces a position. Your thesis is your position.

The source audit — six dimensions

The three questions get you started. The audit goes deeper. Six dimensions every source has to be checked against — not all in detail every time, but enough that you'd notice if something was off.

1. Methodology How was the data gathered? Are the methods appropriate to the claim?
2. Evidence Is the evidence cited primary, secondary, or anecdotal? How much of it?
3. Scope What population, region, period does the claim apply to? How widely is it generalised?
4. Limitations Are limitations acknowledged? Are they downplayed or honestly faced?
5. Position Where does the author sit theoretically? What's their stake in the argument?
6. Reception How has the field responded — replicated, critiqued, ignored? Recent or out of date?
💬 Of the six, which is most often skipped?

In your experience, which dimension do PhDs most often forget when evaluating a source?

Reception (#6). Most researchers evaluate a source as if it exists in isolation. But a 1990 paper that has been heavily critiqued and superseded should not carry the same weight as one that has been replicated and built on. The reception of a source is part of its evidential strength.

Practical move: when you cite a foundational source, also cite ONE significant response to it. That shows you know how the field has handled the work.

Weak vs strong evaluation in writing

⚠ Weak

"Smith (2018) argues that X."

Pure summary. No audit visible. Reader has no way to judge whether Smith's claim deserves weight.

✓ Strong

"Smith's (2018) ethnographic study of three urban districts argues X — a finding partly corroborated by Lee's (2021) larger survey but contested on methodological grounds by Hassan (2023), who notes the absence of comparative cases."

Methodology, scope, reception all visible. Reader knows where Smith sits in the field.

✍ Try it now

Take a source from your literature. Write a single sentence that includes: the claim + the methodology + at least one piece of reception (a corroboration or a critique).

⚡ The compression

One sentence with method + claim + reception is worth a paragraph of pure summary. It tells the reader you've audited the source.

The citation card — capture evaluation alongside the note

Evaluation is only useful if you can find it again two years later. The discipline is to capture your evaluation IN your note, not in your head.

The Cornell + Zettelkasten lesson taught you to write atomic notes. The Linking lesson taught you to link them. This lesson adds one more layer — the citation card: an evaluation alongside every source.

202405-04-A
Source: Putnam, R. (2000). Bowling Alone: The Collapse and Revival of American Community. Simon & Schuster.
Central claim: US civic engagement has declined since the 1960s, with consequences for democratic health.
Methodology: Quantitative — large-scale survey data on participation in voluntary associations.
Strengths: Foundational, longitudinal data set; widely cited.
Limitations: Treats traditional associations as proxy for ALL civic engagement; minimal racial/class differentiation.
Position: Mainstream liberal-democratic; assumes face-to-face engagement is the standard.
Reception: Foundational status; significant critiques include Skocpol on missing organisational forms, Crawford on race-blind data.
My use: Cite for the decline narrative; pair with critique to show why I extend rather than accept the framework.
💬 What does the card give you?

Read the card again. What can you do with it that you couldn't do with a one-line note?

Three things:

  1. You can write a literature review paragraph straight from it — every line is thesis-ready prose.
  2. You can defend your use in viva — the "My use" line tells future-you why this source matters and how you're handling its limitations.
  3. You can notice when the source no longer serves you — if the field has moved on, the reception line will tell you.
✍ Build a citation card for one of your sources

Pick one paper you cite often. Fill in each row.

💬 Honest check

Was there a row you couldn't fill? Which one? That's the row that tells you what's missing in your reading of this source.

⚡ Compound interest

One citation card per important source. By the end of year 2, you'll have 80–120 cards. Your literature review writes itself — you'll just sequence the cards.

Apply to your reading — live

Now we put it into practice on YOUR thesis. Pick a paper. Audit it. Build the card. Position it.

💬 Pick the source

Name a paper you've cited (or plan to cite) in your literature review. Author, year, central claim — say it aloud.

✍ Step 1 — The three questions
✍ Step 2 — The six-dimension audit
✍ Step 3 — The "My use" line

This is the most important line. Why are you citing this source? What does it do for your argument? How are you handling its limitations?

💬 Read it back

Read your "My use" line aloud. Does it sound like a reason — or like an excuse? If it sounds like "because everyone cites this," the audit isn't done. A strong "My use" line names what the source does in your thesis.

Before closing this lesson

⚠ Watch for this

The audit sometimes reveals a source you've been leaning on isn't strong enough to support what you're using it for. That is the audit doing its job. Don't ignore the finding because it's inconvenient. Replace the source or qualify your claim.

The viva test — defending your sources

The viva panel will not just ask you to summarise your sources. They will ask you to defend your selection. The questions below are real — examiners use versions of these constantly.

Speaking time
2:00
🎓 Viva question 1

"Why did you rely so heavily on Source X when Critic Y has challenged its central methodology?"

💬 The strong answer template

Three moves: (1) acknowledge the critique; (2) explain what Source X still gives you that the critique doesn't undermine; (3) name how you've qualified the use in your thesis.

"I take the methodological critique seriously — Critic Y is right that the original survey design treats traditional associations as a proxy for civic life as a whole. But what Source X still gives me is the longitudinal data on those traditional associations, which is foundational for the decline narrative regardless of the proxy concern. In Chapter 3 I cite Source X for the temporal pattern alone, and explicitly draw on Y's critique when I extend the framework to include online and informal forms."

Notice: not defensive. Acknowledges the critique, narrows the use, and shows how the limitation has been handled in the thesis itself.

🎓 Viva question 2

"Your literature is heavily weighted toward [a particular tradition]. What sources have you deliberately chosen NOT to engage with, and why?"

💬 Why this question is dangerous

Examiners ask this to test whether your selection is principled or accidental. The bad answer is "I hadn't thought about it." The strong answer names the alternative tradition, explains the reason for the boundary, and acknowledges what's lost by drawing it.

✍ Draft your answer (60 seconds, then say it aloud)
🎓 Viva question 3

"If you could only keep five sources from your literature review, which would they be — and why?"

💬 What this reveals

This question forces you to name your load-bearing literature. If you've evaluated each source properly, you'll know within seconds which five your thesis cannot do without. If you haven't, you'll panic.

Try answering it now. The answer is your literature review's spine.

Take this away

Three things to do before next lesson:

  1. Build citation cards for your five load-bearing sources. Every row filled.
  2. For one source you've been heavy-handed with, rewrite the "My use" line until it's defensible — or replace the source.
  3. Identify one tradition you're not engaging with and write the principled reason why. Not "I haven't read it" — a real boundary.

Bring all three to next lesson. We'll pressure-test the cards as if the viva were tomorrow.

⚡ The hidden lesson

Critical evaluation is not skepticism. It's curatorship. You're not trying to demolish every source — you're deciding which ones earn a place in your thesis and on what terms.