Galedra
Sign in Sign up

Claim

In the Nepal and Philippines delivery experiments, phone-call tutoring improved learning by 0.40 operation levels with government teachers and 0.30 operation levels with NGO teacher aides.

Type COMPARATIVE · truth-evaluable: yes · status at snapshot: ACTIVE · created seq 14707 · qualifiers {"population":"Primary-school children in the Nepal and Philippines delivery-model experiments.","denominator":"Pooled results across the two delivery-model contexts; operation-level learning outcome."}

26 words; atomic claims are usually under 25a conjunction joins clauses that may be separately evaluable

Referenced 89 times: checked 1, looked up by assistants 1, viewed 64, shared 23. A count of attention, not evidence.

Topics

Education · 1efd24fe Economics · 1efd24fe

Assessment

Supported

Score: 0.8161 under ledger-default@0.3.0 at snapshot 27745

3 of 4 review checks done · 1 counted · 2 by the author only

2 independent evidence lineages · review checks 1 of 4 · stability MEDIUM

Main unresolved issue: 7 counted evidence items have no independence review; repeats of one origin may be counted as several coverage:24699160-3023-8894-a712-63414cdb230a

Not yet independently audited.Evidence points both ways.Evidence reviewed so far supports this claim, but only 1 of 4 review checks has been done.Every quoted passage was confirmed on the page when Galedra fetched it.

Why?

Strongest counted support: The delivery comparison directly reports 0.40 operation levels for government teachers and 0.30 for NGO aides. weight 2.000000 evidence

Strongest counted contradiction: A randomized Sierra Leone trial found no learning-score effect from calls by either private or government teachers. weight 0.510000 evidence

Suppressed as dependent: The excerpt directly reports pooled learning improvements of 0.40 operation levels for government teachers and 0.30 for NGO teacher aides.

Review gaps: qualifiers reviewed, opposing search done, independence reviewed

What would most change this: One independent, direct measurement that contradicts this claim would move it from Supported to Leans contradicted.

Hide calculation

0.8161 under ledger-default@0.3.0 at snapshot 27745 · state Supported · Review checks: 1 of 4 · stability MEDIUM · 7 sources, 2 independent lineages

Model ledger-default@0.3.0 (the default model, not the answer) · snapshot 27745 · trace sha256:81d6adcd2f090444dc05da92b041b6af22309fee2c68d9369a08a48b0cbafe2f

Last changed at entry seq 15150; nothing logged since has borne on this claim.

How the number was reached

Each counted link is weighed by multiplying the factors the model declares; a factor it does not declare is not shown. Every factor name below links to what that number means.

LinkWorkingWeightCounted as
7e2d9b60 qualify relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.540000 0.000000 (non directional)
4a2c813d qualify relevance MODERATE 0.6 × observation DIRECT_TEXT 0.9 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.459000 0.000000 (non directional)
2d84fa49 support relevance DIRECT 2.0 × observation DATASET_RESULT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 0.000000 (dependent strongest only, kept 74c6dbfa)
3c554cd9 qualify relevance DIRECT 2.0 × observation MEASUREMENT 1.0 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 2.000000 0.000000 (non directional)
74c6dbfa support relevance DIRECT 2.0 × observation MEASUREMENT 1.0 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 2.000000 2.000000
37355003 contradict relevance MODERATE 0.6 × observation MEASUREMENT 1.0 × interpretation 1 step, 1 − 0.15 × 1 0.850000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 0.510000 0.510000
071c8af3 qualify relevance DIRECT 2.0 × observation DIRECT_TEXT 0.9 × interpretation 0 steps, 1 − 0.15 × 0 1.000000 × authenticity UNVERIFIED 1.0 × extraction UNVERIFIED 1.0 × provenance INDEPENDENT 1.0 × edition NAMED_OR_UNRELATED 1 1.800000 0.000000 (non directional)

prior 0.50 → log-odds 0.000000 + 1.490000 (the counted weights) = 1.490000 → probability 0.8161

Under neighbouring settings of the same model: 0.7394 to 0.8740, a spread of 0.1346.

Half-even rounding, six places for weights and four for the probability. The same inputs under the same model reproduce this exactly; that is what the trace hash above is for. How a score is worked out explains every factor, why it is there, and what the model sets it to.

Your view

Sign in to register whether you agree or disagree. A view is yours alone and never changes the assessment.

Registered views

Nobody has registered a view yet.

Registered views are personal belief, not evidence: they never change Galedra's assessment. Affiliations are self-declared and shown only for groups of 5 or more.

Checked as part of

Statements this claim was broken out of. The claim is scored on its own; a statement's reading only counts its claims.

Evidence for

Evidence against

Qualifications

Suppressed as dependent

EvidenceGroupKept instead
dcc8a88874c6dbfa

Inferences

Concluded from

None.

Used as a premise in

None.

An inference is interpretation, not evidence: it never changes the assessment of its conclusion. Each premise is a claim with its own evidence.

Threads

None. Threads are for disagreements about how a determination was made — a statement whose figures are not in the passage it rests on, two sources that may share an origin. Something about the world belongs in the evidence above.

Claim edges

None. Edges are stored and displayed; v0.1 does not propagate probability across them.

Review checklist

Review checks: 1 of 4

3 checks by this claim's own author, alongside the independent review above. 1 OPPOSING EVIDENCE SEARCH · 1 QUALIFIER CHECK · 1 EVIDENCE VERIFICATION. A check by the person who recorded a claim does not raise its review coverage.

CheckDoneBy
qualifiers reviewedno
opposing search doneno
independence reviewedno
primary source reviewedyes7e2d9b60, 4a2c813d, 2d84fa49, 3c554cd9, 74c6dbfa, 37355003, 071c8af3

Summary

Supported. The main support is: The delivery comparison directly reports 0.40 operation levels for government teachers and 0.30 for NGO aides. 44756efd

Against that, contradiction: A randomized Sierra Leone trial found no learning-score effect from calls by either private or government teachers. 16e10697

1 further item repeats the same origin and is not independent evidence. dcc8a888

Qualifier: The Nepal and Philippines trials occurred amid COVID-19 school disruption and lengthy closures. 437a6a6f

Qualifier: The Sierra Leone authors attribute the differing result partly to radio-linked, less personalized call instruction. 68418cee

Qualifier: The 0.40 and 0.30 operation-level effects are pooled across Nepal and the Philippines, not separate country estimates. 38cdc9a5

Generated by stub-v0.1; every sentence cites graph ids.

Contribution history

seqeventdetail
14707APPENDED
14708ACCEPTAUTOMATIC_AFTER_VALIDATION
14717LINK_EVIDENCEby 1efd24fe (accepted)
14742TASK_RESULTby 1efd24fe (accepted)
14941TASK_RESULTby 1efd24fe (accepted)
15149TASK_RESULTby 1efd24fe (accepted)

Score trace

{
  "claim": "24699160-3023-8894-a712-63414cdb230a",
  "links": [
    {
      "link": "0fa067c3-e251-8dc4-b93c-562a7e2d9b60",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "0edb8d7c-a0f5-8448-977c-183a437a6a6f",
      "direction": "QUALIFY",
      "magnitude": "0.540000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "149191bd-c67e-811a-af87-a9cb4a2c813d",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "6fc496ba-d7c0-809d-a17a-d51568418cee",
      "direction": "QUALIFY",
      "magnitude": "0.459000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 1
    },
    {
      "kept": "5d3e67ff-82b7-82be-b652-685074c6dbfa",
      "link": "39b0bcf5-f141-8591-bad4-acab2d84fa49",
      "group": null,
      "reason": "dependent_strongest_only",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "536222bf-a437-8fc9-87fa-29e0dcc8a888",
      "direction": "SUPPORT",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DATASET_RESULT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "4916d807-d909-8286-acf5-f1143c554cd9",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "4df154ad-bd83-8806-a1de-cb7938cdc9a5",
      "direction": "QUALIFY",
      "magnitude": "2.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    },
    {
      "link": "5d3e67ff-82b7-82be-b652-685074c6dbfa",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "02f773f8-71d5-8b9d-b303-d59144756efd",
      "direction": "SUPPORT",
      "magnitude": "2.000000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "2.000000",
      "interpretive_steps": 0
    },
    {
      "link": "6b84cc96-f199-82f7-be1e-d14c37355003",
      "group": null,
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "f1479c05-9b56-8163-891e-0c0e16e10697",
      "direction": "CONTRADICT",
      "magnitude": "0.510000",
      "relevance": "MODERATE",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "MEASUREMENT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.510000",
      "interpretive_steps": 1
    },
    {
      "link": "ed1e2f0a-a8ef-84eb-9dc3-1924071c8af3",
      "group": null,
      "reason": "non_directional",
      "edition": "NAMED_OR_UNRELATED",
      "evidence": "49d87d86-a254-8752-8018-f9a1dcee575f",
      "direction": "QUALIFY",
      "magnitude": "1.800000",
      "relevance": "DIRECT",
      "extraction": "UNVERIFIED",
      "provenance": "INDEPENDENT",
      "observation": "DIRECT_TEXT",
      "source_type": "PRIMARY_TEXT",
      "authenticity": "UNVERIFIED",
      "audit_confirmed": false,
      "effective_weight": "0.000000",
      "interpretive_steps": 0
    }
  ],
  "model": "ledger-default@0.3.0",
  "prior": "0.50",
  "variants": {
    "spread": "0.1346",
    "permissive": "0.8740",
    "conservative": "0.7394"
  },
  "code_hash": "sha256:c61a6fdf35a754a0d7e958df149036a083c0eaeb7d2d2e52704ec32b0c36def7",
  "contested": true,
  "stability": "MEDIUM",
  "claim_type": "COMPARATIVE",
  "config_hash": "sha256:86768038080b8ab5233f1e4b7aba10af05b5bb44caa432095150b90e81209809",
  "probability": "0.8161",
  "provisional": true,
  "evidence_sum": "1.490000",
  "snapshot_seq": 15150,
  "prior_log_odds": "0.000000",
  "support_groups": 1,
  "model_dependent": false,
  "review_coverage": "0.25",
  "truth_evaluable": true,
  "assessment_state": "SUPPORTED",
  "review_checklist": {
    "qualifiers_reviewed": {
      "by": [],
      "ok": false
    },
    "opposing_search_done": {
      "by": [],
      "ok": false
    },
    "independence_reviewed": {
      "by": [],
      "ok": false
    },
    "primary_source_reviewed": {
      "by": [
        "0fa067c3-e251-8dc4-b93c-562a7e2d9b60",
        "149191bd-c67e-811a-af87-a9cb4a2c813d",
        "39b0bcf5-f141-8591-bad4-acab2d84fa49",
        "4916d807-d909-8286-acf5-f1143c554cd9",
        "5d3e67ff-82b7-82be-b652-685074c6dbfa",
        "6b84cc96-f199-82f7-be1e-d14c37355003",
        "ed1e2f0a-a8ef-84eb-9dc3-1924071c8af3"
      ],
      "ok": true
    }
  },
  "contradict_groups": 1,
  "rounding_boundary": false,
  "posterior_log_odds": "1.490000",
  "not_applicable_reason": null,
  "independence_unreviewed": 7
}