A transit search where a panel of independent reviewers marks dips in blind-coded light curves, consensus is skill-weighted, and every candidate keeps its provenance. Built to follow the Planet Hunters CHEOPS workflow.
Probes only; Sentinels not run on this example. Sentinels run on Claude (Anthropic) by default; other providers are supported and labelled. Probes are deterministic matched-filter detectors.
Thresholds, weights and every input are written to manifest.json, so a result can be rerun exactly.
Passed candidates are the catalogue. Rejected and flagged events are kept on purpose, so a reader can see what the vetting decided and why.
Every reviewer's answer for every blind-coded subject. Disagreement is kept visible, because it is where the consensus is earned.
| reviewer | label | marks (BTJD) | rationale |
|---|---|---|---|
| volunteer-sensitive | potential planet | 1368.825–1368.992, 1369.007–1369.045, 1371.097–1371.314, 1373.341–1373.375, 1373.388–1373.550, 1377.916–1378.090 | simulated detector |
| volunteer-typical | potential planet | 1368.825–1368.992, 1369.010–1369.046, 1373.339–1373.378, 1373.402–1373.554, 1377.904–1378.104 | simulated detector |
| volunteer-cautious | potential planet | 1368.855–1369.019, 1373.351–1373.381, 1373.412–1373.536, 1377.931–1378.072 | simulated detector |
| reviewer | label | marks (BTJD) | rationale |
|---|---|---|---|
| volunteer-sensitive | potential planet | 1355.126–1355.512, 1359.615–1359.996, 1364.126–1364.559, 1366.614–1366.734 | simulated detector |
| volunteer-typical | potential planet | 1355.174–1355.433, 1359.681–1359.986, 1364.191–1364.493 | simulated detector |
| volunteer-cautious | potential planet | 1355.233–1355.399, 1359.689–1359.928, 1364.135–1364.487 | simulated detector |
*Known false positive.* A TESS Object of Interest the TOI table dispositions as a false positive (FP): a 2.4% dip every 4.5 days.
Run runs/tess-toi-236-s2 (TESS SPOC 2-minute, sector 2; config configs/showcase/tess-toi-236-s2.toml, sha256 eef6f1318b3b1dac…; code v0.1.0-3-g0c029a2). Light curves: public TESS data from MAST tess2018234235059-s0002-0000000009727392-0121-s_lc.fits (sha256 35374d1f753db7ea…).
**Probes only; Sentinels not run on this example.** 6 dips (6 rejected).
A test SetuHQ must fail to pass: TOI-236.01 is in the real-TOI benchmark's false-positive set. The page says what the vetting did with it, whatever it did.
Source: NASA Exoplanet Archive, table toi, fetched 2026-10-19 (the real-TOI benchmark's frozen sample, sha256 6f0e111ec8d2c38d…).
| quantity | TOI table | SetuHQ |
|---|---|---|
| disposition | FP | Caught: all 6 dips on the TOI ephemeris were rejected by vetting (secondary_any_phase, secondary_eclipse), so none is a candidate. |
| period (d) | 4.53445 | 4.5358 (BLS) |
| depth (ppm) | 23,575 | 17,478 (box); 23,280 / 23,501 (fit, per signal) |
| Rp/R★ | 0.1411 / 0.1418 (fit, per signal) | |
| T14 (h) | 4.94 | 4.96 (fit) |
| transits predicted in the data / with a dip | 6 | 6 |
| dips on the ephemeris, by vetting outcome | 6 rejected | |
| vetting flags on those dips | `secondary_any_phase`, `secondary_eclipse` | |
| secondary eclipse at phase 0.5, SNR (vetting's search) | 10.9 |
Panel: volunteer-sensitive, volunteer-typical, volunteer-cautious
Weights: volunteer-cautious=0.633, volunteer-sensitive=0.667, volunteer-typical=0.667
Completeness is the fraction of injected transits recovered as a vetted candidate, with the consensus centred within half a transit duration of the injection.
| depth (ppm) | duration (h) | subjects | recovered | completeness |
|---|---|---|---|---|
| 300 | 1.0 | 20 | 0 | 0.00 |
| 300 | 2.0 | 20 | 0 | 0.00 |
| 300 | 4.0 | 20 | 0 | 0.00 |
| 1000 | 1.0 | 20 | 3 | 0.15 |
| 1000 | 2.0 | 20 | 16 | 0.80 |
| 1000 | 4.0 | 20 | 20 | 1.00 |
| 3000 | 1.0 | 20 | 20 | 1.00 |
| 3000 | 2.0 | 20 | 19 | 0.95 |
| 3000 | 4.0 | 20 | 20 | 1.00 |
False positives: 0.000 vetted candidates per empty subject (40 empty subjects).
| id | kind | weight |
|---|---|---|
| volunteer-sensitive | simulated | 0.600 |
| volunteer-typical | simulated | 0.600 |
| volunteer-cautious | simulated | 0.400 |
Skipped (unavailable here): none
eef6f1318b3b1dac…{
"setuhq_version": "0.1.0",
"created_at": "2026-10-22T17:40:42+00:00",
"python": "3.13.16",
"platform": "Linux-6.18.44-fc-v140-x86_64-with-glibc2.39",
"packages": {
"numpy": "2.5.4",
"scipy": "1.18.1",
"astropy": "8.0.2",
"matplotlib": "3.11.2",
"lightkurve": "2.6.0"
},
"config_name": "tess-toi-236-s2",
"config_sha256": "eef6f1318b3b1dacd92f63be5daccf0d45ee463fd30bda47d50bf77e3e778f4d",
"subject_days": 13.0,
"search_scope": "subject",
"claude_prompt_version": "2026-10-16.1",
"sentinel_prompt_version": "2026-10-16.1",
"inputs": [
{
"source": "MAST",
"author": "SPOC",
"sector": 2,
"exptime_s": 120,
"flux_column": "pdcsap_flux",
"time_unit": "BTJD",
"lightkurve_version": "2.6.0",
"file": "tess2018234235059-s0002-0000000009727392-0121-s_lc.fits",
"file_sha256": "35374d1f753db7ea8f977c38e000b5eb14c370d6811350001d02daa69e569315",
"crowdsap": 0.95167005,
"flfrcsap": 0.85172087,
"target": "TIC 9727392",
"mission": "TESS"
}
],
"reviewers": [
{
"id": "volunteer-sensitive",
"kind": "simulated",
"weight": 0.6,
"calibration": "calibrated",
"calibration_note": "measured by injection"
},
{
"id": "volunteer-typical",
"kind": "simulated",
"weight": 0.6,
"calibration": "calibrated",
"calibration_note": "measured by injection"
},
{
"id": "volunteer-cautious",
"kind": "simulated",
"weight": 0.4,
"calibration": "calibrated",
"calibration_note": "measured by injection"
}
],
"skipped_reviewers": [],
"skipped_reviewers_detail": [],
"weights": {
"volunteer-cautious": 0.4,
"volunteer-sensitive": 0.6,
"volunteer-typical": 0.6
},
"weights_source": "docs/results/reviewer_weights_full_panel.json (Probes only)",
"panel": {
"mode": "probes_only",
"sentinels_configured": [],
"note": "Probes only; Sentinels not run on this example"
},
"code": "v0.1.0-3-g0c029a2",
"counts": {
"light_curves": 1,
"subjects": 2,
"classifications": 6,
"consensus_events": 6,
"passed_vetting": 0
}
}