Frontier models: 100% correct with Pipeworx, 69% with web search
Fable 5.1 + web search
70% correct
$35.93
Fable 5.1 + Pipeworx
100% correct
$4.53
DeepSeek V4 Flash + Pipeworx
98% correct
$0.406
50 questions. Cost is the full bill: model tokens, search fees and Pipeworx requests.
Fable 5.1 and Opus 5.5: 100/100 with Pipeworx for $6.06, 69/100 with web search for $54.23, 11/100 alone.
Every model, every way
Opus 5.5
+ Pipeworx
50/50
$1.53
Fable 5.1
+ Pipeworx
50/50
$4.53
Grok 4.7
+ Pipeworx
49/50
$0.879
Gemini 4
+ Pipeworx
49/49
$0.899
DeepSeek V4 Flash
+ Pipeworx
49/50
$0.406 · 1 wrong
GPT-5
+ Pipeworx
48/48
$1.15
Grok 4.7
+ web search
46/50
$22.94 · 3 wrong
GPT-5 Nano
+ Pipeworx
44/50
$0.394 · 1 wrong
DeepSeek V4 Flash
+ web search
42/50
$0.369 · 3 wrong
GPT-5
+ web search
41/50
$7.13
Gemini 4
+ web search
37/46
$3.03 · 1 wrong
Fable 5.1
+ web search
35/50
$35.93 · 5 wrong
Perplexity Pro Search
its own search
35/50
$0.960 · 10 wrong
Opus 5.5
+ web search
34/50
$18.30 · 4 wrong
GPT-5 Nano
+ web search
27/50
$3.38 · 4 wrong
Opus 5.5
alone
6/50
$0.391 · 2 wrong
Fable 5.1
alone
5/50
$0.948 · 3 wrong
Gemini 4
alone
3/50
$0.052
Grok 4.7
alone
2/50
$0.139
GPT-5
alone
2/50
$0.628 · 1 wrong
DeepSeek V4 Flash
alone
2/50
$0.0094 · 10 wrong
GPT-5 Nano
alone
1/50
$0.030
What each one cost
| Model and mode | Correct | Wrong | Model tokens + search | Pipeworx requests | Total | Per answer | Per correct |
|---|---|---|---|---|---|---|---|
| Opus 5.5+ Pipeworx | 50/50 | $1.19 | 67 × $0.005 = $0.335 | $1.53 | $0.031 | $0.031 | |
| Fable 5.1+ Pipeworx | 50/50 | $4.17 | 73 × $0.005 = $0.365 | $4.53 | $0.091 | $0.091 | |
| Grok 4.7+ Pipeworx | 49/50 | $0.499 | 76 × $0.005 = $0.380 | $0.879 | $0.018 | $0.018 | |
| Gemini 4+ Pipeworx | 49/49 | $0.534 | 73 × $0.005 = $0.365 | $0.899 | $0.018 | $0.018 | |
| DeepSeek V4 Flash+ Pipeworx | 49/50 | 1 | $0.016 | 78 × $0.005 = $0.390 | $0.406 | $0.0081 | $0.0083 |
| GPT-5+ Pipeworx | 48/48 | $0.721 | 86 × $0.005 = $0.430 | $1.15 | $0.024 | $0.024 | |
| Grok 4.7+ web search | 46/50 | 3 | $22.94 | — | $22.94 | $0.459 | $0.499 |
| GPT-5 Nano+ Pipeworx | 44/50 | 1 | $0.034 | 72 × $0.005 = $0.360 | $0.394 | $0.0079 | $0.0089 |
| DeepSeek V4 Flash+ web search | 42/50 | 3 | $0.369 | — | $0.369 | $0.0074 | $0.0088 |
| GPT-5+ web search | 41/50 | $7.13 | — | $7.13 | $0.143 | $0.174 | |
| Gemini 4+ web search | 37/46 | 1 | $3.03 | — | $3.03 | $0.066 | $0.082 |
| Fable 5.1+ web search | 35/50 | 5 | $35.93 | — | $35.93 | $0.719 | $1.03 |
| Perplexity Pro Searchits own search | 35/50 | 10 | $0.960 | — | $0.960 | $0.019 | $0.027 |
| Opus 5.5+ web search | 34/50 | 4 | $18.30 | — | $18.30 | $0.366 | $0.538 |
| GPT-5 Nano+ web search | 27/50 | 4 | $3.38 | — | $3.38 | $0.068 | $0.125 |
| Opus 5.5alone | 6/50 | 2 | $0.391 | — | $0.391 | $0.0078 | $0.065 |
| Fable 5.1alone | 5/50 | 3 | $0.948 | — | $0.948 | $0.019 | $0.190 |
| Gemini 4alone | 3/50 | $0.052 | — | $0.052 | $0.0010 | $0.017 | |
| Grok 4.7alone | 2/50 | $0.139 | — | $0.139 | $0.0028 | $0.070 | |
| GPT-5alone | 2/50 | 1 | $0.628 | — | $0.628 | $0.013 | $0.314 |
| DeepSeek V4 Flashalone | 2/50 | 10 | $0.0094 | — | $0.0094 | $0.0002 | $0.0047 |
| GPT-5 Nanoalone | 1/50 | $0.030 | — | $0.030 | $0.0006 | $0.030 |
Cost per correct answer
Who got each question right
| Question | alone | + web search | + Pipeworx | Perplexity | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Fable | Opus | Gemini | Grok | GPT-5 | DeepSeek | GPT-5 | Fable | Opus | Gemini | Grok | GPT-5 | DeepSeek | GPT-5 | Fable | Opus | Gemini | Grok | GPT-5 | DeepSeek | GPT-5 | Pro | |
| 1 How many currently recruiting Phase 3 interventional studies of semaglutide are there, and what conditions do they cover?pharma · 29 by the registry condition index, 37 by free-text match (ClinicalTrials.gov, RECRUITING + PHASE3 + INTERVENTIONAL, 2026-10-15). Conditions include oSource: ClinicalTrials.gov | – | – | – | – | – | – | – | – | – | – | ✓ | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – |
| 2 Is any semaglutide product currently on the FDA drug shortage list, and what is its status?pharma · Not on the CURRENT shortage list (status=Current returns zero). Present in the same FDA database under a different status: Rybelsus (semaglutide) tablSource: openFDA drug shortages | ✓ | ✓ | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 3 How many FAERS adverse event reports for semaglutide list ischaemic optic neuropathy as a reaction?pharma · 631 to 869 reports, depending on which drug-name field is counted (openFDA FAERS, captured 2026-10-16): 631 = openFDA-enriched generic_name semaglutidSource: openFDA FAERS, semaglutide + optic ischaemic neuropathy | – | – | – | – | – | – | – | – | – | ✗ | ✗ | ✓ | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 4 Which company markets generic semaglutide in the United States, and when was it approved?pharma · None. No generic semaglutide is FDA-approved for marketing or marketed in the US; Novo Nordisk's brands (Ozempic, Wegovy, Rybelsus) are the only markeSource: FDA Drugs@FDA -- semaglutide products; one ANDA (Apotex) with tentative approval only | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ |
| 5 How many magnitude 5.0 or greater earthquakes occurred worldwide in the last 7 days?other · 33 (USGS FDSN event count, minmagnitude 5, exact trailing 7 days, captured 2026-10-17T02:15Z immediately before the refresh run)Source: USGS earthquake catalog, M5.0+, trailing 7 days | – | – | – | – | – | – | – | ✗ | ✗ | – | ✓ | – | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 6 What is the San Francisco Giants' current win-loss record this season?other · 65-97 (.401), fourth in the NL West, 35.0 games back — final 2026 regular-season record (season ended 2026-09-27)Source: MLB Stats API standings | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ |
| 7 How many federal disaster declarations has FEMA issued in 2026?other · 141 declarations in fiscal year 2026 (FY closed 2026-09-30; one per FEMA declaration string), most recent EM-3654-HI, Tropical Storm Nolo, declared 20Source: OpenFEMA disaster declarations summaries, fy_declared=2026 | – | – | – | – | – | – | – | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 8 How many later court decisions have cited Miranda v. Arizona?legal · 58,662 citing referencesSource: US case law citation graph, cluster 107252 | – | – | – | – | – | ✗ | – | – | – | ✓ | ✗ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 9 How many later court decisions have cited Roe v. Wade?legal · 5,590 citing referencesSource: US case law citation graph, cluster 108713 | – | – | – | – | – | ✗ | – | ✗ | – | · | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – |
| 10 What did the court decide in Tesla, Inc. v. Charge Fusion Technologies, LLC, and when?legal · Two nonprecedential Federal Circuit decisions share this caption, both on appeal from the PTAB. (a) No. 24-1584, decided 2026-02-25 (IPR2022-01217): aSource: US case law, cluster 10830336 | – | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ |
| 11 How many executive orders signed in 2026 have been published in the Federal Register so far, and what is the number and title of the most recent one?legal · 64 executive orders, EO 14372 (signed 2026-01-07) through EO 14435. Most recent: EO 14435, 'Emergency Tax Relief on Diesel Fuel', signed 2026-10-05, pSource: Federal Register API, documents of type Presidential Document / executive_order, signing_date >= 2026-01-01 | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 12 How many public laws has the 119th Congress enacted so far, and what is the most recent one?legal · 121 public laws (Public Law 119-1 through 119-121). Most recent: Public Law 119-121, S. 195, the American Music Tourism Act of 2025, became law 2026-1Source: congress.gov API v3, /law/119 (123 laws = 121 public + 2 private) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 13 DHS has proposed new fees for F-1 students' Optional Practical Training (OPT). What fee amounts does the proposal set, and when does the public comment period close?legal · $70,000 for initial OPT and $30,000 for any subsequent OPT, per F-1 student. Comments due on or before 2026-11-09 (Paperwork Reduction Act comments onSource: Federal Register API, document 2026-20660 | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | – | ✓ |
| 14 How many FDIC-insured banks have failed so far in 2026, and which was the most recent?finance · 6 failures in 2026. Most recent: Nano Banc, Irvine, CA, closed 2026-09-25, acquired by Sunwest Bank. Earlier: Tioga-Franklin Savings Bank (PhiladelphiSource: FDIC Failed Bank List (fdic.gov failed bank list data download) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | – | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 15 What was the high yield at the most recent US Treasury auction of nominal 10-year notes (not TIPS), and on what date was the auction held?finance · 5.300% high yield, auction 2026-10-07 (reopening of CUSIP 91282CRF0, 9-year 10-month remaining term, 4.625% coupon, $39 billion offered, bid-to-cover Source: TreasuryDirect auction results API (TA_WS securities search, type Note, auctionDate since 2026-09-01) | – | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 16 How many novel drugs has the FDA's Center for Drug Evaluation and Research (CDER) approved so far in 2026, and what was the most recent one?pharma · 46 novel drug approvals. Most recent (#46): Hovilpri (pritelivir), approved 2026-10-09, for refractory mucocutaneous herpes simplex virus infection inSource: FDA, 'Novel Drug Approvals for 2026' (CDER), page content current as of 2026-10-09 | – | – | – | – | – | – | – | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | · | ✓ | ✓ | ✓ | ✓ | ✓ |
| 17 According to CMS's Medicare Part D Spending by Drug data, how much did Medicare Part D spend in total on Jardiance in calendar year 2024, and how many beneficiaries used it?pharma · $11,435,997,421 (about $11.44 billion) total 2024 Part D spending; 2,543,331 beneficiaries; 11,368,280 claims. (2023: $8,839,935,063.)Source: CMS Medicare Part D Spending by Drug, data year 2024 (released 2026-06-25), Brnd_Name Jardiance, Mftr_Name Overall | – | – | – | – | – | – | – | ✗ | ✗ | · | ✓ | – | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 18 According to the latest US Drought Monitor map, what percentage of the contiguous United States is in drought (category D1 or worse)?other · 53.73% of CONUS in D1-D4, map valid 2026-10-13 (released 2026-10-15). Of which D2-D4 30.33%, D3-D4 9.79%, D4 1.30%; 74.54% abnormally dry or worse (D0Source: US Drought Monitor data services API, USStatistics/GetDroughtSeverityStatisticsByAreaPercent, aoi=conus, statisticsType=1 (cumulative) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 19 How many confirmed exoplanets does the NASA Exoplanet Archive currently list?other · 6,451 confirmed planetsSource: NASA Exoplanet Archive TAP service, select count(*) from pscomppars (same count from ps where default_flag=1) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 20 What has been the busiest single day of 2026 so far at TSA airport security checkpoints, and how many travelers were screened that day?other · 2026-06-18 (Thursday), 2,988,204 travelers screened. Runners-up: 2026-06-21 (2,981,485), 2026-05-22 (2,976,209).Source: TSA checkpoint travel numbers (tsa.gov passenger volumes table, 2026-01-01 through 2026-10-15) | – | – | – | – | – | – | – | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 21 YCA26, L.P., a Y Combinator fund vehicle, filed a Form D with the SEC in April 2026. According to that filing, what total amount of securities had been sold, and how many investors had already invested?finance · $727,774,091 sold; 87 investors. Total offering amount reported as 'Indefinite'. Original Form D (not an amendment) filed 2026-04-27, accession 000131Source: SEC EDGAR, Form D primary_doc.xml, accession 0001315863-26-000364 (CIK 0002131752); submissions JSON shows this is the only filing for the CIK as of 2026-10-16 | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 22 Converge Bio Inc. filed a Form D with the SEC in April 2026. What date of first sale did it report, how much was sold, and how many investors participated?finance · Date of first sale 2025-09-24; $25,000,000 sold of a $25,000,000 total offering ($0 remaining); 19 investors. Original Form D filed 2026-04-28, accessSource: SEC EDGAR, Form D primary_doc.xml, accession 0002131104-26-000001 (CIK 0002131104); submissions JSON shows it is the only filing for the CIK as of 2026-10-16 | – | – | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 23 Chickadee Biomedicines, Inc. filed a Form D with the SEC in June 2026. What total offering amount did it report, how much had been sold, and which federal exemption did it claim?pharma · Total offering $1,000,000; $150,000 sold; $850,000 remaining; exemption Rule 506(b). Original Form D filed 2026-06-25, accession 0002138882-26-000001,Source: SEC EDGAR, Form D primary_doc.xml, accession 0002138882-26-000001 (CIK 0002138882); only filing for the CIK as of 2026-10-16 | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 24 Veloxis Pharmaceuticals entered into a Corporate Integrity Agreement with the HHS Office of Inspector General in 2026. What is the agreement's effective date, how long is its term, and what settlement amount does OIG list for it?pharma · Effective August 7, 2026; duration 5 years (estimated completion August 2031); OIG lists a settlement amount of $34,450,000. Status Active/Effective; Source: HHS-OIG, Corporate Integrity Agreements, browse-cias roster and the Veloxis Pharmaceuticals, Inc. agreement page (agreement document dated 08072026) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 25 In the USGS Mineral Commodity Summaries 2025, what was Madagascar's estimated 2024 mine production of natural graphite, and what were its graphite reserves?other · Estimated 2024 mine production 89,000 metric tons (2023: 63,000 t, itself an estimate); reserves 27,000,000 metric tons (27 million t).Source: USGS National Minerals Information Center, Mineral Commodity Summaries 2025 Data Release (ver. 2.0, April 2025), world data table, Graphite / Madagascar row (ScienceBase item 677eaf95d34e760b392c4970) | ✗ | ✓ | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 26 In 2026, California's Office of Tax Appeals issued a precedential business-tax opinion whose listed issues include generative-AI hallucinations. What is the case name and its OTA citation?legal · SABPLINC dba Ananda Bhaven, 2026-OTA-368P (July 2026, Precedential). OTA's issues tag: 'Unreported taxable sales (restaurant); GenAI hallucinations'.Source: California Office of Tax Appeals, All Precedential Business Tax Opinions listing and the 2026 Business Tax Opinions listing (ota.ca.gov), read 2026-10-16 | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ |
| 27 Under North Carolina's expedited procedure for removing unauthorized occupants (squatters) from residential property, enacted in 2025, what is the minimum appeal bond an unauthorized person must post to appeal a removal order, and at most how long after service of the order does the person have to vacate?legal · Minimum appeal bond $10,000 (G.S. 14-159.53, which allows a higher amount based on estimated rent and damages); vacate no more than four hours after sSource: North Carolina General Assembly, General Statutes Chapter 14 (ncleg.gov, chapter HTML), §§ 14-159.52 and 14-159.53, read 2026-10-16 | – | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ |
| 28 How many entries on the New York State Office of the Medicaid Inspector General (OMIG) exclusion list have an exclusion effective date in calendar year 2025?pharma · 446 (of 9,141 entries on the list as downloaded 2026-10-16). For context, 2024 = 424 and 2026 to date = 391.Source: NY OMIG, Medicaid exclusion list, tab-delimited download (apps.omig.ny.gov exclusions), EXCLUSION_EFFECTIVE_DATE field, read 2026-10-16 | – | – | – | – | – | – | – | – | – | – | ✓ | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – |
| 29 In the single audit Stanford University submitted to the Federal Audit Clearinghouse for its fiscal year ended August 31, 2025, what total federal award expenditures were reported, and how many audit findings were there?other · $1,102,470,206 total federal expenditures; zero findings. Report 2025-08-GSAFAC-0000415527 (auditee: Board of Trustees of the Leland Stanford Junior USource: GSA Federal Audit Clearinghouse public API (api.fac.gov) — general table (total_amount_expended) and findings table for report 2025-08-GSAFAC-0000415527, read 2026-10-16 | – | – | – | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 30 The 2026 edition of CALCRIM, California's official criminal jury instructions, added a new instruction for organized retail theft (Penal Code section 490.4). What is its CALCRIM number, and which other instructions were newly added (not merely revised) in that same February 2026 Judicial Council approval?legal · CALCRIM No. 1808, Organized Retail Theft (Pen. Code, § 490.4) — new. The other three new instructions: No. 3235 (Aggravating Factor: Numerous or IncreSource: Judicial Council of California, CALCRIM 2026 edition PDF (courts.ca.gov), front-matter 'Table of Revised Judicial Council of California Criminal Jury Instructions (CALCRIM), March 2026' and each instruction's 'New February 2026' history line | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 31 In the US Department of Labor's H-1B labor condition application (LCA) disclosure data for federal fiscal year 2026 through the third quarter (cases decided October 1, 2025 to June 30, 2026), how many H-1B LCAs did OpenAI OpCo, LLC file, and what was the median offered annual wage on them?other · 211 H-1B LCAs (239 counting all visa classes in the file: 211 H-1B, 21 E-3 Australian, 7 H-1B1 Singapore). Median offered wage $260,000/year, the sameSource: DOL OFLC, LCA_Disclosure_Data_FY2026_Q3.xlsx (cumulative FY2026 Q1-Q3; decision dates 2025-10-01..2026-06-30; 437,496 rows), EMPLOYER_NAME = 'OPENAI OPCO, LLC', read 2026-10-16. The FY2026_Q4 file is not yet published. | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 32 Counting SBA 504 loans approved since fiscal year 2010 to borrowers in Vermont, which certified development company (CDC) made the most of them, and how many?finance · Granite State Economic Development Corporation (a New Hampshire CDC): 284 of the 339 Vermont-borrower 504 loans in the file, $145.7M gross approval. 2Source: SBA FOIA, 504 loans FY2010-present CSV (data.sba.gov dataset 7a-504-foia, AsOfDate 2026-06-30), BorrState = 'VT', grouped by CDC_Name, read 2026-10-16 | – | – | ✓ | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – |
| 33 Founders Fund Growth IV, LP filed a Form D with the SEC in March 2026. According to that filing, what total amount had been sold, and how many investors had already invested?finance · $6,024,585,000 sold, of a $6,024,585,000 total offering ($0 remaining); 370 investors; no non-accredited investors. The issuer's note says the amount Source: SEC EDGAR, Form D primary_doc.xml, accession 0001231919-26-000265 (CIK 0002112131). The submissions JSON, read 2026-10-16, shows it is the CIK's only filing. | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 34 Is Done Global, Inc., the ADHD telehealth company, on California's Medi-Cal Suspended and Ineligible Provider List? If so, what date of suspension does the list give, and is any affiliated Done entity listed with it?pharma · Yes. 'Done Global, Inc.' (Entity/Corporation, San Francisco), date of suspension 2026-08-10, 'Indefinitely effective'. 'Done Health, P.C.' (Entity/CorSource: California DHCS Medi-Cal Suspended and Ineligible (S&I) Provider List, via the CHHS Open Data Portal CKAN datastore (resource 48630a37-b5ba-4d3d-af54-e82b30e658a0; 23,526 rows; resource last_modified 2026-10-12), read 2026-10-16 | – | – | – | – | – | ✗ | – | – | – | – | ✓ | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 35 How many entries in the Texas HHSC Office of Inspector General's Medicaid exclusions database have an exclusion start date in calendar year 2025?pharma · 278 of 13,445 entries in the file downloaded 2026-10-16 (StartDate in 2025). For context: 5 are companies, 4 have since been reinstated, and the most Source: Texas HHSC OIG, 'Download Exclusions File' (oig.hhsc.state.tx.us exclusions download, file TexasExclusionsData_2026_10_16.txt, tab-delimited), StartDate field, read 2026-10-16 | – | – | – | – | – | – | – | – | – | – | ✓ | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – |
| 36 Illinois's Wellness and Oversight for Psychological Resources Act restricts the use of AI in therapy. What is the maximum civil penalty per violation under it, and within how many days of the Department's order must the penalty be paid? Give the ILCS citation of the penalty section.legal · Not to exceed $10,000 per violation, assessed by the Department (IDFPR) after a hearing; payable within 60 days after the date of the Department's ordSource: Illinois General Assembly: ftp.ilga.gov ILCS file repository, Ch 0225/Act 0155/022501550K30.html (snapshot through P.A. 104-433), cross-checked 2026-10-16 against the live ilga.gov FullText?DocName=022501550K30, which shows identical text and source note (P.A. 104-54, eff. 8-1-25) | ✓ | ✓ | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | · | ✓ | ✓ | ✓ |
| 37 Indiana enacted a 2026 law (Indiana Code article 24-16) regulating adolescents' use of social media. Under it, after how many hours of use in a single six-month period must a social media provider first try to determine an Indiana account holder's age, and within how many days? What age makes someone an 'adolescent', and when does the article take effect?legal · 25 hours in a single six-month period, then within 14 days (IC 24-16-4-1(a)). A second, verifying age determination follows at 50 hours in a six-monthSource: Indiana General Assembly, Indiana Code 2026 edition, iga.in.gov/ic/2026/Title_24.html, IC 24-16-2-2, 24-16-2-5 and 24-16-4-1, read 2026-10-16 | – | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 38 In the current (119th) Congress, who chairs the Senate Armed Services Committee's Subcommittee on Cybersecurity, who is its ranking member, and how many senators sit on it?legal · Chairman Mike Rounds (R-SD); Ranking Member Jacky Rosen (D-NV). 11 total members, 6 majority and 5 minority, including the full-committee chairman (WiSource: United States Senate, committee membership page for the Committee on Armed Services (senate.gov/general/committee_membership/committee_memberships_SSAS.htm), read 2026-10-16: 'Subcommittee on Cybersecurity, Total Members: 11, Majority Members (6), Minority Members (5)' | ✓ | ✓ | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ |
| 39 What is the MSHA Mine ID of the Leer South Mine in West Virginia, and which companies does MSHA currently list as its operator and its controller?other · Mine ID 4604168. Operator: Wolf Run Mining LLC. Controller: Core Natural Resources Inc. Underground coal mine, Barbour County, status Active.Source: MSHA Open Government Data, Mines.zip (Mines.txt, 92,071 mines; file dated 2026-10-16), MINE_ID 4604168: CURRENT_OPERATOR_NAME, CURRENT_CONTROLLER_NAME, CURRENT_MINE_STATUS, read 2026-10-16 | ✗ | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 40 How many violations (citations, orders and safeguards) did the Mine Safety and Health Administration issue at the Marshall County Mine in West Virginia (MSHA Mine ID 4601437) during calendar year 2025?other · 743 issued in 2025 (by VIOLATION_ISSUE_DT): 738 citations, 4 orders, 1 safeguard; 726 to the operator (Marshall County Coal Resources, Inc.) and 17 toSource: MSHA Open Government Data, Violations.zip (Violations.txt; file dated 2026-10-16), MINE_ID 4601437, VIOLATION_ISSUE_DT in 2025, read 2026-10-16 | – | – | – | – | – | – | – | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 41 Transport Infrastructure Ireland's TED contract award notice for the TII400 Luas Operations and Maintenance Contract was published in 2026. Who won it, and what total contract value did the award notice report?finance · Keolis (UK) Limited; total value EUR 718,979,302. TED publication number 604549-2026 (contract award notice, published 2026-09-02); award decision 202Source: TED Search API v3 (api.ted.europa.eu/v3/notices/search), query FT ~ "TII400" -> 3 notices; award notice 604549-2026 fields total-value, winner-name, winner-decision-date, contract-conclusion-date | – | – | – | – | – | – | – | ✗ | ✗ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 42 What is the TED publication number of the contract award notice for Norway's Stad ship tunnel construction contract, who was the contractor, and what contract value did the notice report?finance · TED 603800-2026 (contract award notice, published 2026-09-02); buyer Kystverket (Norwegian Coastal Administration); winner AF Gruppen Norge AS; total Source: TED Search API v3, query FT ~ "Stad ship tunnel" -> 10 notices, only one contract award notice for the main works (603800-2026) | – | – | – | – | – | – | – | ✓ | ✓ | · | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 43 According to GLEIF, which legal entity is the ultimate accounting parent of Klarna Bank AB (Swedish organisation number 556737-0431), and what is that parent's LEI?finance · KLARNA GROUP PLC (England & Wales, company number 14467769), LEI 636700HER4JIK7GZUN17. Klarna Bank AB's own LEI is 549300O3HXYXXUHR0897; its direct paSource: GLEIF API: /api/v1/lei-records/549300O3HXYXXUHR0897/ultimate-parent and /ultimate-parent-relationship (golden copy 2026-10-16T08:00Z) | – | – | – | – | ✗ | – | – | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ |
| 44 In August 2026 an LEI was issued for Revolut's new Swiss company in Zürich. What is that entity's legal name and LEI, and what Swiss commercial-register (UID) number is it registered under?finance · Revolut Swiss NewCo AG (also Revolut Swiss NewCo Ltd / SA), LEI 5067008GL1U4VQ24PP29, registered as CHE412350035 (= UID CHE-412.350.035), legal addresSource: GLEIF API: /api/v1/lei-records?filter[fulltext]=Revolut (40 records) and /api/v1/lei-records/5067008GL1U4VQ24PP29 (golden copy 2026-10-16T08:00Z) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 45 What is Monzo Bank Limited's Companies House company number, and on what date were its full accounts for the year ended 31 March 2026 filed at Companies House?finance · Company number 09446231; full accounts made up to 31 March 2026 filed 27 August 2026 (filing type AA, 195 pages). Note the separate holding company MOSource: Companies House register, find-and-update.company-information.service.gov.uk/company/09446231/filing-history (and /company/14785367/filing-history for the holdco) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 46 What is the ECB's deposit facility rate right now, and from what date has that rate applied?finance · 2.50%, in effect since 16 September 2026 (decision announced at the 10 September 2026 Governing Council meeting). Path: 2.00% from 11 Jun 2025 -> 2.25Source: ECB Data Portal API, data-api.ecb.europa.eu/service/data/FM/B.U2.EUR.4F.KR.DFR.LEV (observation dates are effective dates); decision date = the Thursday before, per the ECB's effective-date convention | ✗ | ✗ | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | · | ✓ | ✓ | ✓ |
| 47 According to the FCA's latest aggregated net short position data, which UK-listed company currently has the largest aggregate net short position, and how large is it as a percentage of issued share capital?finance · CERES POWER HOLDINGS PLC (ISIN GB00BG5KQW09), 17.19%, latest position date 15/10/2026. Next: Ibstock 14.20%, Vistry 14.12%, Yellow Cake 14.02%, GenuitSource: FCA aggregated current net short positions CSV (fca.org.uk/publication/documents/aggregated-current-net-short-positions.csv), sorted by 'Aggregated net short position (%)' | – | – | – | – | – | – | – | ✓ | ✓ | · | ✓ | ✓ | ✓ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 48 What is Norges Bank's policy rate today, and when did it last change?finance · 4.50%, effective 25 September 2026 (decision announced 24 September 2026). 2026 path: 4.00% (from 19 Sep 2025) -> 4.25% from 8 May 2026 -> 4.50% from Source: Norges Bank data API, data.norges-bank.no/api/data/IR/B.KPRA.SD.R (policy rate, business-daily; dates are effective dates, the decision is announced the business day before) | – | ✗ | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 49 In the 2025 annual accounts that Vipps MobilePay AS (Norwegian org. no. 918713867) filed with the Brønnøysund Register of Company Accounts, what were its total operating revenues and its net result for the year?finance · Company (selskap) accounts for 2025-01-01 to 2025-12-31, NOK: total operating revenue (sumDriftsinntekter) 2,088,436,698 (of which sales revenue 2,088Source: Brønnøysund Register of Company Accounts API, data.brreg.no/regnskapsregisteret/regnskap/918713867 (2025 SELSKAP record, journal no. 2026748035) | – | – | – | – | – | – | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✗ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 50 On what date did Ubisoft Entertainment file its 2025-26 Universal Registration Document (Document d'enregistrement universel) with the AMF?finance · 6 July 2026. The document's own cover states 'Le Document d'Enregistrement Universel a été déposé le 6 juillet 2026 auprès de l'AMF ... sans approbatiSource: DILA info-financiere regulated-information feed (France's officially appointed storage mechanism for AMF regulated information), dataset flux-amf-new-prod, issuer UBISOFT ENTERTAINMENT, type 300005; plus the cover page of the filed ESEF document FC307636192_20260706 | – | – | – | – | – | ✗ | – | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
Notes
- Run 16 October 2026. Three questions (earthquakes, Monzo, Ubisoft) were re-run on 17 October after fixes to the tools behind them; every mode was re-run for those three, not only Pipeworx.
- Answer keys come from each publisher's own data, not from a model. Every answer was graded blind by Claude Sonnet 4.5.
- Costs are each API's billed usage. Pipeworx is charged at list, $0.005 a request.
- Web search: Fable 5.1 and Opus 5.5 use Anthropic's search, which reads whole pages. The other models use OpenRouter's search, which returns results only. Perplexity Pro Search is Perplexity's own search product.
- Each answer gets up to 4,096 output tokens and 8 Pipeworx calls. 7 answers that hit a provider error or the call limit are left out of the scores.