Replies: 2 comments 2 replies
-
|
I updated to v4, and still have the scotus filter issue. |
Beta Was this translation helpful? Give feedback.
-
|
You need to understand the filters and data model correctly, and Claude simply does not. Opinions go through clusters and dockets to the court model, so you need to filter them with Clusters go through dockets to courts, so you need to filter them like: Dockets just go through courts, so you just need: Courts don't go through anything, so you just need This is all off the top of my head, so they might not be exactly right, but the API is workign properly, so I made this a discussion, not a bug. I hope this helps! |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
What happened?
Claude.AI is helping me with this. Here's what it found. (two versions, one more general and one with more detail)
Is Claude right, or is CourtListener right?
When querying the
/clusters/endpoint withcourt=scotus, the API returns cases that are clearly from state courts and lower federal courts, not the Supreme Court of the United States.Evidence
Query Used
Examples of Non-SCOTUS Cases Returned
Mongeon Bay Properties, LLC v. Town of Colchester
State v. Wallace Cable
Moore v. Brooks
Chad Everette Urrutia v. The State of Wyoming
Ricky R. House, Jr. v. State of Indiana
State of Louisiana v. Carl England
Additional Data Quality Issues
Some cases returned have impossible future filing dates:
Expected Behavior
When filtering by
court=scotus, the API should return only cases from the Supreme Court of the United States, which would have:Scope of Issue
The API reports
"count": 9970832results forcourt=scotus. Given that the Supreme Court has decided fewer than 10,000 cases in its entire history, this suggests the vast majority of these ~10 million results are incorrectly classified.Questions
Technical Details for Reproduction
API Endpoint:
https://www.courtlistener.com/api/rest/v3/clusters/Parameters:
court=scotusorder_by=-date_filedpage_size=20Date of Testing: January 23, 2026
Expected SCOTUS Indicators:
Observed State Court Indicators:
CourtListener SCOTUS Filtering Issue - Technical Documentation
Issue Summary
State and lower court cases are returned when filtering for Supreme Court of the United States cases in the CourtListener API.
Reproduction Steps
1. Query the Clusters Endpoint for SCOTUS Cases
2. Verify Court ID is Correct
First, confirm that 'scotus' is the correct court identifier:
Response:
{ "id": "scotus", "full_name": "Supreme Court of the United States", "short_name": "Supreme Court", "url": "https://www.supremecourt.gov/", "jurisdiction": "F" }✅ Confirmed: 'scotus' is the correct identifier for the Supreme Court of the United States.
Problem: Non-SCOTUS Cases Returned
Example 1: Vermont Supreme Court Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778750/", "id": 10778750, "absolute_url": "/opinion/10778750/mongeon-bay-properties-llc-v-town-of-colchester/", "docket_id": 72181187, "case_name": "Mongeon Bay Properties, LLC v. Town of Colchester", "date_filed": "2026-01-23", "citations": [{ "volume": "2026", "reporter": "VT", "page": "1", "type": 8 }], "precedential_status": "Published" }Evidence this is NOT a SCOTUS case:
Example 2: Rhode Island Supreme Court Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778747/", "id": 10778747, "case_name": "State v. Wallace Cable", "date_filed": "2026-01-23", "syllabus": "The defendant was found guilty on one count of first-degree child molestation sexual assault. On appeal, the defendant claimed that the trial justice erred when he permitted the state to introduce into evidence multiple out-of-court statements concerning what the complaining witness told a treating physician about the alleged charged and uncharged sexual assaults. The Supreme Court concluded that but for a single statement, the defendant failed to preserve the hearsay arguments for appeal. With respect to the one statement that was preserved concerning the defendant's fear of imprisonment, the Supreme Court concluded that the trial justice did not abuse his discretion in admitting the hearsay statement pursuant to Rhode Island Rule of Evidence 803(4)..." }Evidence this is NOT a SCOTUS case:
Example 3: North Carolina Business Court Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778746/", "id": 10778746, "case_name": "Moore v. Brooks", "date_filed": "2026-01-23", "citations": [{ "volume": "2026", "reporter": "NCBC", "page": "6", "type": 4 }] }Evidence this is NOT a SCOTUS case:
Example 4: Wyoming Supreme Court Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778737/", "id": 10778737, "case_name": "Chad Everette Urrutia v. The State of Wyoming", "date_filed": "2026-01-23", "citations": [{ "volume": "2026", "reporter": "WY", "page": "14", "type": 8 }] }Evidence this is NOT a SCOTUS case:
Example 5: Indiana Court of Appeals Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778743/", "id": 10778743, "case_name": "Ricky R. House, Jr. v. State of Indiana", "date_filed": "2026-01-23", "judges": "Altice, May, Foley", "disposition": "Affirmed" }Evidence this is NOT a SCOTUS case:
Example 6: Louisiana Court of Appeal Case
Query Result:
{ "resource_uri": "https://www.courtlistener.com/api/rest/v3/clusters/10778744/", "id": 10778744, "case_name": "State Of Louisiana v. Carl England", "date_filed": "2026-01-23" }Additional Data Quality Issues: Future Dates
Case with 2041 Filing Date
{ "id": 10698117, "case_name": "Mary Hersey v. WPB Partners LLC", "date_filed": "2041-02-11", "citations": [{ "volume": "2014", "reporter": "DNH", "page": "029" }] }Case with 2035 Filing Date
{ "id": 10730588, "case_name": "State of Minnesota v. Jeremy Thomas Herrera", "date_filed": "2035-11-03" }Expected SCOTUS Case Indicators
Legitimate Supreme Court of the United States cases should have:
Reporter Citations:
Reasonable Filing Dates:
SCOTUS Docket Numbers:
Federal Jurisdiction:
Scale of the Problem
API Response:
{ "count": 9970832 }The API reports 9,970,832 cases with
court=scotus.Historical Reality:
Conclusion:
Approximately 99.9% of the cases returned by
court=scotusfilter are incorrectly classified.Test Cases for Validation
If the filtering were working correctly, querying recent SCOTUS cases should return:
Attempted Workarounds
Using cluster__court Parameter on Opinions Endpoint
Result: Returns the same incorrectly classified cases (e.g., Ohio Court of Appeals case "Geisenfeld v. Geisenfeld, 2026-Ohio-205")
System Information
/clusters/,/opinions/Request for Clarification
Additional Notes
This issue prevents reliable automated tracking of Supreme Court decisions. The current state requires extensive manual filtering to separate actual SCOTUS cases from the ~10 million incorrectly tagged state court cases.
Expected behavior
No response
Actual behavior
No response
Steps to reproduce
No response
Screenshots
No response
What is the severity of the bug?
Unknown
Beta Was this translation helpful? Give feedback.
All reactions