crbench//

Cases

127 cases. A case with 0 defects is a deliberate false-positive trap: no bug is present and a clean review is the correct answer. See the methodology for the tiers, scoring, and framework-specific cases.

Tier 1 — hand-authored, execution-grounded

Authored · go, python, rust, typescript · 36 cases

CaseLangDefects
A new required TRACKER_GEOCODER_URL setting is not added to the Helm chart, so every pod fails at startup python 1
A new required TRACKER_GEOCODER_URL setting is not added to the Helm chart, so every pod fails at startup python 1
Binary-sink migration missed an unchanged Serializer implementer (CsvSerializer still returns str) python 1
Binding the tenant scope with `let _ =` drops the guard at once, so the digest reads every tenant's rows rust 1
Day-bucketing the keyset filter in the session timezone diverges from the UTC-pinned cursor and empties page 2 python 1
Environment scoping added to create/update but not the sibling delete leaves a cross-env IDOR typescript 2
Filtering empty entries silently misaligns audit's positional entry/timestamp pairing python 2
Handlers are now built once per context instead of per event, so the PayoutFees the fee schedule keeps for each payout.paid handler, which charges each seller once, stops charging the payout fee after a seller's first payout typescript 1
Handlers are now built once per context instead of per event, so the PayoutFees the fee schedule keeps for each payout.paid handler, which charges each seller once, stops charging the payout fee after a seller's first payout typescript 1
Lowercasing tags silently breaks the case-sensitive admin check in access.py python 1
Moving the Server Action redirect into the render commit drops it on the unchanged non-React result path typescript 2
Narrowing a shared visibility gate for one control silently hides two unrelated controls typescript 1
Rejecting a zero throttle interval silently stops an unthrottled heartbeat that must always fire go 1
Reordering Job's fields silently re-ranks the unchanged scheduler's heap by name instead of priority rust 1
Reusing a scratch buffer for end keys corrupts every recorded span via the retaining writer go 1
Routing Amex to the legacy gateway breaks payments via an unchanged capability the diff can't see go 1
Sorting the roster silently misaligns payroll's positional name/amount pairing python 1
Stripping the trailing slash silently malforms URLs built by the unchanged helper python 1
Switching encode() to chunks_exact silently discards the partial final frame of every batch rust 1
Switching flusher workers to the spawn context silently disables the reaper's isinstance-gated kill python 1
The cached shipment payload changes shape without bumping CACHE_VERSION, so old entries are read as current python 1
The cached shipment payload changes shape without bumping CACHE_VERSION, so old entries are read as current python 1
The location record gains a field but the TypeScript client decoder keeps the old record layout python 1
The location record gains a field but the TypeScript client decoder keeps the old record layout python 1
check now sees each family's canonical values, and for an EDI line canonical() sets the quantity in units through units(), so Pinecrest's cap on the quantity as ordered rejects every case line over 150 units python 1
check now sees each family's canonical values, and for an EDI line canonical() sets the quantity in units through units(), so Pinecrest's cap on the quantity as ordered rejects every case line over 150 units python 1
load_flags() returns None for empty config, breaking the membership check in gate.py python 1
position_of() not-found sentinel changed None -> -1, breaking router's `is None` guard python 1
transform() returning nothing now drops the event, and an unchanged handler's transform still returns nothing, dropping every dispute typescript 1
transform() returning nothing now drops the event, and an unchanged handler's transform still returns nothing, dropping every dispute typescript 1
transform() returning nothing now drops the event, and the dispute handler's transform returns noteMissing(), which returns nothing, dropping every dispute typescript 1
transform() returning nothing now drops the event, and the dispute handler's transform returns noteMissing(), which returns nothing, dropping every dispute typescript 1
validate() now skips on a falsy return, and an unchanged handler's validate still returns None, dropping every refund python 1
validate() now skips on a falsy return, and an unchanged handler's validate still returns None, dropping every refund python 1
validate() now skips on a falsy return, and the refund handler's validate returns note_missing(), which returns the optional fields it found missing: an empty list for every refund that has a reason python 1
validate() now skips on a falsy return, and the refund handler's validate returns note_missing(), which returns the optional fields it found missing: an empty list for every refund that has a reason python 1

Tier 2 — real merged PRs from open-source projects

Cal.com · typescript · 11 cases

CaseLangDefects
Add guest management functionality to existing bookings typescript 5
Advanced date override handling and timezone compatibility improvements typescript 4
Async import of the appStore packages typescript 1
Comprehensive workflow reminder management for booking lifecycle events typescript 3
OAuth credential sync and app integration enhancements typescript 7
SMS workflow reminder retry count tracking typescript 3
feat: 2fa backup codes typescript 3
feat: `Troubleshooter` atom typescript 1
feat: add calendar cache status and actions (#22532) typescript 1
fix: handle collective multiple host on destinationCalendar typescript 7
fix: instant booking location lookup typescript 1

CockroachDB · go · 5 cases

CaseLangDefects
Backup manifest EndKey stored without Clone is corrupted by a caller's scratch-buffer reuse go 3
Crud writer feeds tombstone updates a row without stored computed columns, panicking the Deleter go 1
Per-statement fnv.New128() allocation is a hot-path throughput regression go 4
Tombstone updater re-leases its descriptor on every call and reports failed updates as success go 2
Treating min_checkpoint_frequency=0 as 'disabled' stalls the changefeed highwater go 1

ComfyUI · python · 1 cases

CaseLangDefects
Add LoRA trainer nodes and image-set loaders python 1

Deno · rust · 1 cases

CaseLangDefects
fix(npm): handle deno run/install of npm package with only directories.bin rust 1

Discourse · ruby · 7 cases

CaseLangDefects
Add comprehensive email validation for blocked users ruby 1
Enhance embed URL handling and validation system ruby 5
FEATURE: Can edit category/host relationships for embedding ruby 8
FEATURE: automatically downsize large images ruby 4
FEATURE: per-topic unsubscribe option in emails ruby 2
FIX: proper handling of group memberships ruby 2
Optimize header layout performance with flexbox mixins ruby 1

Django · python · 1 cases

CaseLangDefects
Fixed #36273 -- Moved Index system checks from Model to Index.check(). python 2

Formbricks · typescript · 2 cases

CaseLangDefects
Add response-pipeline webhook delivery job typescript 1
Storage auth session path uses a role-blind access check, letting billing-role users escalate typescript 4

Grafana · go, typescript · 9 cases

CaseLangDefects
Advanced SQL Analytics Framework go 2
Anonymous: Add configurable device limit go 2
AuthZService: improve authz caching go 2
DashboardDS: Fix Mixed panels not updating on time-range change with stale upstreams typescript 1
Database Performance Optimizations go 2
Dual Storage Architecture go 4
Frontend Asset Optimization go 1
Notification Rule Processing Engine go 3
Unified Storage Performance Optimizations go 2

Keycloak · java · 9 cases

CaseLangDefects
Add AuthzClientCryptoProvider for authorization client cryptographic operations java 2
Add Client resource type and scopes to authorization schema java 1
Add Groups resource type and scopes to authorization schema java 3
Add HTML sanitizer for translated message resources java 1
Add caching support for IdentityProviderStorageProvider.getForLogin operations java 1
Add rolling-updates feature flag and compatibility framework java trap
Fix concurrent group access to prevent NullPointerException java 1
Fixing Re-authentication with passkeys java 2
Implement access token context encoding framework java 3

Kubernetes · go · 4 cases

CaseLangDefects
Reduce cache locking duration when the DaemonSet controller fetches pods go 1
Serve LISTs with exact ResourceVersion and continuations from the cache go 3
Trim managedFields in the controller-manager and scheduler informer transforms go 1
kubelet DRA: update claimInfo cache locking and checkpoint semantics go 3

LVGL · c · 1 cases

CaseLangDefects
xml: sync the widget schemas with the runtime parsers c 3

mpv · c · 1 cases

CaseLangDefects
player: detect forced subtitle tracks from the filename c 1

n8n · typescript · 1 cases

CaseLangDefects
fix(editor): Load credentials when opening node credential picker typescript 1

NetBeans · java · 2 cases

CaseLangDefects
Extract the source file name from the .class and use it to locate the source java 1
LSP: do not compute text edits in source actions on resolve java 1

Next.js · typescript · 4 cases

CaseLangDefects
Image optimizer hardcodes max-age=0, discarding the upstream cache TTL typescript 4
Passing nextConfig: undefined also disables basePath stripping, corrupting router.query typescript 1
Server Action external redirect is dropped when invoked outside a React scope typescript 1
Wrapping the data response in a Buffer misclassifies it as dynamic, dropping Content-Length and ETag typescript 9

Novu · typescript · 1 cases

CaseLangDefects
Environment scoping added to create/update integration routes but not the sibling mutations typescript 1

OpenCV · cpp · 1 cases

CaseLangDefects
videoio: add IStreamReader support to the Java bindings cpp 1

PostHog · python, typescript · 6 cases

CaseLangDefects
Email-queue routing parks workflow waits on a queue the subscription matcher never searches typescript 1
Hardcoded queue_name='hogflow' filter never finds email-routed parked waits typescript trap
Narrowing a shared visibility flag hides sync-method/field/primary-key columns for non-SQL sources typescript 1
Raw query uses the HogQL table alias 'logs' instead of the physical 'logs_distributed' python 1
Timezone-unpinned toStartOfDay vs UTC-pinned date constants empties keyset page 2 python trap
feat(sig): custom agents python 1

Redis Client · ruby · 1 cases

CaseLangDefects
Implement Write Barriers for HiredisConnection ruby 2

Sentry · python, typescript · 10 cases

CaseLangDefects
Enhanced Pagination Performance for High-Volume Audit Logs python 4
GitHub OAuth Security Enhancement python 2
GitLab integration search returns full project paths python 2
Optimize spans buffer insertion with eviction during insert python 3
Span Buffer Multiprocess Enhancement with Health Monitoring python 2
Span tree minimap and secondary panel typescript 2
feat(ecosystem): Implement cross-system issue synchronization python 1
feat(upsampling) - Support upsampled error count with performance optimizations python 4
feat(uptime): Add ability to use queues to manage parallelism python 2
feat(workflow_engine): Add in hook for producing occurrences from the stateful detector python 1

SigNoz · go · 2 cases

CaseLangDefects
chore: recognize variable in expression go 9
fix: do not sort in descending locally if the other is explicitly specified go 2

TaskFlow (Convex) · typescript · 10 cases

CaseLangDefects
.collect() Just to Count (TaskFlow PR #6) typescript 1
.filter() vs Index (TaskFlow PR #2) typescript 1
Authorization Bypass (TaskFlow PR #10) typescript 2
Exposed Internals (TaskFlow PR #4) typescript 1
Missing Aggregate Update (TaskFlow PR #8) typescript 1
Missing Auth Check (TaskFlow PR #3) typescript 1
Nested Lookups (TaskFlow PR #1) typescript trap
OCC Conflict on Hot Path (TaskFlow PR #9) typescript 1
Unbounded .collect() (TaskFlow PR #5) typescript 1
Unbounded Array in Document (TaskFlow PR #7) typescript 4

Tauri · rust · 1 cases

CaseLangDefects
fix(core): Correctly detect Android Tauri configuration file, closes #7785 rust 1