Skip to content

[iris] Grant OpenAthena principals full CoreWeave budgets - #8776

Merged
rjpower merged 6 commits into
mainfrom
weaver/iris-priority-assignment
Aug 29, 2026
Merged

[iris] Grant OpenAthena principals full CoreWeave budgets#8776
rjpower merged 6 commits into
mainfrom
weaver/iris-priority-assignment

Conversation

@rjpower

@rjpower rjpower commented Aug 29, 2026

Copy link
Copy Markdown
Collaborator

Grant both the authenticated email and established job-path alias for each of eight OpenAthena principals an unlimited INTERACTIVE budget on all four CoreWeave clusters. A zero limit keeps their work from degrading to BATCH, so each principal can claim the full cluster after other users exceed the guest allowance.

Live Marin rows paired nickname job paths such as /power/... with authenticated emails in jobs.submitting_user, while budget consumers still used the nickname. Iris now uses the authenticated principal for max-band admission, active-task caps, spend, scheduling fairness and demotion, Kubernetes dispatch, and scheduler dashboard buckets. Friendly job paths remain unchanged. Trusted local jobs and rows with an empty submitting_user continue to use the job-path owner.

Set the unlisted-user limit to one GPU node: 10688 on the H100 clusters and 5680 on the GB200 cluster. Additional unlisted work becomes BATCH and can be preempted by the core tier. Non-core aliases remain in their bounded researcher tier. The prior Benjamin Feuer override is superseded by the unlimited core tier. The roster is explicit in each cluster config because Iris has no cross-file config include.

The budget tiers apply when each controller next starts, and authenticated-principal accounting applies after the updated controller is deployed. No cluster was restarted. The investigation record is https://echo.oa.dev/wiki/288.

Give the seven named OpenAthena identities unlimited INTERACTIVE budgets on every CoreWeave cluster. Restore the unlisted-user default to 1000 so excess work falls to BATCH and the core tier can reclaim cluster capacity.
@rjpower rjpower added agent-generated Created by automation/agent agentic-lint Local agentic lint review completed labels Aug 29, 2026
@github-actions

Copy link
Copy Markdown
Contributor

IaC preview

  • cw-rno2a
  • cw-us-east-02a
  • cw-us-east-08a
  • cw-us-west-04a
  • marin

@loom-oa-dev loom-oa-dev Bot added the weaver label Aug 29, 2026
Comment thread lib/iris/config/cw-rno2a.yaml Outdated
Comment thread lib/iris/config/cw-us-east-02a.yaml
Allow one GPU node to stay INTERACTIVE for unlisted CoreWeave users. The H100 configs use 10688 and the GB200 config uses 5680, matching Iris resource_value; additional capacity degrades to BATCH.
Use jobs.submitting_user for budget admission, active-task caps, spend, scheduling fairness, demotion, Kubernetes dispatch, and dashboard buckets. Preserve the friendly job-path owner as the fallback for trusted local and pre-migration rows.

Add ben.feuer@openathena.ai to the unlimited INTERACTIVE tier on every CoreWeave cluster.
Describe the fallback in terms of empty submitting_user rows, remove a stale incident reference, and keep the regression tests focused on behavior.
@rjpower rjpower changed the title [iris] Give core developers full CoreWeave budgets [iris] Grant OpenAthena principals full CoreWeave budgets Aug 29, 2026
Place each established core job-path alias next to its authenticated OpenAthena email in the unlimited INTERACTIVE tier. Leave non-core aliases in the bounded researcher tier and remove the superseded Benjamin Feuer override.
Use canonical or local identity constants in budget-path tests and keep the budget selector documentation proportional to its behavior.
@rjpower
rjpower requested a review from yonromai August 29, 2026 21:10
@rjpower
rjpower enabled auto-merge (squash) August 29, 2026 21:10
@rjpower
rjpower disabled auto-merge August 29, 2026 21:15
@rjpower
rjpower merged commit e7f0df2 into main Aug 29, 2026
44 checks passed
@rjpower
rjpower deleted the weaver/iris-priority-assignment branch August 29, 2026 21:15
- russell.power@openathena.ai
- power
- will.held@openathena.ai
- held

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing Ahmad?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also missing Larry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agent-generated Created by automation/agent agentic-lint Local agentic lint review completed weaver

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants