Skip to content

Update regression datasets#658

Open
MarkWolters wants to merge 3 commits intomainfrom
update_regression_datasets
Open

Update regression datasets#658
MarkWolters wants to merge 3 commits intomainfrom
update_regression_datasets

Conversation

@MarkWolters
Copy link
Copy Markdown
Contributor

Updating regression tests (AutoBenchYAML) to use the datasets.yml configuration rather than hard-coding its datasets.

  • AutoBenchYAML.java updated to dynamically load datasets for testing from yaml
  • DataSets.java updated to return a specific subsection of datasets.yml based on section key passed
  • new subsection ("regression-tests") added to datasets.yml
  • new yml files added for the datasets used by regression (primarily the only difference is that we don't want to run as many permutations of overquery or high k value in regression due to time concerns)
  • new datasets needed by regression added to dataset-metadata.yml

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026

Before you submit for review:

  • Does your PR follow guidelines from CONTRIBUTIONS.md?
  • Did you summarize what this PR does clearly and concisely?
  • Did you include performance data for changes which may be performance impacting?
  • Did you include useful docs for any user-facing changes or features?
  • Did you include useful javadocs for developer oriented changes, explaining new concepts or key changes?
  • Did you trigger and review regression testing results against the base branch via Run Bench Main?
  • Did you adhere to the code formatting guidelines (TBD)
  • Did you group your changes for easy review, providing meaningful descriptions for each commit?
  • Did you ensure that all files contain the correct copyright header?

If you did not complete any of these, then please explain below.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant