Logic for rules validation

[RishabGulati7]

Currently there is no validation for the rules_df that is provided to SE. This PR adds a function that checks whether the following keys are present in the rules_df and also if they have null values:

• product_id
• table_name
• rule
• rule_type

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.
• All new and existing tests passed.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 98.44%. Comparing base (11f52a9) to head (0f91260).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #288   +/-   ##
=======================================
  Coverage   98.43%   98.44%           
=======================================
  Files          27       27           
  Lines        3255     3274   +19     
=======================================
+ Hits         3204     3223   +19     
  Misses         51       51           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[saiboddu759]

LGTM

[Copilot]

Pull request overview

Adds validation to ensure rules_df passed into SparkExpectations includes required columns and that required fields are non-null / non-empty, with accompanying unit tests.

Changes:

• Introduces _validate_rules() in SparkExpectations and calls it during initialization.
• Adds helper checks for missing columns and NULL/empty values in required columns.
• Adds unit tests + fixtures covering empty DF, missing columns, NULL/empty values, and error message formatting.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File	Description
spark_expectations/core/expectations.py	Adds rules DataFrame validation and wires it into __post_init__.
tests/unit/core/test_expectations.py	Adds unit tests validating the new rules validation behavior.
tests/unit/core/conftest.py	Adds fixtures for missing-column / NULL / empty-string rules DataFrame scenarios.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[AmaniG77]

LGTM

[ravishikhar]

lgtm, Thanks