Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add column functions to check for valid date strings #144

Merged
merged 10 commits into from
Jan 31, 2025

Conversation

ghanse
Copy link
Contributor

@ghanse ghanse commented Jan 29, 2025

Changes

Added the following column functions:

  • is_valid_date
  • is_valid_timestamp

Users can specify the format as a string which should adhere to the Spark Datetime pattern specifications.

Linked issues

Resolves #143

Tests

Added test_col_is_valid_date and col_is_valid_timestamp functions to the integration tests.

  • manually tested
  • added unit tests
  • added integration tests

@ghanse ghanse added the enhancement New feature or request label Jan 29, 2025
@ghanse ghanse requested a review from a team as a code owner January 29, 2025 15:06
@ghanse ghanse requested review from pratikk-databricks and removed request for a team January 29, 2025 15:06
Copy link

github-actions bot commented Jan 29, 2025

✅ 113/113 passed, 1 skipped, 24m39s total

Running from acceptance #301

Copy link
Contributor

@mwojtyczka mwojtyczka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ghanse
Copy link
Contributor Author

ghanse commented Jan 31, 2025

@mwojtyczka made a few updates and resolved your comments, tests are succeeding.

@mwojtyczka mwojtyczka merged commit 27bc038 into main Jan 31, 2025
8 checks passed
@mwojtyczka mwojtyczka deleted the feature_valid_date_checks branch January 31, 2025 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEATURE]: Add checks for valid date/timestamp strings
2 participants