Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Kernel][Expressions] Add support for LIKE expression #3103

Merged
merged 10 commits into from
May 23, 2024

Conversation

krishnanravi
Copy link
Contributor

@krishnanravi krishnanravi commented May 15, 2024

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

Add SQL LIKE expression support in Kernel list of supported expressions and a default implementation.

Addresses part of #2539 (where STARTS_WITH as LIKE 'str%')

How was this patch tested?

added unit tests

Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
@krishnanravi
Copy link
Contributor Author

@vkorukanti this is ready for review.

@vkorukanti vkorukanti changed the title [Kernel][Predicate] - Add support for LIKE expression [Kernel][Expressions] Add support for LIKE expression May 20, 2024
Copy link
Collaborator

@vkorukanti vkorukanti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look great! Thanks for the PR. Few minor comments. Let me know if you have any questions.

@vkorukanti vkorukanti added this to the 3.3.0 milestone May 20, 2024
created special eval for Like expression

Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Copy link
Collaborator

@vkorukanti vkorukanti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Few minor comments. Otherwise looks good to go.

Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Copy link
Collaborator

@vkorukanti vkorukanti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@krishnanravi LGTM. Very close to merging. Just one comment about the empty batch handling and few more test cases. Once those done, then this PR is good to merge.

Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Copy link
Collaborator

@vkorukanti vkorukanti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. thank you @krishnanravi!

@vkorukanti vkorukanti merged commit 0deef04 into delta-io:master May 23, 2024
10 checks passed
@krishnanravi krishnanravi deleted the likePredicateSupport branch May 23, 2024 16:16
longvu-db pushed a commit to longvu-db/delta that referenced this pull request May 28, 2024
## Description
Add SQL `LIKE` expression support in Kernel list of supported expressions and a default implementation.

Addresses part of delta-io#2539 (where `STARTS_WITH` as `LIKE 'str%'`)

## How was this patch tested?
added unit tests

Signed-off-by: Krishnan Paranji Ravi <krishna.pr@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants