-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor for BigQueryPartition class #54
Refactor for BigQueryPartition class #54
Conversation
…ed table is expired and no longer accessible.
…rom time to time, the pipeline should be able to recover reading from the beginning of the split or the last checkpointed offset
/gcbrun |
...ctor-bigquery/src/main/java/com/google/cloud/flink/bigquery/services/TablePartitionInfo.java
Show resolved
Hide resolved
...r-bigquery/src/main/java/com/google/cloud/flink/bigquery/common/utils/BigQueryPartition.java
Outdated
Show resolved
Hide resolved
...gquery/src/test/java/com/google/cloud/flink/bigquery/common/utils/BigQueryPartitionTest.java
Outdated
Show resolved
Hide resolved
/gcbrun |
...uery/src/main/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartition.java
Show resolved
Hide resolved
...uery/src/main/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartition.java
Outdated
Show resolved
Hide resolved
...uery/src/main/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartition.java
Outdated
Show resolved
Hide resolved
...uery/src/main/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartition.java
Outdated
Show resolved
Hide resolved
.../src/test/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartitionTest.java
Outdated
Show resolved
Hide resolved
BigQueryPartition.formatPartitionRestrictionBasedOnInfo( | ||
Optional.of(info), "event", "2010-10-10")) | ||
.isEqualTo("event BETWEEN '2010-10' AND '2010-11'"); | ||
public void testCheckPartitionCompletedMonth() { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should add edge case tests for February as leap month, non-leap month, a 30 day month, a 31 day month.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add not completed 31 day month case. LGTM otherwise.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
.../src/test/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartitionTest.java
Outdated
Show resolved
Hide resolved
.../src/test/java/com/google/cloud/flink/bigquery/table/restrictions/BigQueryPartitionTest.java
Show resolved
Hide resolved
/gcbrun |
/gcbrun |
In preparation for the unbounded source implementation. Test coverage for partition related methods was improved as well.