Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests for Hive Sink and Source. #1125

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
+728 −1
Open

Integration tests for Hive Sink and Source. #1125

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Integration tests for Hive Sink and Source.
@jasir99
jasir99 committed Jun 4, 2021
commit 70651049376d8e7a0211986f02fe9c20b3a26957
713 changes: 713 additions & 0 deletions integration-test-remote/src/test/java/io/cdap/cdap/app/etl/batch/HiveConnectorsTest.java
View file

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions integration-test-remote/src/test/resources/hive_source.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"string_value":"Zoe","int_value":869874622,"float_value":82.0225,"double_value":7763.959904,"decimal_value":[0, 0, 0, 6, 53, -43, -6, -105, 82],"struct_value":{"id":1,"name":"Zoe"},"map_value":{"name":"Zoe"},"array_value":[1,2,3],"timestamp_millis_value":1622462255628,"boolean_value":false}
1 change: 1 addition & 0 deletions integration-test-remote/src/test/resources/hive_source_multiple_partitions.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"string_value":"Zoe","int_value":869874622,"float_value":82.0225,"double_value":7763.959904,"decimal_value":[0, 0, 0, 6, 53, -43, -6, -105, 82],"struct_value":{"id":1,"name":"Zoe"},"map_value":{"name":"Zoe"},"array_value":[1,2,3],"timestamp_millis_value":1622462255628,"boolean_value":false,"partition_column":"NY","partition_column2":"US"}
1 change: 1 addition & 0 deletions integration-test-remote/src/test/resources/hive_source_partition.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"string_value":"Zoe","int_value":869874622,"float_value":82.0225,"double_value":7763.959904,"decimal_value":[0, 0, 0, 6, 53, -43, -6, -105, 82],"struct_value":{"id":1,"name":"Zoe"},"map_value":{"name":"Zoe"},"array_value":[1,2,3],"timestamp_millis_value":1622462255628,"boolean_value":false,"partition_column":"NY"}
13 changes: 12 additions & 1 deletion pom.xml
View file
Original file line number Diff line number Diff line change
@@ -47,7 +47,7 @@
<kafka.version>0.8.2.2</kafka.version>
<snappy.version>1.1.1.7</snappy.version>
<chaosmonkey.version>0.1.0-SNAPSHOT</chaosmonkey.version>

<hive.version>2.3.8</hive.version>
<!-- Skip all test cases by default. The different test cases are enabled in the profiles defined below -->
<skip.remote.test>true</skip.remote.test>
<skip.standalone.test>true</skip.standalone.test>
@@ -212,6 +212,17 @@
<artifactId>junit</artifactId>
<version>${junit.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-service</artifactId>
<version>${hive.version}</version>
<exclusions>
<exclusion>
<groupId>asm</groupId>
<artifactId>asm</artifactId>
</exclusion>
</exclusions>
</dependency>
</dependencies>

<repositories>