[JAVA][CI] Adds a recipe for Flight SQL#391
Conversation
A very basic database server is implemented that uses the DataFusion query engine for answering SQL queries on single-file, write-once tables stored in the Arrow IPC format. Although this does not implement all the features and possibilities of FlightSqlProducer, it show cases the two main categories of concepts through the inclusion of tables (like catalog, database schema, sqlinfo, etc) and statement (like prepared statement and substrait statement). Some updates to the building of the Java Cookbook: Using the release property instead of the compiler source and target values which is deprecated.
|
Apparently I did not compile with full Java 11 support (or limitations in this context). I believe the compilation issue is fixed for Java 11. |
|
If someone could give me an approval for running, that would be awesome. |
Removed DataFusion because it requires other components to run. Now the example is purely Arrow based.
|
Anything I can do to help move this forward? |
lidavidm
left a comment
There was a problem hiding this comment.
I appreciate the contribution, but I'm wondering if this is really a "recipe" in the first place. In my mind, a recipe is meant to be a short code snippet accomplishing a narrow task, while this is more of a general example project implementing a full-blown database server.
@raulcd do we have a better place for this kind of example code?
|
(I'm also going to hammer on #351 again; having a ton of code embedded into reST makes it hard to author and to review) |
I get your point. It is not like reading a CSV where you only have to change the filename. However, I do think it is a recipe, but one with more parameters. Nevertheless, I propose to move it to the documentation. I can add more explanation about Flight SQL, build up the example/recipe a bit more in parts. |
|
Closing in favor of GH-979 |
A very basic database server is implemented that uses the DataFusion query engine for answering SQL queries on single-file, write-once tables stored in the Arrow IPC format.
Although this does not implement all the features and possibilities of FlightSqlProducer, it show cases the two main categories of concepts through the inclusion of tables (like catalog, database schema, sqlinfo, etc) and statement (like prepared statement and substrait statement).
Some updates to the building of the Java Cookbook: Using the release property instead of the compiler source and target values which is deprecated.