Claude/improve flowframe api y c4 pz#447
Draft
Edwardvaneechoud wants to merge 2 commits intomainfrom
Draft
Conversation
…alog auto-registration - Add "virtual" to write_mode Literal on write_catalog_table (frame + module-level + WriteMode TypeAlias) so the type hint matches what core already accepts. - Expose output_field_config on cloud storage readers (scan_*_from_cloud_storage / scan_delta / read_from_cloud_storage) so Python-built flows can enforce the same schema validation the canvas does. Re-export OutputFieldConfig + OutputFieldInfo from flowfile_frame. - Add register_flow_with_catalog() for Python-authored flows: persists the flow as YAML and creates a FlowRegistration row, mirroring how the canvas registers flows. Defaults to General > Python Editor under ~/.flowfile/flows/python_editor_flows/. - Auto-register on write_mode='virtual' when the flow has no source_registration_id, so users don't have to manually save+register before producing virtual catalog tables. - Seed General > Python Editor namespace and add python_editor_flows_directory storage path. https://claude.ai/code/session_01M3GMQP8Tk7BeUx9LbMH7Tx
…_code When the upstream polars_expr_transformer can express a flowfile formula as native polars/flowframe code (e.g. now(), [a]+[b], "literal"), upgrade with_columns(flowfile_formulas=...) to use a polars_code/formula node built from the translated Expr instead of the legacy formula path. Falls back transparently when the translator can't handle a formula (e.g. to_date with a format string) and is skipped when the user supplies explicit output_column_datatypes. The upgrade is value-preserving: round-trippable formulas like [a]+[b] still land as formula nodes (their _ff_repr round-trips losslessly), while non-round-trippable ones like now() now produce polars_code nodes. Also add a unit test confirming output_field_config is exposed on every cloud storage reader helper, so Python flows can opt into the schema validation that runs at the core layer. - Bump polars-expr-transformer to >=0.5.4 (ships to_flowframe_code). - Add _try_translate_flowfile_formulas() helper in flow_frame.py. https://claude.ai/code/session_01M3GMQP8Tk7BeUx9LbMH7Tx
✅ Deploy Preview for flowfile-wasm canceled.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.