Support INTERVAL data type in DB-API, arrow, and pandas connectors #836
Labels
api: bigquery
Issues related to the googleapis/python-bigquery API.
external
This issue is blocked on a bug with the actual product.
status: blocked
Resolving the issue is dependent on other work.
type: feature request
‘Nice-to-have’ improvement, new feature or different behavior or design.
Follow-up to #826 since pandas and Arrow do not yet have a structured type that aligns with
INTERVAL
. The existing Timedelta support would work for INTERVALS with only a time component, but it is not calendar aware, so supporting year, month, and day intervals would require some mapping to timedelta, which is not ideal.Why is a new data type needed?
Note: DB-API support is included here because it uses the BigQuery Storage API, where we use the Arrow wire format.
TODO:
to_dataframe
object
, sincetimedelta64
doesn't have years/months.to_arrow
type is expected datatypeinsert_rows_from_dataframe
load_rows_from_dataframe
(CSV)load_rows_from_dataframe
(Parquet)The text was updated successfully, but these errors were encountered: