Cannot read all data while executing BinaryRowInputFormat

[papachord]

Describe the bug

Each time calling clickhouse::Client.insert, I always encountered the error Cannot read all data. But, when I execute an insert test in the clickhouse CLI, it works, so I suspect it might be an issue with the Rust ClickHouse client.

I suspect that it might be caused by Option with default. In fact ,this column owns default value, so it dont need to be Nullable, but it seems that clickhouse-rs could not resolve this.

No matter inserting None, or serde with skip_serializing_if = "Option::is_none", it does not work. And we do need this value while selecting from table.

Steps to reproduce

1. Setup schema

Create table with default value col: created_at DateTime DEFAULT now()

2. Define the data struct

#[serde(skip_serializing_if = "Option::is_none")]
#[serde(with = "clickhouse::serde::chrono::datetime::option")]
created_at: Option<DateTime<Utc>>,

3. Insert

    pub async fn insert(usr_stat: &UsrStat, state: &State) -> Result<()> {
        let mut insert = state.client.insert(USR_STAT_TABLE)?;
        insert.write(usr_stat).await?;
        insert.end().await?;
        Ok(())
    }

Error log

Error: Clickhouse(BadResponse("Code: 33. DB::Exception: Cannot read all data. Bytes read: 5. Bytes expected: 8.: (at row 1)\n: While executing BinaryRowInputFormat. (CANNOT_READ_ALL_DATA) (version 25.6.5.41 (official build))"))

Configuration

Environment

• Client version: 0.13.3
• OS: WSL Debian 12.9 on Windows11 24H2 (It works on localhost web sql )

ClickHouse server

• ClickHouse Server version: 25.6.5.41

[slvrtrn]

#[serde(skip_serializing_if = "Option::is_none")]

I think you can't do that, as CH expects 0 or 1 that denotes if a Nullable field contains the value. Having this attribute prevents the serializer to write the required byte.

Regarding

In fact ,this column owns default value, so it dont need to be Nullable, but it seems that clickhouse-rs could not resolve this.

If the column is not Nullable in the database, then it's schema mismatch between the CH table and your struct. You should remove Option in this case. In other words, use DateTime<Utc> for DateTime columns, and Option<DateTime<Utc>> only if it is defined as Nullable(DateTime).

You will have clearer error messages about that once we release #221 + #244 that enables validation by default.

it seems that clickhouse-rs could not resolve this

Yes, we can't do that in the client.