Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: Improved error message and raise new error for small-string NaN edge case in HDFStore.append #60829

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

JakeTT404
Copy link

Updated pytables.py to improve error messages caused by datatype mismatches in HDFStore.append. Also added ValueError for when the NaN representation cannot fit into the column. Modified tests concerning the improved error message and added new test for when column is type string with length <3 and as such nan_rep 'nan' is too big.

@JakeTT404 JakeTT404 changed the title Improved error message and raise new error for small-string NaN edge case in HDFStore.append ENH: Improved error message and raise new error for small-string NaN edge case in HDFStore.append Feb 2, 2025
pandas/io/pytables.py Outdated Show resolved Hide resolved
pandas/io/pytables.py Outdated Show resolved Hide resolved
@mroeschke mroeschke added Error Reporting Incorrect or improved errors from pandas IO HDF5 read_hdf, HDFStore labels Feb 3, 2025
…Raise ValueError when nan_rep too large for pytable column. Add and modify applicable test code.
@JakeTT404 JakeTT404 force-pushed the Wrong-error-message-in-HDFStore.append branch from 04a8169 to 500ab5a Compare February 3, 2025 21:05
@JakeTT404
Copy link
Author

I've removed the comments mentioned and reverted the error type. I've replaced the test with a function of 3 tests testing the following cases:

  • Error on string column too small
  • Error on modified nan_rep too big
  • Success on small modified nan_rep in small string column

There may be some odd git stuff during me updating the main branch due to my unfamiliarity with the GitHub contribution workflow and git as a whole.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Error Reporting Incorrect or improved errors from pandas IO HDF5 read_hdf, HDFStore
Projects
None yet
2 participants