Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug Report - staging table stuck (again) #8442

Closed
javanveldhuizen opened this issue Jan 14, 2025 · 3 comments
Closed

Bug Report - staging table stuck (again) #8442

javanveldhuizen opened this issue Jan 14, 2025 · 3 comments
Assignees
Labels
Bug Arctos is not performing as it should. Collection Type - Paleontology Priority-Critical (Arctos is broken) Critical because it is breaking functionality.

Comments

@javanveldhuizen
Copy link

Describe the bug
A clear and concise description of the encountered error.
I am trying to validate some records in the catalog bulkloader and it is taking a lot longer than it normally does. The past 8 chunks took around 20-30 minutes to validate the records. For some reason this chunk is taking several hours even though it has the same amount of records.

To Reproduce
Steps to reproduce the behavior:

  1. Upload data to the bulkloader staging table.
  2. Click on the Validate button.
  3. Go to bulkloader home and see current data table section

Screenshots
If applicable, add screenshots to help explain your problem.
Screenshot 2025-01-14 130901

Data
If this involves external data, attach the actual data that caused the problem. Do not attach a transformation or subset. You may ZIP most formats to attach, or request a Box email address for very large files.
bulkloader_fossil verts_chunk 9.csv

Desktop (please complete the following information):

  • OS: Windows 11 Enterprise
  • Browser: Chrome
  • Version: 131.0.6778.265 (Official Build) (64-bit)

Additional context
Add any other context about the problem here.
Possibly related to this bug: #8421

@javanveldhuizen javanveldhuizen added Priority-Critical (Arctos is broken) Critical because it is breaking functionality. Bug Arctos is not performing as it should. Collection Type - Paleontology labels Jan 14, 2025
@dustymc
Copy link
Contributor

dustymc commented Jan 14, 2025

Taking longer (even MUCH longer) is not surprising, load varies wildly, data can be different, back-end things change, etc.

That said, this worked as expected for me (in 610958.544 ms), your data are https://arctos.database.museum/Bulkloader/BulkloadSpecimens.cfm, I would guess that you're locking yourself out by clicking in multiple tabs or similar but that's just a guess, I don't see anything very informative from here. Please let me know if you can re-create, I'd not mind doing something a little more sophisticated than periodically killing any stragglers in ArctosDB/dev#150!

@javanveldhuizen
Copy link
Author

Thanks, @dustymc. Everything looks good on my end. Much appreciated.

Taking longer (even MUCH longer) is not surprising, load varies wildly, data can be different, back-end things change, etc.

I was wondering if this may be the case. Good to know to not worry too much about it.

I would guess that you're locking yourself out by clicking in multiple tabs or similar but that's just a guess,

Interesting. I didn't have multiple tabs open for Arctos (this go around). Question: Is it better to just use the bulkloader and don't touch other Arctos stuff while the records are validating?

Please let me know if you can re-create,

Can do. I have one more large chunk like this to upload. Will reopen this issue if I have the same problem.

@dustymc
Copy link
Contributor

dustymc commented Jan 14, 2025

just use the bulkloader and don't touch other Arctos stuff while the records are validating?

That shouldn't matter, requesting the check creates the lock and the check finishing removes it, so disrupting that process (eg by loading more records, deleting them, requesting the same check in another tab, or possibly/probably that thing I haven't figured out yet!) should be all that matters. Should....

It's no problem at all, and thanks for the patience. Let me know if you have any more problems, and of course you're always welcome to send me more than the UI can handle if that proves convenient.

@dustymc dustymc closed this as completed Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Arctos is not performing as it should. Collection Type - Paleontology Priority-Critical (Arctos is broken) Critical because it is breaking functionality.
Projects
None yet
Development

No branches or pull requests

2 participants