[Investigate] scope PDF parsing functionality  #18

Activity

1. sidmohan0

   self-assigned this

   on Mar 24, 2024
2. bazooka720 commented on Mar 25, 2024

   

   bazooka720

   on Mar 25, 2024

   More actions

   This will be good one to have.

   👍React with 👍1Reacted by Sid Mohan
3. sidmohan0

   added

   enhancementNew feature or requestNew feature or request

   on Apr 1, 2024
4. sidmohan0

   added this to the v2.4.0 milestone on Apr 1, 2024
5. sidmohan0 commented on Apr 1, 2024

   

   sidmohan0

   on Apr 1, 2024

   ContributorAuthor

   More actions

   @bazooka720 we have a beta release (datafog==2.4.0b3) if you're interested in giving it a spin. Planning on releasing 2.4.0 tonight.

   Main update:

   • added unstructured.io support via an 'upload_file' function in the DataFog class.
   • added unstructured[pdf] and unstructured[pptx] packages
   • unstructured has out-of-the-box support for a variety of formats so I'm writing some tests to confirm support across those but it did pass unit tests for pdf and pptx.

   sample usage:
   

   TODO: expose OCR/Image capabilities (which using Unstructured involves passing a 'high_res' param in for setting) - will try to fit that in for tonight's release.

   Let me know if you have any questions/feedback and thanks for all the input!

   👍React with 👍1Reacted by bazooka720
6. sidmohan0

   linked a pull request that will close this issuePDF text extraction with Unstructured #19on Apr 2, 2024
7. sidmohan0

   closed this as completedin #19on Apr 2, 2024