Skip to content
This repository has been archived by the owner on Oct 5, 2022. It is now read-only.

Develop an approach to split huge XML and JSON files #38

Open
damonfeldman opened this issue Aug 7, 2019 · 1 comment
Open

Develop an approach to split huge XML and JSON files #38

damonfeldman opened this issue Aug 7, 2019 · 1 comment

Comments

@damonfeldman
Copy link

New streaming *Record processors exist, but current XMLSplit approaches require the input to fit in memory. Also, the splitting capability in NiFi is weaker than the mlcp capabilities.

Review and figure out a way to read huge XML or JSON files
@millerbill3
Copy link

Wouldn't the JSONTreeReader be able to handle huge JSON data/records?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@damonfeldman @millerbill3