Support inserting based on batchsize into shuffler

[ayushdg]

Description

• This pr adds support for inserting into a shuffler with a batched method if available and adds support in the ExactDuplicateIdentification stage.
• Improves speed for exact dedup tests by ~25s on my machine (1:54s -> 1:29s)

Usage

# Add snippet demonstrating usage

Checklist

• I am familiar with the Contributing Guide.
• New or Existing tests cover these changes.
• The documentation is up to date with these changes.

[copy-pr-bot]

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

[ayushdg]

/ok to test 41ba9c0

[greptile-apps]

_{3 files reviewed, no comments}

_{Edit Code Review Agent Settings | Greptile}