HADOOP-19609. ABFS: Apache Client Connection Pool Relook #7817
+341
−341
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
JIRA: https://issues.apache.org/jira/browse/HADOOP-19609
Description
The ABFS (Azure Blob File System) driver currently utilizes the default JDK HTTP client to communicate with the Azure Storage backend service, known as XFE. While the JDK client is lightweight, simple, and built into the JDK, it falls short when it comes to providing advanced connection management capabilities.
By switching to Apache HTTP Client, the ABFS driver aims to gain better control over HTTP connections while enabling enterprise-level features such as configurable keep-alive strategies, idle connection eviction, retries on failure, and better resource usage tracking.
This is the initial PR where we have optimized the structure of keep alive cache for Apache client. Migration from JDK and Apache client will be done in subsequent PR.