-
Notifications
You must be signed in to change notification settings - Fork 698
Open
Labels
enhancementNew feature or request.New feature or request.t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.
Milestone
Description
❗ Note: This is a starting point for discussion, not a final decision. The team should review and adjust before any implementation begins.❗
Context
The browser pool and the whole browsers subpackage have several architectural issues and poor abstractions. These make it difficult to extend (e.g., remote browser support in #1743 and maybe even lifecycle hooks in #1741). We've discussed these issues a few times already. With the introduction of #1743, this may be a good opportunity to finally establish a well-structured and robust design for the browser pool. This effort should also be coordinated with the new user pool initiative in #1435.
Reference
- Python:
src/crawlee/browsers/ - JS BrowserPool:
packages/browser-pool/src/browser-pool.ts - JS abstract classes:
packages/browser-pool/src/abstract-classes/ - JS LaunchContext:
packages/browser-pool/src/launch-context.ts - JS fingerprinting hooks:
packages/browser-pool/src/fingerprinting/hooks.ts
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or request.New feature or request.t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.
Type
Fields
Give feedbackNo fields configured for issues without a type.