Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: HTTP pull source #28

Open
edlee2121 opened this issue May 28, 2022 · 1 comment
Open

feat: HTTP pull source #28

edlee2121 opened this issue May 28, 2022 · 1 comment
Labels
area/source enhancement New feature or request

Comments

@edlee2121
Copy link
Contributor

edlee2121 commented May 28, 2022

Is your feature request related to a problem? Please describe.
Desirable to have a source that periodically pulls from an http endpoint to generate messages.
This would be very useful for demos as well since we can pull from services that everyone can access rather than just synthetically generated data.

Describe the solution you'd like
A source that generates a stream of data by periodically pulling from an http endpoint.

Describe alternatives you've considered
Using an S3 bucket as a source (not many interesting data is available to everyone in S3 buckets).

Additional context
None


Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.

@edlee2121 edlee2121 added enhancement New feature or request area/source labels May 28, 2022
@vigith
Copy link
Member

vigith commented May 28, 2022

We might be able to do this using our current generator source with a UDF that can do cURL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/source enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants