Skip to content

feat(tools): add social_platforms tool for Apify social scraping#1

Open
protoss70 wants to merge 13 commits intomain-syncedfrom
feat/apify-social-scrapers
Open

feat(tools): add social_platforms tool for Apify social scraping#1
protoss70 wants to merge 13 commits intomain-syncedfrom
feat/apify-social-scrapers

Conversation

@protoss70
Copy link
Collaborator

@protoss70 protoss70 commented Feb 16, 2026

What

Adds TikTok, Instagram, Youtube and LinkedIn scrapers as a built-in tool for the OpenClaw agent.

How

Created a new tool called social-platforms where by only providing you Apify token it can start scraping these websites

How to test

Testing this will be tricky because you need a VPS with Docker installed. After that you can follow the following commands to start your OpenClaw

  1. Clone this repository at the feat/apify-social-scraper branch
  2. Cd into it cd openclaw
  3. put the following tokens into env files
cp .env.example .env
nano .env
  • APIFY_TOKEN (at the bottom, make sure to uncomment it)
  • A model provider token (I use Anthropic) Smarter models work better for testing
  1. build the docker: docker build -t openclaw .
  2. run the docker with the following command (NOTE it is important to keep the restart logic)
sudo docker run -d \
  --name openclaw-gateway \
  --restart unless-stopped \
  --env-file .env \
  -p 3000:3000 \
  openclaw \
  node openclaw.mjs gateway --allow-unconfigured --bind lan
  1. Configure openclaw models, choose model -> select your provider -> make sure a model is selected (it will restart once you do this so wait about 5 seconds)
sudo docker exec -it openclaw-gateway node openclaw.mjs configure
  1. Run the following command to start chatting with your OpenClaw agent. You can ask it to list all available built-in tools it has. If the social scraper not showing up, there is an issue with your settup. If it is showing you can start prompting your way
sudo docker exec -it openclaw-gateway node openclaw.mjs tui

Pipeline

The pipeline fails here because we dont have all repository secrets but you can check out the actual PR pointing to the openclaw repo here: openclaw#19421

Adds Instagram, TikTok, and YouTube scraping via Apify actors with
detailed LLM-facing tool descriptions, caching, and config support.
@protoss70 protoss70 self-assigned this Feb 16, 2026
@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@github-actions
Copy link

⚠️ Formal models conformance drift detected

The formal models extracted constants (generated/*) do not match this openclaw PR.

This check is informational (not blocking merges yet).
See the formal-models-conformance-drift artifact for the diff.

If this change is intentional, follow up by updating the formal models repo or regenerating the extracted artifacts there.

@protoss70 protoss70 force-pushed the feat/apify-social-scrapers branch from 691b5ea to f31d5ad Compare February 17, 2026 20:02
@protoss70 protoss70 changed the base branch from main to main-synced February 17, 2026 20:20
@protoss70 protoss70 marked this pull request as ready for review February 17, 2026 21:01
@protoss70 protoss70 requested review from MQ37 and drobnikj February 17, 2026 21:01
Copy link

@MQ37 MQ37 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quickly went through it and LGTM, merge it if it works 👍 I just do not like the hardcoded Actor input parameters, but let's keep it simple - but we need to make sure we keep it updated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants