‹ 返回总目录
工具 最近更新07-27

explore-run

| 2026-08-01 收录(在榜5天)

☆ 收藏
🛒 📚 AI提效实战指南 · 图解Skill🛒 📱 大流量手机卡 · 低月租📣 加入推广 · 佣金80-300/张 ›

🛍️ 更多精选好物 ›

📊 公开数据一览

📦 榜单安装量2.1K
⭐ GitHub Stars43(fork 7)
🗓️ 最近推送2026-07-27
🌱 项目创建2026-02-03
💻 语言 / LicenseTypeScript · MIT
🐛 开放Issue4

📝 工具简介

CLI for AI-powered web scraping, structured data extraction, web search, multi-page crawling, and scheduled page-change monitoring powered by the ScrapeGraph AI API. Turn any URL into markdown, HTML, screenshots, links, images, summaries, or brand assets; pull structured JSON with a prompt + schema; watch pages on a cron with webhook alert

📖 怎么用

全局装用 `npm install -g just-scrape@latest`,或者临时跑 `npx just-scrape@latest --help`。装完先设环境变量 `export SGAI_API_KEY=<your-api-key>`,然后跑 `just-scrape validate` 验证一下。开始用很简单:`just-scrape scrape "https://example.com" -f markdown,links --json` 抓页面,`just-scrape extract "https://store.example.com" -p "Extract product names and prices"` 提结构化数据,`just-scrape search "AI regulation EU" --time-range past_week` 搜网页。想装成 agent 技能就 `npx skills add https://github.com/ScrapeGraphAI/just-scrape --skill just-scrape`。

📋 迷你测评

AI驱动的网页抓取CLI工具,支持结构化数据提取、搜索、多页爬取和定时监控。亮点是URL转markdown或JSON,方便后续处理。

📄 README 要点

这是ScrapeGraphAI的命令行工具,把网页抓取功能包装成简单的终端命令。核心功能包括:抓取已知URL并输出markdown、HTML、截图、链接、图片、摘要或结构化JSON;用提示词和可选schema从URL提取结构化数据;搜索网页并对结果做提取;爬取网站某个区域的多页内容;定时监控页面变化并可选webhook通知。技术栈是Node.js 22、Bun包管理器、TypeScript和citty框架。安装后直接用命令行操作,还附带一个给AI代理用的技能文件。适合需要快速抓网页、做数据提取、监控页面变化的数据分析师和开发者,特别是喜欢命令行操作的人。

查看英文原文
just scrape Command line interface for ScrapeGraphAI. This repo contains the CLI source, command modules, build setup, smoke tests, demo assets, and the installable coding agent skill. Scope just scrape wraps ScrapeGraphAI workflows behind a small terminal interface: scrape gets a known URL as markdown, html, screenshot, links, images, summary, branding, or structured JSON extract gets structured JSON from a known URL with a prompt and optional schema search searches the web and can run extraction over results crawl collects multiple pages from a bounded site section monitor schedules recurring page checks and optional webhook notifications history , credits , and validate cover operational API workflows The detailed agent facing workflow lives in skills/just scrape/SKILL.md. Stack Runtime: Node.js =22 Package manager used in this repo: Bun Language: TypeScript, ESM CLI framework: citty Prompts/output: @clack/prompts , chalk Environment loading: dotenv ScrapeGraph client: scrapegraph js Build: tsup Checks: TypeScript, Biome, Bun test Repository Layout [安装/使用命令见下方] Install [安装/使用命令见下方] Package: just scrape on npm. Configuration Get an API key at scrapegraphai.com/dashboard. [安装/使用命令见下方] API key resolution order: 1. SGAI API KEY 2. .env 3. /.scrapegraphai/config.json 4. interactive prompt Environment variables: Variable Description Default SGAI API KEY ScrapeGraph API key none SGAI API URL Override API base URL https://v2 api.scrapegraphai.com SGAI TIMEOUT Request timeout in seconds 120 SGAI DEBUG Debug logs to stderr 0 Usage [安装/使用命令见下方] Use just scrape help for command options. Use json when piping output into scripts or agents. Coding Agent Skill Install the skill with: [安装/使用命令见下方] Skill source: skills/just scrape/SKILL.md Browse the published skill: skills.sh/scrapegraphai/just scrape/just scrape Development [安装/使用命令见下方] Common commands: [安装/使用命令见下方] When adding a command, put the command module in src/commands/ , register it in src/cli.ts , and keep shared parsi

💬 评论(0)

交流使用体验、避坑建议;违规内容将被删除

💬 意见反馈 / 联系客服

数据来源:skills.sh 榜单 + GitHub 公开数据,非人工实测,仅供参考