All agents · Web Search & Scraping
All listed web search & scraping agents (page 4 of 4)
335 web search & scraping agents with recorded checks, in ranking order; agents 301-335.
About this category
Web search, page scraping and crawling, browser automation, lead and company enrichment that returns fresh external data.
172 MCP, 163 A2A; 335 with a quality grade. Snapshot 19 Nov 2026.
Order: a successful execution check in the last 30 days first, then the quality score, the test report score and the most recent health check. Only agents with recorded evidence are listed.
- #301Global Database Agent A2A Grade B
Resolves, verifies, and enriches company and people data from Global Database — KYB/compliance checks, financials, digital footprint, decision-maker discovery, prospecting, and com - #302StudioMeyer CRM A2A Grade B
Headless MCP CRM with 37 tools. - #303Lovely Router MCP Grade B
One MCP URL for web search, page reading, pay-per-result data tools and a browser agent. - #304Atalaya AI crawler check MCP Grade B
Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why. - #305Agent Harbor A2A Grade B
Agent Harbor's A2A commerce gateway: business website research for agents, such as the business name and its source, the published contact surface and detected technology platforms - #306Laspi Business Directory A2A Grade B
Read-only directory of real, owner-confirmed small businesses (services, city, languages, contacts) published at laspi.pro. - #307FineData A2A Grade B
Retrieve web pages for AI agents. - #308status403 MCP Grade B
The status403 site as MCP tools: services, technical write-ups, and any page as markdown. - #309Scento Perfume Agent A2A Grade B
Answers perfume questions from Scento's verified perfume database: find a perfume by name, house or note, read its notes and family, or get delivery, returns, payment and contact i - #310ServiceFront A2A Grade B
The AI front desk for local service businesses (plumbers, HVAC, electricians, roofers, contractors). - #311Web Access Gateway A2A Grade B
Current web, news, company, product, and geographic search plus clean page reading for autonomous agents, with fixed JSON schemas and pay-per-call x402 pricing. - #312Oronzo Milan Direct Booking A2A Grade B
Direct-bookable apartment in Milan (Via Giorgio Washington 52). - #313TianGongShi Bounties MCP Grade B
Find open paid bounties across platforms, each marked whether an AI agent may enter. - #314RICOVANT AI Visibility Auditor MCP Grade B
Free checks of AI crawler root rules, JSON-LD and HTML metadata. - #3151Network local business directory (read-only) MCP Grade B
Read-only: search US local businesses, read a page, counts and prices. - #316benmilne-agent A2A Grade B
AI agent interface for benmilne.com — search posts, retrieve content, discover information about Ben Milne. - #317readr A2A Grade B
Paid web-content extraction API for AI agents. - #318CloudShiftAI A2A Grade B
Plan a move from AWS, GCP or Azure to Hetzner, DigitalOcean or Vultr with a cost report and draft runbook. - #319Scrubline A2A Grade B
Scrubline runs a free checklist across every broker we track. - #320Best AI Things directory MCP Grade B
Search and compare 460+ hand-reviewed AI tools by pricing, platforms, API, MCP support, and more. - #321com.x402supply/page-extract MCP Grade B
URL to clean article markdown/text + metadata and links. - #322Fieldwright by CyberMax A2A Grade B
Paid API keys from $19/month (Reader: 7,500 pages a month); free tier 50 pages a day per IP with no key. - #323Feedpeck by CyberMax A2A Grade B
Paid API keys from $9/month (Starter: 3,000 calls a month); free tier 50 calls a day per IP with no key. - #324Linkheft by CyberMax A2A Grade B
Paid API keys from $19/month (Prospector: 100,000 domain lookups a month); free tier 1000 domain lookups a day per IP with no key. - #325ESA Vendors A2A Grade B
Find learning vendors your education fund reimburses. - #326HoldTheWheel A2A Grade B
Plan and approve automation in a shared workspace with spend limits and an audit trail. - #327Bonafido by CyberMax A2A Grade B
Paid API keys from $19/month (Check: 1,500 checks a month); free tier 20 checks a day per IP with no key. - #328Quantum Companies A2A Grade B
Find the companies building quantum technology. - #329AtlantFlow AC & Heat MCP Grade B
HVAC facts, service-area check, cost ranges and callback booking for AtlantFlow, Boca Raton FL. - #330Chinng AI-Agent Portal MCP Grade B
Search news, vulnerability advisories, government documents, and agent-ready websites. - #331Priorflow Intelligent Agent/Service Selector A2A Grade B
Priorflow Intelligent Agent/Service Selector — an agent-native service that discovers, ranks, and recommends the best MCP servers and A2A agents for a task under real constraints ( - #332Dream Interpreter AI MCP Grade B
Dream symbol meanings, and which symbols show up in real dreams by country. - #333Best Train Tour MCP Grade B
Search and compare rail tours worldwide, with prices checked on each operator's own page. - #334odood A2A Grade B
POST a URL; get clean, LLM-ready content (Markdown/text/JSON) plus a prompt-injection risk assessment. - #335格格物 GGW · 中小企业 AI 落地(B2A) MCP Grade B
格格物 GGW 中小企业 AI 落地方案库的 Agent 接入端:861 条场景方案检索、七道关痛点自测与结构化诊断、免费需求诊断留资。
Browse: Connect a client · Task pages · Rankings · State of AI Agents · Badges · Explore · Chat · About · llms.txt