AI Agent & MCP Setup Guide
Autonomous Website Monitoring with AI Agents
The Webtools MCP server lets any MCP-compatible AI agent — Claude, Kiro, or your own — monitor your websites, run performance tests, audit crawls, and analyse uptime data using natural language. No local installation. No Node.js. Just add two lines to your agent config and start asking questions.
https://webtools.ayalr.com/mcp
Streamable HTTP · JSON-RPC 2.0 · MCP 2024-11-05
Contents
Get your API key
The MCP server authenticates every request using your Webtools account email and an API key. You need both before connecting any agent.
- Sign in to Webtools and go to your Profile page.
- Scroll to the API Key section and click Generate API Key.
- Copy the key — it is shown only once. If you lose it, generate a new one (the old key is immediately invalidated).
Connect Kiro
Kiro reads MCP server configuration from a JSON file in your workspace or user home directory. Open (or create) the file at one of these paths:
- Workspace-level (applies to one project):
.kiro/settings/mcp.json - User-level (applies to all projects):
~/.kiro/settings/mcp.json
Add the following block inside the mcpServers object, replacing the placeholder values with your real credentials:
{
"mcpServers": {
"webtools": {
"url": "https://webtools.ayalr.com/mcp",
"headers": {
"X-Email": "[email protected]",
"X-API-Key": "your_api_key_here"
}
}
}
}
If you already have other MCP servers configured, merge the webtools block into your existing mcpServers object — don't replace the whole file:
{
"mcpServers": {
"some-other-server": { "..." },
"webtools": {
"url": "https://webtools.ayalr.com/mcp",
"headers": {
"X-Email": "[email protected]",
"X-API-Key": "your_api_key_here"
}
}
}
}
After saving the file, Kiro reconnects automatically. You can also trigger a reconnect from the MCP Server view in the Kiro feature panel, or by searching MCP in the command palette.
Connect Claude Desktop
Open the Claude Desktop configuration file for your operating system:
| OS | Config file path |
|---|---|
| macOS | ~/Library/Application Support/Claude/claude_desktop_config.json |
| Windows | %APPDATA%\Claude\claude_desktop_config.json |
| Linux | ~/.config/Claude/claude_desktop_config.json |
Add the same webtools block as shown in Step 2. If the file doesn't exist yet, create it with this content:
{
"mcpServers": {
"webtools": {
"url": "https://webtools.ayalr.com/mcp",
"headers": {
"X-Email": "[email protected]",
"X-API-Key": "your_api_key_here"
}
}
}
}
Restart Claude Desktop after saving. The Webtools tools will appear in the tool picker (the icon) in any new conversation.
Verify the connection
Once your agent is configured, confirm it can reach the server before running any tests.
Option A — Ask the agent directly:
The agent will call get_quota and return your plan name, total monthly allowance, calls used, and remaining calls. This tool never consumes quota, so it's safe to call as many times as you like.
Option B — Test the endpoint directly with curl:
curl -X POST https://webtools.ayalr.com/mcp \
-H "Content-Type: application/json" \
-H "X-Email: [email protected]" \
-H "X-API-Key: your_api_key_here" \
-d '{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/call",
"params": {
"name": "get_quota",
"arguments": {}
}
}'
You should receive a JSON-RPC response like:
{
"jsonrpc": "2.0",
"id": 1,
"result": {
"content": [{
"type": "text",
"text": "{\n \"plan_name\": \"Pro\",\n \"total_calls\": 1000,\n \"used_calls\": 42,\n \"remaining_calls\": 958\n}"
}]
}
}
You can also GET https://webtools.ayalr.com/mcp (no auth required) to see the server's discovery metadata.
Your first agent prompt
With the server connected, try these prompts to get started. The agent will automatically discover and call the right tools.
Discover your data
"List all my sites, crawlers, and monitors."
Performance check
"Show me last week's performance scores for all my sites and flag anything with LCP above 3 seconds."
Uptime health
"Check all my uptime monitors and tell me which ones had failures in the last 24 hours."
SEO audit
"Run a crawl on my main site and summarise the broken links and pages with missing H1 tags."
Available Tools
The MCP server exposes 9 tools. The agent selects and calls them automatically based on your prompt — you don't need to name them explicitly.
| Tool | What it does | Plan required | Consumes quota |
|---|---|---|---|
get_quota |
Returns your plan name, total monthly API allowance, calls used, and remaining calls. | Any | No |
list_sites |
Lists all configured sites and their URLs. | Any | Yes |
run_site_test |
Triggers an async Lighthouse lab test for a site. Measures Core Web Vitals, performance, accessibility, SEO, and best practices. | Any | Yes |
get_site_results |
Returns Lighthouse scores and Core Web Vitals history for a site, grouped by URL. | Any | Yes |
list_crawlers |
Lists all crawler monitors with recent crawl summaries (broken links, non-200s, H1 issues). | Any | Yes |
run_crawl |
Queues an async full-site crawl. Checks for broken links, non-200 responses, duplicate H1s, mixed content, and security issues. | Any | Yes |
get_crawl_details |
Returns the full raw crawl report for a specific crawl execution. | Any | Yes |
list_monitors |
Lists all uptime, RUM, and Server monitors grouped by type. | Any | Yes |
get_monitor_results |
Returns uptime check results, RUM session data, or server metrics for a monitor. | Any | Yes |
Quota note: Each tool call that reads or writes data counts as one API call against your monthly allowance.
Use get_quota to check your remaining balance before running bulk operations.
Upgrade your plan on the pricing page to increase your allowance.
Example Agent Prompts
These prompts work with any MCP-compatible agent. The agent figures out which tools to call and in what order.
Performance monitoring
- "Check my quota, then run a performance test on site ID 1 and tell me the results when they're ready."
- "Compare this week's Lighthouse scores to last week's for all my sites. Highlight any URLs where performance dropped by more than 10 points."
- "Which of my pages has the worst Largest Contentful Paint over the last 30 days?"
- "After my next deployment, run a lab test on site 2 and fail if LCP exceeds 2.5 seconds."
SEO & crawl audits
- "Run a crawl on crawler ID 8 and give me a prioritised list of issues to fix."
- "How many broken links does my site have? Which pages are they on?"
- "Check the latest crawl results and tell me if there are any pages with duplicate H1 tags or missing titles."
- "Compare the last two crawls and tell me if the number of non-200 responses has increased."
Uptime & monitoring
- "Are all my uptime monitors healthy right now? Show me any that failed in the last 24 hours."
- "What's the average response time for monitor ID 12 over the last week?"
- "Check my server metrics for the last hour and tell me if CPU or memory looks abnormal."
Quota-aware automation
- "Check my quota first. If I have more than 20 calls remaining, run tests on all my sites and summarise the results."
- "How many API calls do I have left this month? Is it enough to run a full audit of all my sites and crawlers?"
How It Works
The Webtools MCP server implements the
Model Context Protocol
over Streamable HTTP. When your AI agent needs to monitor a website, it sends a
JSON-RPC 2.0 request to POST https://webtools.ayalr.com/mcp. The server authenticates
the request, executes the tool, and returns the result — all within a single HTTP round-trip.
1. Agent sends a prompt
You ask your AI agent a question in natural language. The agent decides which Webtools tools to call.
2. MCP server executes the tool
The server authenticates your credentials, runs the tool against the Webtools database, and returns structured JSON.
3. Agent reasons and responds
The agent interprets the data, applies your instructions, and delivers a clear answer — no manual dashboard needed.
Technical details
| Endpoint | https://webtools.ayalr.com/mcp |
| Transport | Streamable HTTP (POST for tool calls, GET for discovery) |
| Protocol | JSON-RPC 2.0 · MCP spec version 2024-11-05 |
| Authentication | X-Email + X-API-Key HTTP headers on every request |
| Batch requests | Supported — send a JSON array of requests in one POST |
| Async tools | run_site_test and run_crawl queue work in the background; use webhooks or poll for results |
Troubleshooting
- Check that the
urlfield in your config is exactlyhttps://webtools.ayalr.com/mcp(no trailing slash). - Make sure the
mcpServerskey is at the top level of the JSON object. - In Kiro, use the command palette → MCP: Reconnect Servers after saving the config file.
- In Claude Desktop, fully quit and relaunch the app after editing the config.
- Confirm the
X-Emailvalue matches the email address you use to log in to Webtools. - Regenerate your API key on the Profile page — the key is hashed on the server, so if you copied it incorrectly it won't match.
- Make sure there are no leading/trailing spaces in the key value in your config file.
The tools run_site_test, run_crawl, and get_site_results require a paid plan.
The read-only tools (get_quota, list_sites, list_crawlers, list_monitors, get_crawl_details, get_monitor_results) are available on all plans.
Upgrade your plan to unlock the full tool set.
You've used all your monthly API calls. Quota resets at the start of each billing month.
Upgrade your plan for a higher monthly allowance, or wait for the reset.
Use get_quota to check your current balance — it never consumes a call.
Both tools are asynchronous — they queue the work and return immediately. Tests typically complete within 1–3 minutes depending on the number of URLs.
Ask the agent to call get_site_results or get_crawl_details after a short wait, or provide a webhook_url when triggering the test so you're notified automatically when it finishes.
Autonomous Website Monitoring Using AI Agents and MCP
The Webtools MCP server bridges the gap between AI language models and real website monitoring data. By implementing the Model Context Protocol over a simple HTTPS endpoint, it lets any MCP-compatible agent — Claude, Kiro, GPT-4 with tool use, or your own custom agent — query live performance metrics, trigger Lighthouse audits, run SEO crawls, and check uptime status without any manual dashboard interaction.
What is MCP and why does it matter for monitoring?
MCP (Model Context Protocol) is an open standard that lets AI agents discover and call external tools at runtime. Instead of hard-coding API calls into your automation scripts, you describe your tools once and any MCP-compatible agent can use them. For website monitoring, this means you can ask an agent in plain English to investigate a performance regression, triage broken links from a crawl, or summarise uptime failures — and the agent will figure out which tools to call, in what order, and how to interpret the results.
Core Web Vitals monitoring via AI
The run_site_test and get_site_results tools give agents direct access to Lighthouse-based
lab test data: LCP, CLS, TBT, FCP, Speed Index, and TTFB for every URL on your site.
An agent can compare scores across deployments, flag regressions against your own thresholds,
and produce a plain-language summary — all without you opening a single dashboard.
Automated SEO crawl analysis
The run_crawl and get_crawl_details tools let agents trigger and analyse full-site crawls.
The raw crawl data includes every visited URL, its HTTP status code, H1 tags, canonical tags, and a summary of
issues: broken links, 4xx/5xx errors, missing titles, duplicate canonicals, and mixed content.
An agent can prioritise these issues by severity, cross-reference them with performance data,
and produce an actionable SEO audit report.
Uptime and RUM data in natural language
The list_monitors and get_monitor_results tools expose uptime check history,
Real User Monitoring session data, and server metrics. An agent can detect anomalies,
correlate uptime failures with deployment events, and summarise SLA compliance — all from a single prompt.