AI Agent & MCP Setup Guide

Autonomous Website Monitoring with AI Agents

The Webtools MCP server lets any MCP-compatible AI agent — Claude, Kiro, or your own — monitor your websites, run performance tests, audit crawls, and analyse uptime data using natural language. No local installation. No Node.js. Just add two lines to your agent config and start asking questions.

https://webtools.ayalr.com/mcp Streamable HTTP · JSON-RPC 2.0 · MCP 2024-11-05
1
Get your API key

The MCP server authenticates every request using your Webtools account email and an API key. You need both before connecting any agent.

  1. Sign in to Webtools and go to your Profile page.
  2. Scroll to the API Key section and click Generate API Key.
  3. Copy the key — it is shown only once. If you lose it, generate a new one (the old key is immediately invalidated).
2
Connect Kiro

Kiro reads MCP server configuration from a JSON file in your workspace or user home directory. Open (or create) the file at one of these paths:

  • Workspace-level (applies to one project): .kiro/settings/mcp.json
  • User-level (applies to all projects): ~/.kiro/settings/mcp.json

Add the following block inside the mcpServers object, replacing the placeholder values with your real credentials:

{
  "mcpServers": {
    "webtools": {
      "url": "https://webtools.ayalr.com/mcp",
      "headers": {
        "X-Email":   "[email protected]",
        "X-API-Key": "your_api_key_here"
      }
    }
  }
}

If you already have other MCP servers configured, merge the webtools block into your existing mcpServers object — don't replace the whole file:

{
  "mcpServers": {
    "some-other-server": { "..." },
    "webtools": {
      "url": "https://webtools.ayalr.com/mcp",
      "headers": {
        "X-Email":   "[email protected]",
        "X-API-Key": "your_api_key_here"
      }
    }
  }
}

After saving the file, Kiro reconnects automatically. You can also trigger a reconnect from the MCP Server view in the Kiro feature panel, or by searching MCP in the command palette.

3
Connect Claude Desktop

Open the Claude Desktop configuration file for your operating system:

OSConfig file path
macOS ~/Library/Application Support/Claude/claude_desktop_config.json
Windows %APPDATA%\Claude\claude_desktop_config.json
Linux ~/.config/Claude/claude_desktop_config.json

Add the same webtools block as shown in Step 2. If the file doesn't exist yet, create it with this content:

{
  "mcpServers": {
    "webtools": {
      "url": "https://webtools.ayalr.com/mcp",
      "headers": {
        "X-Email":   "[email protected]",
        "X-API-Key": "your_api_key_here"
      }
    }
  }
}

Restart Claude Desktop after saving. The Webtools tools will appear in the tool picker (the icon) in any new conversation.

4
Verify the connection

Once your agent is configured, confirm it can reach the server before running any tests.

Option A — Ask the agent directly:

"Use the webtools MCP server to check my API quota."

The agent will call get_quota and return your plan name, total monthly allowance, calls used, and remaining calls. This tool never consumes quota, so it's safe to call as many times as you like.

Option B — Test the endpoint directly with curl:

curl -X POST https://webtools.ayalr.com/mcp \
  -H "Content-Type: application/json" \
  -H "X-Email: [email protected]" \
  -H "X-API-Key: your_api_key_here" \
  -d '{
    "jsonrpc": "2.0",
    "id": 1,
    "method": "tools/call",
    "params": {
      "name": "get_quota",
      "arguments": {}
    }
  }'

You should receive a JSON-RPC response like:

{
  "jsonrpc": "2.0",
  "id": 1,
  "result": {
    "content": [{
      "type": "text",
      "text": "{\n  \"plan_name\": \"Pro\",\n  \"total_calls\": 1000,\n  \"used_calls\": 42,\n  \"remaining_calls\": 958\n}"
    }]
  }
}

You can also GET https://webtools.ayalr.com/mcp (no auth required) to see the server's discovery metadata.

5
Your first agent prompt

With the server connected, try these prompts to get started. The agent will automatically discover and call the right tools.

Discover your data

"List all my sites, crawlers, and monitors."

Performance check

"Show me last week's performance scores for all my sites and flag anything with LCP above 3 seconds."

Uptime health

"Check all my uptime monitors and tell me which ones had failures in the last 24 hours."

SEO audit

"Run a crawl on my main site and summarise the broken links and pages with missing H1 tags."

Available Tools

The MCP server exposes 9 tools. The agent selects and calls them automatically based on your prompt — you don't need to name them explicitly.

Tool What it does Plan required Consumes quota
get_quota Returns your plan name, total monthly API allowance, calls used, and remaining calls. Any No
list_sites Lists all configured sites and their URLs. Any Yes
run_site_test Triggers an async Lighthouse lab test for a site. Measures Core Web Vitals, performance, accessibility, SEO, and best practices. Any Yes
get_site_results Returns Lighthouse scores and Core Web Vitals history for a site, grouped by URL. Any Yes
list_crawlers Lists all crawler monitors with recent crawl summaries (broken links, non-200s, H1 issues). Any Yes
run_crawl Queues an async full-site crawl. Checks for broken links, non-200 responses, duplicate H1s, mixed content, and security issues. Any Yes
get_crawl_details Returns the full raw crawl report for a specific crawl execution. Any Yes
list_monitors Lists all uptime, RUM, and Server monitors grouped by type. Any Yes
get_monitor_results Returns uptime check results, RUM session data, or server metrics for a monitor. Any Yes

Quota note: Each tool call that reads or writes data counts as one API call against your monthly allowance. Use get_quota to check your remaining balance before running bulk operations. Upgrade your plan on the pricing page to increase your allowance.

Example Agent Prompts

These prompts work with any MCP-compatible agent. The agent figures out which tools to call and in what order.

Performance monitoring
  • "Check my quota, then run a performance test on site ID 1 and tell me the results when they're ready."
  • "Compare this week's Lighthouse scores to last week's for all my sites. Highlight any URLs where performance dropped by more than 10 points."
  • "Which of my pages has the worst Largest Contentful Paint over the last 30 days?"
  • "After my next deployment, run a lab test on site 2 and fail if LCP exceeds 2.5 seconds."
SEO & crawl audits
  • "Run a crawl on crawler ID 8 and give me a prioritised list of issues to fix."
  • "How many broken links does my site have? Which pages are they on?"
  • "Check the latest crawl results and tell me if there are any pages with duplicate H1 tags or missing titles."
  • "Compare the last two crawls and tell me if the number of non-200 responses has increased."
Uptime & monitoring
  • "Are all my uptime monitors healthy right now? Show me any that failed in the last 24 hours."
  • "What's the average response time for monitor ID 12 over the last week?"
  • "Check my server metrics for the last hour and tell me if CPU or memory looks abnormal."
Quota-aware automation
  • "Check my quota first. If I have more than 20 calls remaining, run tests on all my sites and summarise the results."
  • "How many API calls do I have left this month? Is it enough to run a full audit of all my sites and crawlers?"
How It Works

The Webtools MCP server implements the Model Context Protocol over Streamable HTTP. When your AI agent needs to monitor a website, it sends a JSON-RPC 2.0 request to POST https://webtools.ayalr.com/mcp. The server authenticates the request, executes the tool, and returns the result — all within a single HTTP round-trip.

1. Agent sends a prompt

You ask your AI agent a question in natural language. The agent decides which Webtools tools to call.

2. MCP server executes the tool

The server authenticates your credentials, runs the tool against the Webtools database, and returns structured JSON.

3. Agent reasons and responds

The agent interprets the data, applies your instructions, and delivers a clear answer — no manual dashboard needed.


Technical details
Endpointhttps://webtools.ayalr.com/mcp
TransportStreamable HTTP (POST for tool calls, GET for discovery)
ProtocolJSON-RPC 2.0 · MCP spec version 2024-11-05
AuthenticationX-Email + X-API-Key HTTP headers on every request
Batch requestsSupported — send a JSON array of requests in one POST
Async toolsrun_site_test and run_crawl queue work in the background; use webhooks or poll for results
Troubleshooting
  • Check that the url field in your config is exactly https://webtools.ayalr.com/mcp (no trailing slash).
  • Make sure the mcpServers key is at the top level of the JSON object.
  • In Kiro, use the command palette → MCP: Reconnect Servers after saving the config file.
  • In Claude Desktop, fully quit and relaunch the app after editing the config.
  • Confirm the X-Email value matches the email address you use to log in to Webtools.
  • Regenerate your API key on the Profile page — the key is hashed on the server, so if you copied it incorrectly it won't match.
  • Make sure there are no leading/trailing spaces in the key value in your config file.

The tools run_site_test, run_crawl, and get_site_results require a paid plan.

The read-only tools (get_quota, list_sites, list_crawlers, list_monitors, get_crawl_details, get_monitor_results) are available on all plans. Upgrade your plan to unlock the full tool set.

You've used all your monthly API calls. Quota resets at the start of each billing month. Upgrade your plan for a higher monthly allowance, or wait for the reset. Use get_quota to check your current balance — it never consumes a call.

Both tools are asynchronous — they queue the work and return immediately. Tests typically complete within 1–3 minutes depending on the number of URLs. Ask the agent to call get_site_results or get_crawl_details after a short wait, or provide a webhook_url when triggering the test so you're notified automatically when it finishes.

Autonomous Website Monitoring Using AI Agents and MCP

The Webtools MCP server bridges the gap between AI language models and real website monitoring data. By implementing the Model Context Protocol over a simple HTTPS endpoint, it lets any MCP-compatible agent — Claude, Kiro, GPT-4 with tool use, or your own custom agent — query live performance metrics, trigger Lighthouse audits, run SEO crawls, and check uptime status without any manual dashboard interaction.

What is MCP and why does it matter for monitoring?

MCP (Model Context Protocol) is an open standard that lets AI agents discover and call external tools at runtime. Instead of hard-coding API calls into your automation scripts, you describe your tools once and any MCP-compatible agent can use them. For website monitoring, this means you can ask an agent in plain English to investigate a performance regression, triage broken links from a crawl, or summarise uptime failures — and the agent will figure out which tools to call, in what order, and how to interpret the results.

Core Web Vitals monitoring via AI

The run_site_test and get_site_results tools give agents direct access to Lighthouse-based lab test data: LCP, CLS, TBT, FCP, Speed Index, and TTFB for every URL on your site. An agent can compare scores across deployments, flag regressions against your own thresholds, and produce a plain-language summary — all without you opening a single dashboard.

Automated SEO crawl analysis

The run_crawl and get_crawl_details tools let agents trigger and analyse full-site crawls. The raw crawl data includes every visited URL, its HTTP status code, H1 tags, canonical tags, and a summary of issues: broken links, 4xx/5xx errors, missing titles, duplicate canonicals, and mixed content. An agent can prioritise these issues by severity, cross-reference them with performance data, and produce an actionable SEO audit report.

Uptime and RUM data in natural language

The list_monitors and get_monitor_results tools expose uptime check history, Real User Monitoring session data, and server metrics. An agent can detect anomalies, correlate uptime failures with deployment events, and summarise SLA compliance — all from a single prompt.