Glasser

Provided by DataForSEO

Find non-indexable pages in a website crawl with DataForSEO

$0.00 per callanswers within 30s

Crawled pages that search engines cannot index, with the reason (robots.txt, meta tag, HTTP header, attribute or redirects). Reads one page of results of a finished OnPage crawl Run by its task id (free within 30 days of the crawl); the crawl is never repeated here.

How to run it

Step 1Set up

Once: paste this into your agent's chat. The Skill installs the CLI and logs in by itself. For an agent that cannot use a shell, connect it over MCP instead.

Set up
set up https://glasser.ai/SKILL.md

Show me how to use the DataForSEO endpoint /v3/on_page/non_indexable on Glasser.

Step 2Try a specific example task

When you need to investigate a website problem, you might review crawl findings that relate to the issue you are trying to understand.

Copy this prompt into your agent to review crawl findings for your website issue.

Prompt
Use dataforseo:/v3/on_page/non_indexable on Glasser.
Find returned crawl findings relevant to the website problem I describe.

Endpoint structure

json
{
  "type": "object",
  "$schema": "http://json-schema.org/draft-07/schema#",
  "required": [
    "id"
  ],
  "properties": {
    "id": {
      "type": "string",
      "pattern": "^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$"
    },
    "limit": {
      "type": "integer",
      "maximum": 1000,
      "minimum": 1
    },
    "offset": {
      "type": "integer",
      "maximum": 2000000,
      "minimum": 0
    },
    "filters": {
      "type": "array",
      "description": "DataForSEO filter expression, passed through unchanged: one condition [field, operator, value], or conditions joined by \"and\" / \"or\" ([[a], \"and\", [b]]). Field names come from this endpoint's result items; the number of conditions allowed is in the endpoint's docUrl."
    }
  },
  "additionalProperties": false
}

How pricing works

Data returned or no matchThe same price with or without matching data.$0.00
Provider errorThe Provider failed to answer.$0.00
Timed outThe Run exceeded its time limit.$0.00
Internal failureAn internal error prevented completion.$0.00
MethodPOSTVersion3Provider documentation ↗