Extracts rich structured metadata from a URL: title, description, og/twitter tags, json-ld, images, headings, response headers, and more. Perfect for SEO research or metadata indexing & analysis

Data & Analytics

Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs

Developer Tools

Extracts a light, token-efficient preview of a URL: title, description, and image (only)

Data & Analytics