Extracts rich structured metadata from a URL: title, description, og/twitter tags, json-ld, images, headings, response headers, and more. Perfect for SEO research or metadata indexing & analysis

Data & Analytics

Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs

Developer Tools

Extracts a clean, token-efficient content summary as markdown from a URL. Removes ads, nav, scripts. Much more efficient than raw HTML fetches for LLMs

AI & Machine Learning

Extracts a light, token-efficient preview of a URL: title, description, and image (only)

Data & Analytics