Scraper

The Scraper is a search-engine discovery module. Give it keywords or dorks and it collects the result URLs returned by the selected search engines. It is designed for breadth: finding relevant pages across many websites without running every search by hand.

What It Does

• Runs lists of search queries in bulk across supported search engines.
• Collects URLs and removes exact duplicates.
• Can keep one result per domain or focus on selected top-level domains.
• Separates cleaned, parameterized links from the raw result set.
• Can pass its output to another DorkPlus task or workflow.

The Scraper only sees pages that a search engine has indexed and chooses to return. It does not follow every link inside a website; use the Crawler for that.

What You Can Use It For

• Building a broad list of public pages for authorized research or OSINT.
• Finding candidate URLs that match a topic, technology, country, or file type.
• Turning a large dork list into input for a crawler or an authorized security review.
• Comparing coverage across different search engines and regions.

Typical Input and Output

Input: keywords, domains, or advanced search queries such as site:, inurl:, or ext: searches.

Output: a raw URL list and, when filtering is enabled, a smaller cleaned list of unique URLs with useful query parameters.

When to Choose It

Choose the Scraper when you need to discover many websites from outside. Choose the Crawler when you already know the website and want to map it from the inside.

See Scraper & Parser for its filters and Task Settings for configuration details.