Scraper & Parser

Filtered vs. Valid Links

• Valid links are every URL collected from the search engines. They include duplicates, URLs without parameters, and low-quality entries.
• Filtered links are deduplicated, cleaned, and only keep URLs with parameters. Use this export when you want higher injection success rates.

Page Count

Controls how many result pages the scraper requests. Works on all engines except Google (Google mode already pulls as many pages as possible).

URL Check

Keeps a local record of URLs you have scraped. When enabled, the module skips URLs you have already collected, mimicking an AntiPublic filter.

Domain Check

Removes duplicate domains. If you scrape:

https://website.com/blog?id=123
https://website.com/docs?id=456

Only one of these URLs survives when domain check is enabled.

Remove Duplicates

Acts as a fallback in case domain check is disabled. It removes exact URL duplicates from the result set.

Keep Unfiltered

Exports the raw result set without filtering. Enable this only if you have your own process for handling URLs without parameters.