In short: Sends "site:" requests to Google and returns a total amount of indexed documents for a list of websites.
Have a look at the example results file for a better idea of the results.
The bot uses the official Google API (Custom Search) and relies on the results provided by it.
Once the bot completes the job you can view the data online or export it to a CSV, Excel or JSON files.
Endpoint: POST https://botster.io/api/v2/bots/google-total-indexed
Request body:
input string or array of strings (required)
Root URLs
misc string (optional)
Misc. input
Input any additional commands which will be executed by Google, for example "intitle: travel"
cron string (optional)
Set periodicity with which the process should execute. Use cron format.
Example: 0 8 * * * - run every day at 8AM
new_items_only boolean (optional)
The file will contain only the new items that appeared since the latest data crawl.
