I noticed in the logs, that SCM is looking for (and sometimes finding) Contact URLs, but I dont see them listed in the CSV output anywhere. Where are they?
It only visits the contact urls to find emails, it doesn’t save them if they exist or not.
The list of urls to try is here:
The scraper uses alot of extra time on these contact pages .. if I dont need emails, can I just leave this field blank?
I tried it .. it still tries to get the homepage. Is there a way to stop this, so i can save time in each scrape-loop?
I need social links .. so i guess we need to do the homepage. Thanks for answer.