Easy Feature Request .. Please!!!
When scraping website for socials and emails .. can you also please grab:
Title Tag, (Get Meta/OG as backup), Meta/OG:Description, Meta Keywords, and OG:Image
Title and Description are usually the same, but check both Meta and then OG as backup sometimes there is one or the other.
Do we want to grab meta stuff from just the homepage right? ie, not on contact page etc
homepage preferred .. yes we want the homepage data.
you are already scraping the homepage to find socials, right?
if so, we can just parse meta-data and store .. correct?
Just to be clear .. the actual html TITLE tag is the meta title I was referring to.
<TITLE>Page Meta Title</TITLE>
I am taking the meta title, which should = title. Try it first and we can see if it works or not.
Update live soon