https://www.webpronews.com/developer-shares-story-of-being-threatened-by-facebook-for-crawling/