Hi, I have been keeping silent for last 3 days without writing any blog post. Actually I was in trouble with my websites.
As we all know that viral fun quiz websites depends on Facebook sharing, our websites are being crawled by Facebook all the time.
Last month in July, my website site was crawled by Facebook over 1 million times which is around 30% of my total traffic. Within a week, Facebook crawled me with over 500k traffic, and crawled over 35k pages. You can see the data below.
These crawler hits some usual traffic at my websites which in turn make unusual activity with AdSense. Wow.. It is bad. I am enquiring with Google support team about does this Facebook crawler affect on AdSense policy.
User agents of these traffic: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
When we check our traffic at Google Analytics, we will see some Traffic from PERU, if we go deep with secondary dimension about this traffic, we will see that it’s medium/source is Facebook. But we may also have Direct PERU traffic on our website.
If you guys also know about AdSense policy in Facebook crawler, please comment below.
I’m using namecheap’s shared hosting. Can these facebook bots exert unnecassary load on my website? Any way to block these?
I am using namecheap VPS. For me, I didn’t experience server outage problem, the only thing problem is traffic spike in Analytics and AdSense.
Here is a reference about Facebook crawler and Crashing website: https://stackoverflow.com/questions/12880456/facebook-crawler-bot-crashing-site
I am also still exploring the way how to avoid this. It’s beyond my technical knowledge at the moment.
2 questions:
1. Until now it wasn’t a problem and only now the crawler started to be a problem?
2. If it’s 30% of your traffic, it means you earned a good money with the crawler which means adsene can block u right?
3. I wrote u an email 5 days ago about denied user_genders and, If u have some time please take a look 🙂
hay… sorry for late reply.. I will reply to ur email
Omg! That’s bad. You should contact Google asap and ask them. Otherwise, your Adsense account is at danger. I hope they will have a solution. Thanks for the update.
I did. Now consulting with Google team about it.
I would like to recommend you all to make sure to under stand your site traffic. If possible, please check your website daily traffic with Google Analytics. If you notice the usual spike or usual traffic from strange source, try to trace where this traffic come from till you know the source.
It is very important for you to keep your AdSense account safe and it is more important for the viral website like us.
Did you fix it or talked about it with Adsense?