Google ban!

Imagine one day you wake up and find your website is no longer indexed by Google -- that means not a single visitor is coming to your website from Google organic search results! Further, imagine you didn't violate any of Google's rules. That's exactly what happened to one of our more valuable websites.

How? Our website is hosted with ValueWeb who will not assign or sell entire C blocks of IP addresses. Hosting companies like this one typically have so many customers, that they can not pre-emptively screen them for spammers. They can only react once a customer reveals itself as a spammer, but by then, it's too late.  If one of Valueweb's customers is caught sending spam from, or spamvertising their ValueWeb-hosted site via an outside service, the spam trackers like SORBS may blacklist the entire netblock, falsely implicating many innocent websites.

Next, Google delists all the websites blacklisted by SORBS and there you are -- presumed guilty, tried and convicted on the spot. In our case, the website in question is a non-commercial healthcare website without any commercial activity. It doesn't send email, doesn't sell products or display any advertising.

How serious is a Google ban? My research at WebmasterWorld revealed that others in this situation had indexing restored anywhere from 3 months to 2.5 years later.  That could kill a project or even a company.

To be fair to ValueWeb, they responded quickly with assistance requesting delisting from Sorbs. But we'd be foolish to leave our websites in this precarious position where search engine traffic can disappear capriciously at any moment. The lesson? Don't host any website you want indexed by search engines without a dedicated C block.  The risk of being punished severely for having bad neighbors is too great. Our core business websites are at Verio in their Sterling, Virginia facility and soon all our other websites will be hosted there too.

The great irony here? SORBS is running AdSense ads on their website, which means that when they capriciously ban an entire netblock, both SORBS and Google stand to make money when innocent webmasters in droves visit the SORBS site to try to figure out what happened!



Reading Matt Cutt's blog, I came across this interesting post about how Google handle's hacked websites. It's really fascinating as it makes Google look very responsive. As a result we've begun using the Google Webmaster console and look forward to working with better information about Google indexing. Stay tuned.
December 5, 2006 - 5:49pm
eric shannon - SORBS Response

Here's how SORBS responded to our request for assistance:

You have been included in a wider listing policy because your provider is either hosting spammers or is not taking action to prevent spam from being sent. If you are part of a wider netblock that is blocked you are not required to pay the SORBS 'fine' as the entry was not generated because of your actions, however your netblock will not be removed until your upstream removes the spammers. They will then need to contact SORBS themselves to inform us of these changes, there is nothing you can do yourself to have this listing changed or removed from SORBS.

"On occasion, when a particular network is seen to be spamming and the listing of a single IP address seems to have no effect, increasingly larger sections of the netblock will be listed. If spamming continues, the size of the listing will be slowly expanded (depending on the number of spams received) until something is done about the spammer."

December 7, 2006 - 3:11pm

Time to celebrate... Google smiles down on us again! Search google for site:medicine.org - We're back!

We just got this email from Google (we're special now) informing us of a 'service level enhancement' and offering a telephone number.   I called to say we'd advertise if they'd just put us back in the index... Well the service rep searched after my long song and danceLaughing and said 'your site is already there!'.

YEAH!!
January 31, 2007 - 6:47pm
Dennis Gorelik (not verified) - SORBS

How did you learn about SORBS in the first place? I mean -- you found that your web site is not on Google anymore, but how did you link it to SORBS?

** es ** for years, we have used these databases ourselves to diminish the amount of spam we receive.  We filter incoming mail using SORBS and perhaps some of the other databases.  So it was not a stretch for us to check our blacklisting status. There are lots of services out there for checking status both free and paid.

June 5, 2008 - 10:55pm

Post new comment

The content of this field is kept private and will not be shown publicly.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
login