Tuesday, April 11, 2023
Every day, we’re discovering, indexing, and serving billions of web pages, and a significant portion of pages we discover are spam. In 2022 we launched multiple updates to our systems to thwart these attacks and ensure a spam-free experience for all Search users.
Improvements to SpamBrain
SpamBrain is central to our spam-fighting efforts and we made many improvements in 2022 to improve coverage. SpamBrain detected 5 times more spam sites compared to 2021 and 200 times compared to when it first launched. Thanks to SpamBrain, we were able to make sure that more than 99% of visits from Search are spam-free.
Tackling abusive links and hacked spam
We also improved SpamBrain as a robust and versatile platform, launching multiple solutions to improve our coverage of different abuse types. One such example was link spam. As we shared in December, we trained SpamBrain to detect sites building spammy links, as well as sites created to pass spammy links to other sites. Thanks to SpamBrain’s learning capability, we detected 50 times more link spam sites compared to the previous link spam update. Similarly, our efforts to teach SpamBrain more about hacked spam resulted in a 10 times improvement in hacked site detection.
Faster spam handling
SpamBrain was also a big factor in better detecting spam at crawling time. This means we can better identify spam when we first visit a page and not index it at all, allowing our resources to be better used to index helpful pages.
Extending user safety
Beyond spam, we also rolled out new anti-scam solutions to improve user safety on Search. These new solutions improved coverage and extended our scam protections to all languages for the first time. Compared to 2021, we reduced clicks on scam sites by 50%.
Refreshed guidelines for site owners
In addition to fighting spam, we updated our spam policies as part of our Search Essentials. These spam policies cover the most common types of spam and abusive behaviors, and could lead to a site ranking lower or not appearing at all in Search results. We updated our spam policies with more relevant and precise language, and included new examples that help site owners avoid creating harmful content.
We also recognized that there’s a lot of interest in AI-generated and AI-assisted content, and published guidance on AI-generated content. We hope this guidance is useful in explaining how AI and automation can be a useful tool to create helpful content, but if AI is used for the primary purpose of manipulating search rankings, that’s a violation of our long-standing policy against spammy automatically-generated content.
We’re constantly working to detect and nullify spam so that users can find the most useful content through Search. We can’t do this alone; thank you for creating helpful content and functional websites for users, as well as giving us feedback and insightful reports on spam and abuse. If you come across spammy content or manipulative behaviors, please report them to us or visit the Search Central help community.
