Quality Score Questions for Nick Fox, Google

    December 1, 2006

I talked with Nick Fox, Senior Product Manager for Ads Quality at Google, to get caught up on the latest issues relating to Quality-Based Bidding.

To refresh your memory, Google’s minimum bid on a keyword (essentially, governing whether you can afford to show your ad at all) is affected by quality score. If quality score is very low, you will be faced with a very high minimum bid. Google is now factoring Landing Page Quality into the overall quality assessment, and offers advertisers a set of landing page and site quality guidelines to give them an idea of what to avoid.

Google’s latest is that landing page quality is now affecting whether an advertiser’s ad gets included on the content network, as well as impacting your search campaign. They’ve also recently completed an improvement in the algorithm that scours landing pages. According to Fox, there is now “new data from the Adsbot crawl,” and Google has “trained the algorithm on more human-labeled data.” The reason for looking at landing page quality, according to him, is “to improve the user experience,” by removing ads that fall below the “quality-based minimum bids.” In Google’s view, this latest update has been “successful” insofar as user evaluation data show an increase in user satisfaction with SERP’s.

There are, of course, many unanswered questions.

(I’ll be presenting more detailed information on Monday Dec. 4, at a Search Engine Strategies session called Ads in a Quality Score World; and also writing a longer article for Page Zero Advisor subscribers.)

I asked him only hard questions. Here’s a sampler of two of them:

Traffick: To make this as clear as possible, I’m trying to get a sense of whether a number of the “other relevancy factors” you look at for AdWords actually affect ad rank, or whether you’re still letting CTR history and minimum bid decide together where ads are ranked on the page, with the other factors coming into play only with regard to setting minimum bids?

NF: This is where it gets complicated. Actually, there are two quality scores. The first is for setting minimum bids. It’s less accurate. [Traffick: Thus, we assume, predictive where limited data is available on CTR History.] It takes into account landing page quality. The information we use for ranking ads is much more specific.

Traffick followup: So, I’ll assume a whole range of factors are involved in
deciding ad rank but that along with bid, CTR History is, as Google has said in the past, “predominant.” But you’re saying that landing page quality does not currently affect ad rank; landing page quality only affects minimum bids.

NF: We’ve been debating this internally, and it’s my feeling that our users will benefit even if we push the landing page quality measure into the quality score that affects ad rank. Basically, I advocate all of the factors being used in the actual rankings of the ads, not just affecting minimum bids. So I’m pushing for landing page quality being included in the ranking formula and I think you’ll see that soon.

Traffick followup: What are some of these other factors besides CTR?

NF: While much of this is proprietary, I can say that many of them are just different cuts at predicting CTR.

Traffick: How can you provide more information to advertisers who have low quality scores, and is there some way advertisers can appeal high minimum bids that might be based on “algorithmic false positives”?

NF: Google is currently exploring ways of providing more of this type of information to advertisers. The problem is, if we give too much information about the process to the bad guys, they’ll turn around and use that to circumvent the process.

Traffick followup: So they try to “fix” it, but the intent is not to really fix it.

NF: Right, the intent is not to really fix it. In any case, Google is running a test now — we haven’t formally announced it yet, but I guess I’m going to tell you now — showing in the front end, quality score information to the advertiser. This is sensitive. Potentially it helps the bad guys optimize, so we have to be careful how we implement this. As for the editorial process and appeals, today there is an escalation process, and Google can correct mistakes if it sees that a mistake has been made. There are actually few enough of these appeals that I get to see all of them personally.

Bonus question: Do you use things like account history (as in spend, or length of time with an account) in the quality score algorithm?

NF: No. Google doesn’t believe in setting up perverse incentives when it comes to improving the user experience. So we don’t use total spend or time as incentives.

Fox further added that Google had “heated internal debates” as to whether they should wait until January or launch the latest update of the quality scoring algorithm(s) now. They opted to do this now because they’d rather lean towards improving the user experience on the search engine during holiday time, the busiest time in terms of usage for a search engine. Another reason cited by Fox is that “good advertisers” are now likely to see an increase in clicks and leads during this busy season, which will increase their satisfaction.



Add to Del.icio.us | Reddit | Furl

Bookmark WebProNews:

Andrew Goodman is Principal of Page Zero Media, a marketing consultancy which focuses on maximizing clients’ paid search marketing campaigns.

In 1999 Andrew co-founded Traffick.com, an acclaimed “guide to portals” which foresaw the rise of trends such as paid search and semantic analysis.