Archives for 

seo

SEO in the Personalization Age

Posted by gfiorelli1

Only eleven years have passed since Steven Spielberg’s Minority Report was released, and yet the future it depicts—the year 2054—is much closer than we think:

In many respects, we can say that the future is (almost) now.

Of all the things that were presented in Minority Report, the one that most concerns us as SEOs and inbound marketers is the personalization of experiences that our potential customers have when looking for a product and/or information, when they share things online, and when they interact with our brands on our websites.

Search marketing and personalization

Personalization in search marketing is not something new—it was (re)launched on Google in 2005. Still, it was only with the launch of “Search, plus Your World” (January 2012), the rollout of the Venice Update (February 2012), and the introduction of Google Now (July 2012), that the personalization factor has become predominant.

If we ask everyday Google users about personalized search, though, this is what they answer:

This data from the excellent infographic on seotraininglondon.org reveals something that we might have guessed in talking about rankings with our clients: the average user does not know that their Google SERPs are personalized.

To tell the truth, we SEOs also tend to forget that search is almost always personalized, and we examine concepts such as, for example, neutral search.

For example, we tend to act this way when we try to understand the rankings of our sites or when we do competitive analyses. It is certainly not incorrect—it is a necessary starting point—but in reality, it is not enough anymore.

Take the case where our site is national or global: In that case, the personalization of the search experience is such that we should not only check how our site ranks in the U.S. or the UK, but we should also in smaller geographic areas of our targeted country.

At the same time, we should see who our competitors are with a “micro-geographic” focus. In fact, while we might be on the first page in a totally neutral search with its geographical center being the political capital of the country we are analyzing, maybe we don’t rank so highly in the searches done in a city that we consider a target as important as the “nation” (i.e. Seattle or Manchester).

Why? Because the often shamefully forgotten Venice Update enhances the localization of the user performing a search in terms of how their SERPs are shaped. Hence, local businesses, which might not be relevant on a national/global scale, are indeed relevant locally. In those cases, they can be shown at the expense of “national” or “global” sites, which often do not possess sufficient relevance at a local level.

And that’s personalization (note: in the concept of personalization I personally include context, because without it, personalization would provide a poor search experience).

But that’s not the only way localization influences the personalization of search.

In fact, as both Tom Anthony and Will Critchlow explained well, localization (and other contextual information) is a key component of what they defined as “new queries,” which include both a explicit and implicit aspect.

An even stronger implementation of personalization is possible: implicit-only queries, as they are defined by Baris Gultekin in this video interview shot at Google I/O 2013.

These queries are those that users don’t even actually perform, but that Google predicts they are implicitly performing. The results are shown in Google Now cards:

In the first case (personalization due to geolocalization), we can try to acquire more relevance on a local level by creating events (online and/or offline), connections with local web sites, and partnerships with local influencers. Those influencers can be found with tools that geographically map social media followers/fans, such as Followerwonk (all the better if they are already connected with us):

Or, we can take advantage of the geographical segmentation of the people we have circled on Google Plus (and of the local communities’ pages, if they exist):

In the second case (“new queries” with implicit and explicit aspects), we can try to “enter” in the personalized SERPs of our users, creating content that is contextually relevant to a topic + location + device. For now, though, it is quite hard to determine how, from where, and for what a user is already searching on our own sites via Google search. This information can’t be easily understood with tools like Google Analytics, and Google Webmaster Tools does not offer us the opportunity to dig deeper than the country level. Hence, the best way to get this information is by actively obtaining feedback directly from our targeted audience.

In the third case (totally implicit queries), we can go with the classic SEO’s first reaction of fright and ask to have our site integrated in the Google Now ecosystem, as Zillow, Booking, Urbanspoon and many others have already done.

Personalization and Knowledge Base

Last May, at Google I/O 2013, Amit Singhal said, “The search of future will need to answer, converse, and anticipate.”

With “answer,” he refers to the Knowledge Graph, with “converse” to Voice Search, and finally with “anticipate” to Google Now. Knowledge Graph and Google Now are based mostly on the so-called Google Knowledge Base, and in both cases—as well as in Voice Search—semantics and entity recognition play an essential role.

Semantics, entity recognition and the Knowledge Base, then, are the foundation on which Google can really achieve the goal of creating its dreamed-of Star Trek computer, capable of providing information to the user by predicting its needs for information.

As I wrote in a previous post here on Moz, the Knowledge Base helps Google by answering how and why the documents are connected and searched, as well as an understanding of what named entities those same documents cite and are related to.

The most evident examples of this are the Knowledge Graph boxes:

This snapshot, though, shows another example of personalization.

Google presented me Saint Peter the Apostle because in a neutral search I performed before, Google agnostically presented me all the entities the Knowledge Graph could relate to the query “Saint Peter”.

As you can see, neutral “objective” searches still play a huge role in Google… but is this really so? No, it isn’t.

Even in a neutral search, personalization of search is present. Here are a couple of examples:

Knowledge Graph disambiguation boxes in Google.it neutral search for “San Pietro”

Knowledge Graph disambiguation boxes in Google.com neutral search for “San Pietro”

Knowledge Graph disambiguation boxes in Google.fr neutral search for “Saint Pierre”

Knowledge Graph disambiguation boxes in Google.com neutral search for “Saint Pierre”

Localization of the users—both geographically and linguistically—plays an evident role in the personalization of search.

But that’s not all. In fact—as I said before—personalization is always acting, not just when users are logged in. When you’re not signed in, Google uses a cookie to personalize your search experience based on past search information linked to your browser.

The more someone uses Google for search, even logged out, the more Google understands and refines the search experience for that user. Knowing that there are about 5,134,000,000 searches performed every day, we can understand how the Google Knowledge Base is endlessly updating itself. That is not Big Data, that’s Gigantic Data, all used for one purpose: to offer more personalized search and ad results.

How does Google personalize search?

Search History is surely the most important factor, but as we saw, localization has assumed an increasing relevance, especially because of the rise of mobile search.

Google seriously knows a lot about us. Crazypants! as a friend of mine would say.

How does search history shape the personalized SERPs, and how can Google strengthen the personalization of SERPs in relation to a query when search history is not present or is not sufficient by itself?

Google does this thanks to search entities, a concept that is explained in depth by Bill Slawski in this post.

Search entities, as described by Bill, are:

  • A query a searcher submits
  • Documents responsive to the query
  • The search session during which the searcher submits the query
  • The time at which the query is submitted
  • Advertisements presented in response to the query
  • Anchor text in a link in a document
  • The domain associated with a document

The relationships between these search entities can create a “Probability Score,” which may determine if a web document is shown in a determined SERP or not.

I warmly suggest you read Bill’s post to find out more about all the possible relationships that can exist between these search entities, but for this post, I’d like to focus on these ones:

  1. The strength of relationships between these entities can be measured using a metric obtained from direct relationship strengths (derived from data indicating user behavior, such as user search history data) and indirect relationship strengths (derived from the direct relationship strengths).
  2. A relationship between a first entity that has insufficient support (e.g., not enough search history data) to associate a given property with the first entity and a second entity that does have sufficient support to associate the given property with the second entity can be identified, and the given property can be associated with the first entity with higher confidence.
From an SEO point of view, these two cases are telling us that even though we aim for a neutral search environment, we should never forget that 99% percent of a user’s search experience is personalized. We could define this attitude as “growth hacking SEO.”

Moreover, we could take advantage of the personalization of search thanks not only to being included in the personal search history of the users, but also to connections created with entities that are already in those users’ search history. This connection can be a link, a citation, or a co-occurrence in a document, which is considered more relevant than the query alone or the search history of the users.

Somehow this is not something new. In fact, when Richard Baxter talks about doing really targeted outreach, we know it is good from the point of view of being discovered by the audience. Creating content for other sites that are used by the people influencing our target market will often result in new users of our own site.

But now, this patent about search entities is evidence that typically inbound tactics can have a direct reflection on a purely search-related level.

Semantic web

When we talk about entities, we usually think about people, places, and things (i.e., a brand). But web documents are also entities.

And, in light of what is described in the patent cited above, the “probability score” of a web document, which can determine its presence in a SERP or its visibility in results for a determined query based on all the classic on-page “ranking factors,” can be improved by the use of structured data.

Structured data, from schema.org, Microdata and Open Graph, are important not just because they can gift our site’s search results with a rich snippet. That snippet is the facade of something more important: helping the search engines better understand what a document is all about.

For instance, the breadcrumb schema is surely important because it can help add mini-sitelinks to our snippets, but it is even more important because it clearly tells search engines how the documents in our site are hierarchically related between them.

Or, using an even better example, the article schema is the only way (or at least so it is described by Google) to obtain visibility in the In-Depth Articles search blend.

Therefore, the use of structured data has become essential, not only because rich snippets offer us a greater visibility in the SERPs, but also because not many people are using it (36.9% of URLs use Open Graph, and 9.9% use Schema.org, as reported by Matthew Brown at MozCon). In addition, structured data can help increase the relevance of a document for a determined query simply because it “helps our systems to better understand your website’s content, and improves the chances of it appearing in this new set of search results.”

The social layer

We know that social has a correlated impact on rankings. How, though, does social have a direct impact in the personalization of the SERPs?
Once it was with the social annotations from Twitter (and now from Google Plus), even though it’s legit to consider that social activities other than those on Google Plus still weigh on how personalization works.

“Search, plus Your World” (SPYW), which de facto is how all logged in users use Google.com, can seriously help in outranking your competitors.

For instance, “The International SEO Checklist” by Aleyda on Moz ranks first for me and not third, because Aleyda and Gigi (and others in my Circles) plussed it. The “International SEO” Q&A page on Moz ranks third for me, simply because I have Moz circled. If it was not so, that page would not be present in the TOP 100, which we can see from a neutral search.

That means that, yes, in a personalized environment like SPYW, +1s have an impact in rankings, while that’s not the case in a neutral search.

Even if SPYW is not present outside of Google.com, plusses still play a prominent role in how SERPs are personalized. For instance, if I search for “International SEO” in Google.es, and I am logged in, by default Google is showing me search results from Aleyda’s posts, because they were all plussed by many people I’m circling on Google Plus. Instead, a neutral search in Google.es will show a completely different SERP.

The fact that we don’t have the option to switch to a neutral SERP in Google.es (or in the other regional versions of Google) means that all logged in users, if they are active on Google Plus, see an extremely personalized search result page.

The first snapshot presents a logged in personalized search in Google.es for “International SEO”. The second a neutral search. The influence of Google Plus in the first one is evident.

If we can find an evident social layer in search results, social media also has correlated values that can influence the personalization of the SERPs: branded keywords searches, prop-words, and an increase in search volume for our brand and related keywords.

In fact, we know that social media resides at the top of the funnel in the discovery phase. What we don’t realize is that social is also present in a post-discovery phase, when users are searching for confirmations to their conversion intentions.

If we are very active on social, and moreover if we are able to create authority via social media, if we do our homework, and—as SEOs—if we optimize how content is shared socially (SEOcial), then we can instill in our audience those keywords and topics for which they will search for us later on.

Email marketing and personalization

We can also influence the personalization of search with the integration of email marketing to our SEO activities.

We usually tend to consider email marketing just another channel—a very good one if performed correctly, because it can offer great conversion rates and huge amount of organic traffic, but we rarely think at it as a way to obtain visibility in search.

Now that is possible.

For totally implicit queries, we can mark up the emails we send to our users with schema.org for GMail.

The reminders we offer to our users will be presented as Google Now cards on mobile, but these annotations will also allow users to perform (voice) searches, which will deliver those same reminders created from the information we have marked up in our email.

For all the other kinds of queries, it is also possible to use email marketing in order to have visibility in the SERPs.

If you are a tester of the Gmail Search Field Trial (and use Google.com based in the US), you should see these enhanced results in your SERPs:

As you can easily tell, emails relevant to a user’s search can be shown in the SERPs.

This opens a completely new area of SEO activity, in which potential factors are:

  • Who you email: If you email John Doe a lot, it’s likely that messages from John Doe are important.
  • Which messages you open: Messages you open are likely to be more important than those you skip over.
  • What keywords spark your interest: If you always read messages about soccer, a new message that contains those same soccer words is more likely to be important.
  • Which messages you reply to: If you always reply to messages from your mom, messages she sends are likely to be important.
  • Your recent use of stars, archive and delete: Messages you star are probably more important than messages you archive without opening.

I am not guessing these GMail ranking factors; I took them from this patent by MailRank now owned by Google.

Conclusions

Luckily Amit Singhal is present in this snapshot, or many of you would have started getting crazy with me.

Amit Singhal is right when he says that “Answer,” “Converse,” and “Anticipate”—deep personalization of search, I called it—is going to change search as we know it.

Is this maybe the reason why the Search Team at Google is now called the Knowledge Team? Is this maybe the main reason for “Not Provided” keywords, as Will Critchlow mentioned?

What I know is that personalization is already so heavily present in search that avoiding it in the name of a fading neutral search is not doing good SEO.

Moreover, personalized search is clearly telling us how SEO alone is not enough, but that content, social, and email marketing by themselves are also not enough to obtain a real and complete success in Internet marketing.

SEO, for instance, needs social to help people discover a site, just as social needs SEO to reward its activity with recurring conversions on the site.

Personalized search is pushing us to hasten the destruction of silos between Internet marketing disciplines, and hopefully it will oblige marketers to change and embrace a more holistic way of promoting a business online.

Maybe with the rise of deep personalization SEO will finally become Search Experience Optimization, and have users at its center instead of search engines.


Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Continue reading →

Planning for Success: Three Essential Consulting Project Plans

Posted by Benjamin Estes

Being a consultant can be an intense experience. Every client (and every day!) presents a new challenge. In my experience that isn’t a product of the ever-changing state of affairs in SEO or inbound marketing. In fact, I don’t lose sleep over every algorithm change—there are plenty of smarter people from whom I can draw that sort of information.

What keeps me awake at night is how I can shape my projects to make them successful. A lot of people work together with me every day: my clients, my teammates, and teams in other offices. Everyone needs to collaborate to even have a shot at success. How will we pull that off? How will they communicate? What do they need to do this week? Next month? Next quarter?

In short, I focus on planning, and I focus on it in three specific scopes:

  1. Pitching (how do we estimate project size in advance?)
  2. Strategy (how do we know what we are going to do, and when?)
  3. Execution (how do we ensure that these things actually get done?)
Three different tasks with three different plans, each with its own unique purpose. A list of tasks to execute is not a sales pitch any more than it is a high-level summary of the course of a project that helps you decide what to do today. Each of these plans must be treated differently, and with appropriate respect. The most important thing I’ve discovered as a consultant is this:

You can disagree about what’s in a plan, but you must agree about what the plan is intended to accomplish.

Let me walk you through these three types of plans, what the purpose of each is, and what warning signs may crop up if something isn’t going smoothly in each stage. I firmly believe that a little conscious effort can improve how we handle each of them, and tune our instincts to spot when something is going wrong. On the other hand, I won’t go into techniques for how to create these plans—at that point I’d be writing a book instead of a blog post.

I’ve definitely not mastered all of this yet, so if you have any lessons of your own to share in the comments I’d love to hear them! All of these planning phases interact with each other, and I can only talk about them from my point of view. In your experience the lines may be fuzzier or more defined. You may treat them very differently. Do share!

Pitching

Why do we have a plan at this stage?

To understand the scope of a project, that we are the right choice for the client, and that the client is the right choice for us.

What should this plan do?

  • Address the client’s needs (as far as they are understood)
  • Reflect the limitations of what we can offer and what the client can execute
  • Get the right order of magnitude for project size

What should we watch out for?

  • Anyone talking about scheduling deadlines for deliverables—”We need the keyword deliverable week one, the technical audit week two…”

What I’ve noticed:

The first time we have to deal with a plan for a new client is when we’re trying to convince them to work with us. Obviously we are asking someone to trust us to help them get a good return on their investment, and part of building that trust is to let them know what sort of work we are going to be doing. A good plan during the “pitch” phase helps us do that.

An example plan for a pitch from Distilled. Activities are scheduled chronologically left to right.

You can see from the illustration I’ve included that for a lot of projects this plan can be quite broad. Basically it amounts to a straightforward summary of what needs to happen and in what order. It’s where everything begins, before the engagement has even started.

The other piece of data that is presented concurrently with the plan shown is a budget, which is essentially the size of the project or the proposed bandwidth that Distilled will dedicate to it. To know that a budget should be X dollars per month or that a contract should last for some amount of time seems quite amazing if you think about it—so many variables are involved! But while every project is different, there are a lot of things we can estimate with a good degree of accuracy. The things we have a handle on might be different from yours—there might be areas where your estimation is a lot better than ours, or vice versa. Consider:

  • Weekly meetings
  • Project management (time spent scheduling)
  • Monthly reports
  • Some common research reports (this may vary wildly, but it helps to have an average we can point to)

These are all elements which can be used to anchor an estimate. There may also be some other administrative tasks or fixed price elements (tools, copy writing) that can be leveraged as well.

But it is ambiguous. The pitches you deal with might be more or less ambiguous than ours, but there is no possible way that a proposal created in the sales process can accurately reflect what will actually happen. No one can predict the future, and the sales process is too far removed from actual work to be treated as definitive when it comes to planning.

And that’s what I watch out for. It’s not uncommon for leads to demand that we offer them strict calendars for delivery of reports. It’s one thing to build in regular meetings and status updates—those are great, at appropriate intervals—but if we are talking about rigorously scheduling deliverables like technical audits, or are devising a content strategy, there are too many variables present to know exactly when all that is going to happen. Demands in the sales process for the abstract to be made concrete should be handled very carefully in the sales process. The needs of the client must be addressed, but acquiescing to unreasonable scheduling is likely going to hurt your relationship with a client rather than help it. In other words:

A prospective client can disagree with what is included in the proposed project, but they can’t insist on a level of detail that is inappropriate.

In my own experience, there have been a couple of clients in particular who needed help with website redesigns or complete domain migrations. One insisted on an extremely delineated schedule provided in the pitch, with arbitrary deadlines for various deliverables and a project duration which would coincide with the launch of a new site. The justifications for this (on the client’s end) were both to get a better understanding of the work being done and to make sure that we would be around to monitor the site’s launch. Needless to say, the site didn’t launch on time—few websites ever do. And because of the strict language of our arrangement, we had no flexibility to adapt our strategy or extend the duration to accommodate. I didn’t feel good about that outcome.

If I were put in the same position again, working with our sales team on the pitch for this project, would I take a hard line against this style of planning? It’s hard to say. But I would be very aware of the potential risks, and at the very least make sure that there were contingencies in place if the scheduling of work turned out to be inappropriate.

Fortunately, we only have to deal with this sort of ambiguity once or twice in each project—once the engagement has begun, things become more tangible. Once the project has kicked off, we don’t talk at such a general level. It’s time to take charge, get more information, and figure out how to make things happen. It’s time for proper strategy.

Strategy

Why do we have a plan at this stage?

To figure out what work should be done and when it should be done.

What should this plan do?

  • Prioritize work
  • Defer work that can’t be done within time constraints

What should we watch out for?

  • Big chunks of time that don’t have any tasks assigned to them
  • Too many tasks to accomplish in the time available

What I’ve noticed:

Once a client has retained our services we need to figure out what we’re going to do. Consider: there are a tremendous number of constraints on the work we commit to doing every day. We have a finite number of working hours in a day, week, or month. We may be dependent upon other projects finishing in a timely manner—will the client’s website launch in time? Will the team working on the content finish?

In the face of that uncertainty we still manage to accomplish something. We just have to limit the scope of what we do. Estimate the amount of time various elements of the projects will take, decide what will fit into this month, and commit to executing them. It’s that commitment and specificity that distinguishes this phase from the sales pitch phase. And that’s why we can’t start thinking at this level before we’ve engaged a client—we need more information from them, we need their commitment to a project, and we need to know as much as possible about our own bandwidth in a given month.

A screenshot of Distilled’s internal scheduling system. The “size” of tasks is defined by how many hours they are anticipated to take. These tasks are kept fairly broad: project management, weekly meetings, etc.

This plan is the response to those needs. We know we need to do keyword research, a technical audit, and Analytics implementation—how long will each take, approximately? Which will we do this month? Which have to wait for information from the client? We answer these to the best of our ability and that becomes our roadmap.

The facts and the constraints that become apparent also become the boundaries of what we can sensibly plan. It’s in this boundary that I’ve noticed most problems crop up. Some clients will present a barrage of questions that threatens to undermine the rest of the scheduled work you’re trying to do. In the worst cases, results might be demanded when what you’re trying to prioritize is which work should be done. So let’s adjust the axiom above for the “strategy” phase:

A client can adjust the priorities of elements within this strategy, but they can’t insist that you do more work than there are hours available.

Unless they give you a bunch of money. Just kidding. Sort of.

Consider the alternative to using this sort of strategic scheduling: Every month that a client has you on retainer, you just do whatever they ask until you use up the budget in week two and just stop for the rest of the month. Or you keep working and effectively cut your hourly rate in half. Neither of these solutions sound great, do they?

It took a while for me to get the hang of this “strategy” stuff. Early on in my tenure at Distilled, this manifested in projects that were extremely productive early on. There were tons of technical things to fix—so much low hanging fruit that we at Distilled seemed like miracle workers. No strategy needed, pure action—for a couple of months. But once that stuff dried up, the relationships sputtered out. I was so enthusiastic about those quick wins that I didn’t establish a rapport with the client. I didn’t figure out how to work together with them to make their business better. I just told them what to do.

Talking about strategy gave me a language I could speak with my clients that helped improve our relationship and has been much more effective in the long run.

Eventually, you’ll work out a sequence of work that fits your schedule and addresses the needs of the client. Once you get to that point, you need to figure out how to execute the work.

Execution

Why do we have a plan at this stage?

To figure out how we’re going to do the work that needs to get done.

What should this plan do?

  • Lay out exactly what actions need to be taken
  • Let everyone know who is accountable

What should we watch out for?

  • Tasks that aren’t well-defined
  • Tasks that are defined by outcomes (e.g “get 10 links”)

What I’ve noticed:

At this point we’re finally we’re dealing with something that actually looks like a proper schedule—a real to-do list. Tasks need to be chunked into pieces that are clearly delineated and actionable. The image below actually reflects a list of tasks for one of my clients.

An activity schedule in Google spreadsheet form from one of my projects.

The biggest problem that I’ve observed in working with clients in “execution” mode —one that consultants often bring upon themselves—is the tendency to create tasks that aren’t well-defined. For instance, if I have “keyword research report” as a line item in my to-do list, I know I’m doing it wrong. Get more specific: Pull data from Searchmetrics, the Google Keyword tool, and Analytics; do analysis in Excel; and so forth.

On the other hand, the issue that has arisen through my interaction with clients is not recognizing when something is being put in this “to-do” list that is outside the scope of what we laid out in the strategy. Once you know what you are doing in a given month, and you have broken that down into individual tasks, you have to be careful about committing to other things. It’s very common to field random questions from a point of contact or their teammates, and it is usually best for the relationship for you to answer them. In order to do that, it is smart to schedule extra time for this kind of ad hoc support question—and if you starting going over that time you should be seriously concerned. To wit:

A client can negotiate the tasks in this schedule to complete the work you’re setting out to do, but they can’t add unrelated elements (i.e. change the strategy).

There are as many methods of keeping track of to-do lists as there are people doing to dos. How you actually accomplish these tasks is up to you—I prefer OmniFocus, while I know some at Moz have a bit of an Asana obsession. The important thing as that at some point, in order to go from a “strategy” phase to actually accomplishing something, you have to come up with a list of actions.

I know I’ve talked a lot about high-level planning in the “pitch” and “strategy” phases, but I should note that at the end of the day, getting better at scheduling the actual work is the most important element of the process. You can meditate all day on the structure of a perfect project, but unless you actually do something there is no chance for success. I consider it the Minimum Viable Plan, so to speak.

Review

Planning isn’t easy, but it gets better with practice. And that will, in turn, have a positive effect on all the projects you work on. Let me say it once again:

You can disagree about what’s in a plan, but you must agree about what the plan is intended to accomplish.

This rule is something I intuitively use more and more when planning a project and when issues arise over the course of a project. Once you start thinking about these things in increasingly conscious ways, their value becomes exponentially more obvious in ways you can’t anticipate.

Do you think about projects in these three phases? If so, what are the warning signs that you’ve spotted in your experiences?


Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Continue reading →

The Future of User Behavior – Whiteboard Friday

Posted by willcritchlow

In the early days of search, Google used only your typed query to find the most relevant results. We’re now increasingly seeing SERPs that are influenced by all kinds of contextual information — the implicit queries.

In today’s Whiteboard Friday, Will Critchlow covers what exactly that means and how it might explain why we see “(not provided)” in our analytics more often than we’d like.

WBF – Will Critchlow – The Future of User Behavior

PRO Tip: Learn more about how Google ranks pages at Moz Academy.

For reference, here’s a still image of this week’s whiteboard:

Video Transcription

Hi, Moz fans. I’m Will Critchlow, one of the founders of Distilled, and I want to talk today about the future of user behavior, something that I’ve been talking about a MozCon this year. In particular, I want to talk about the implications of query enhancement. So I’m going to start by telling you what we mean by this phrase.

Old-school query, key phrase, this is what we’ve talked about for a long time. In SEO, something like “London tube stations,” a bunch of words strung together, that’s the entire query, and we would call it a query or a key phrase. But we’ve been defining this what we call the “new query” made up of two parts. The explicit query here in blue is London tube stations, again, in this example, exactly the same. What we’re calling the “implicit query” is essentially all of the other information that the search engine knows about you, and this what they know about you in general, what they know about you at this specific moment in time, and what they know about your recent history and any other factors they want to factor in.

So, in this particular case, I’ve said this is an iPhone user, they’re on the street, they’re in London. You can imagine how this information changes the kind of thing that you might be looking for when you perform a query like this or indeed any other.

This whole model is something that we’ve been kind of building out and thinking about a lot this year. Tom Anthony, one of my colleagues in London, presented this at a conference, and we’ve been working on it together. We came up with this kind of visual representation of what we think is happening over time. As people get used to this behavior, they see it in the search results, and they adapt to the information that they’re receiving back from the search engine.

So old school search results where everybody’s search result was exactly the same, if they performed a particular query, no matter where in the world they were, wherever in the country they were, whatever device they were on, whatever time of day it was, whatever their recent history, everybody’s was the same. In other words, the only information that the search engine is taking into account in this case is the old-style query, the explicit part.

Then, what we’ve seen is that there’s gradually been this implicit query information being added on top. You may not be able to see it from my brilliant hand-drawn diagram here, but my intention is that these blue bars are the same height out to here. So, at this point, there’s all of the explicit query information being passed over. In other words, I’m doing the same kind of search I’ve always done. But Google is taking into account this extra, implicit information about me, what it knows about me, what it knows about my device, what it knows about my history and so forth. Therefore, Google has more information here than they did previously. They can return better results.

That’s kind of what we’ve been talking about for a long time, I think, this evolution of better search results based on the additional information that the search engines have about us. But what we’re starting to see and what we’re certainly predicting is going to become more and more prevalent is that as the implicit information that search engines have grows, and, in particular, as their ability to use that information intelligently improves, then we’re actually going to see users start to give less explicit information over. In other words, they’re going to trust that the search engines are going to pull out the implicit information that they need. So I can do a much shorter, simpler query.

But what you see here is, again, to explain my hand-drawn diagram in case it’s not perfectly beautiful, the blue bars are declining here. In other words, I’m sending less and less explicit information over as time goes along. But actually, the total information that search engines have to work with, as time goes on, is actually increasing, because the implicit information they’re gathering is growing faster than the explicit information is declining.

I can give you a concrete example of this. So I vividly remember giving a talk about keyword research, and it was a few years ago. I was kind of mocking that business owner. We’ve all met these business owners who want to rank for the one-word key phrase. So I want to rank for restaurant or whatever. I say, “This is ridiculous. What in the world can you imagine somebody is possibly looking for when they do a search of ‘restaurant.’ ”

Back then, if you did a search like that, you got a kind of weird mix, because this is back in these days when there essentially no implicit information being taken in. You’ve got a mix of the most powerful websites of actual restaurants anywhere in your country plus some news, like a powerful page on a big domain, those kinds of things. Probably a Wikipedia entry. Why would a business owner want to rank for that stuff? That’s going to convert horribly poorly.

But my mind was changed powerfully when I caught myself. I was in Boston, and I caught myself doing a search for “breakfast.” I went to Google, typed in “breakfast,” hit Search. What was I thinking? What exactly was I hoping the outcome was going to be here? Well, actually, I’ve trained myself to believe that all of this other implicit information is going to be taken into account, and, in fact, it was. So, instead of getting that old-style Wikipedia entry, a news result, a couple of random restaurants from somewhere in the country, I got a local pack, and I got some local Boston news articles on the top 10 places to have breakfast in Boston. It was all customized to my exact location, so I got some stuff that was really near me, and I found a great place to have breakfast just around the corner from the hotel. So that worked.

I’ve actually noticed myself doing this more and more, and I imagine, given obviously the industry I work in, I’m pretty much an early adopter here. But I think we’re going to see all users adopt this style of searching more and more, and it’s really going to change how we as marketers have to think, because it doesn’t mean that you need to go out there and rank for the generic keyword “breakfast.” But it does mean that you need to take into account all of the possible ways that people might be searching for these things and the various different ways that Google might piece together a useful search result when somebody gives them such apparently unhelpful explicit information, in particular, obviously, in this case, local.

I kind of mentioned “not provided” down here. This is my one, I guess, non-
conspiracy theory view of what could be going on with the whole not provided thing, which is that actually, if Google’s model is looking more and more like this and less like this, and, in particular, as we get further over to this end, and of course, you can consider something like Google Now would be the extreme of this where is in fact no blue bar and pure orange, then actually the reliance on keywords goes away. Maybe the not provided thing is actually more of a strategic message for Google, kind of saying, “We’re not necessarily thinking in terms of keywords anymore. We’re thinking in terms of your need at a given moment in time.”

So, anyway, I hope that’s been a useful kind of rapid-fire run through over what I think is going to happen as people get used to the power of query enhancement. I’m Will Critchlow. Until next time, thanks.

Video transcription by Speechpad.com


Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Continue reading →

The Web Developer’s SEO Cheat Sheet 2.0

Posted by DannyDover

It is my honor and privilege today to introduce the brand-new version of The Web Developer’s SEO Cheat Sheet. This free and downloadable document covers all of the important SEO code and best practices that are needed by online marketers and developers.

Benefits and features

  • Save the Google searches for your new inbound visitors: This cheat sheet covers all of the details you would normally spend hours researching online. This leaves you with more time for the important things (like laughing at JennaMarbles or pretending you don’t watch Vine compilations).
  • Available both online and offline: You can store the free downloadable PDF wherever you want. Save a hard drive, kill a tree! (It’s printable.)
  • Updated for the inbound marketer: With new sections like responsive design and rel=”author”, you can uphold your flawless nerd reputation by publicly shaming those who make syntax errors in their code (and are foolish enough not to download this cheat sheet!).

Information covered

If it is important, we have you covered!

Page 1

  • Important HTML Elements
  • HTTP Status Codes
  • Canonicalization
  • URL Best Practices
  • Webmaster Tools

Page 2

  • Robot Control Syntax
  • Important User-agents
  • Sitemap Syntax

Page 3

  • Facebook Open Graph
  • Twitter Cards
  • Google+
  • Google+ Authorship
  • Google+ Publisher

Page 4

  • Targeting Multiple Languages
  • Mobile Web Development (Responsive Design)

Backstory:

It has been five years since I created the first version of this cheat sheet. Frustrated with how hard it was to find technical SEO information, I stayed up an entire night crafting the original resource. Without getting a second opinion, I blindly posted it on the company blog and went into the office.

At the time, I was still establishing my professional self and was an intern at Moz. The company was small, and the future of my unpaid internship was uncertain.

The blog post announcing the new cheat sheet resource went on to become the most popular blog post (as judged by thumbs) in the company’s history (in fact, it still is!). The cheat sheet was heavily distributed on popular sites of the day and drove an incredible amount of much-needed links to the still-developing SEOmoz domain.

The Moz team was super excited about how many people the resource was helping, and I gained some desperately needed clout. When Rand tried to show his excitement over the piece, I learned an incredibly valuable lesson about intra-office communication.

Note to interns everywhere. Don’t actually make vocal sound effects when your get the opportunity to “blow up” your boss’s impromptu pound handshake.

Rand: Great job, Danny! Pound it!
*Reaches out fist in congratulatory manner*
Me: BOOOOM! POW! EXPLOSION!
*Confusion followed by reddened face*… *Saddened apology*
Rand: Erm… good job anyways!

Despite my social mishap :-), Rand and the team continued supporting me and this resource. Today’s version is better than the original and even more valuable.

Looking back, the Moz team was absolutely fundamental in shaping me into the person I am today. My career at Moz was some of the most important years of my life thus far.

After leaving Moz in early 2011, I used the many habits and skills I learned from the talented team and continued to step up my career.

Thanks to Moz (and partly due to the original version of this cheat sheet), I am now living my ideal lifestyle by pursuing my bucket list full-time. You can read more about my story here.

Thank you!

A very special thanks to Cyrus and Dawn Shepard for making this new resource a reality. Your long hours and persistence have been inspiring. Thanks to the Moz design team for your artful assets and gleeful glamour (those are good things!).

Lastly, thanks to all of you for downloading and making this thing a success. You all rock!


Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Continue reading →

5 Lessons Learned from 100,000 Usability Studies

Posted by Phil Sharp

This post was originally in YouMoz, and was promoted to the main blog because it provides great value and interest to our community. The author’s views are entirely his or her own and may not reflect the views of Moz, Inc.

It happens all the time.

People get confused, frustrated, and angry while using websites. They sigh, they groan, and sometimes they even shout. I see it happen with my own eyes each and every day.

Over the years at UserTesting.com we’ve literally watched hundreds of thousands of usability studies, which gives us a unique perspective into some of the most common issues that impact users. I’d like to share five of those insights with you.

1) Avoid multi-level navs

The person in the video below is struggling to move her mouse through multiple levels of navigation. Just when she thinks she’s made it to the item she’s looking for, the entire navigation disappears. We see this every day on many different sites and it always frustrates the users.

This person is having a hard time using the site’s navigation.

A fix to consider

One possible alternative to this type of navigation is to take an approach similar to Amazon.com, and have an entire section pop out.


On Amazon.com, the entire section pops out.

This approach makes life much easier for your visitors. Not only does it remove the need for them to delicately maneuver their mouses, but it also lets them see all of their options at once. Plus, it gives you the freedom to add images and other styling to your nav.

For other possible solutions, and a more in-depth look into creating easy-to-use navigation, check out these resources:

2) Your categories might be confusing users

As the video below illustrates, the way we categorize things on our websites might be confusing our visitors. In fact, it’s one of the most common things we see in all of our user tests.

A person looking for a small vacuum for under $50.

In this particular study, it took our participant 48 seconds to find the category for a small vacuum. She started her search by looking in “electronics,” then browsed for something called “household,” and finally made her way over to “Home & Garden.”

At this point you’re likely thinking one of two things:

  • Either, “Silly person, it’s obvious that a vacuum would be in the ‘Home & Garden’ section.”
  • Or, “Silly designer, it’s obvious that ‘Home & Garden’ is a confusing category.”

That’s why I need to introduce you to the “Matt-Damon-and-Good-Will-Hunting-Can-Do-No-Wrong” principle.

The principle is simple: it’s not your fault. (Side note: if you don’t understand this reference, then do yourself a favor and watch this video.)

It’s not your fault. It’s not the user’s fault. It’s not the designer’s fault. In fact, it’s nobody’s fault. What’s crystal clear to you might be confusing to me, and no one is to blame for that. It’s just something we have to work with.

So, what do we do about it?

One of the best ways to test out your site categorization is to sit someone down in front of your site and ask them to find a specific item without using internal search. This is simple, fast, powerful, and very painful to watch.

You’re bound to see people struggle to find things that seem obvious to you. When this happens, remember the “Matt-Damon-and-Good-Will-Hunting-Can-Do-No-Wrong” principle, make some changes to your categories, and then test again.

Another way to improve your categories is to use a tool like OptimalSort or TreeJack. OptimalSort is an online card sorting tool that makes it easy to find out how people think your content should be organized. Then, once you think you have everything organized nicely, TreeJack helps you prove that this site structure will work.

3) Internal search is crucial (and frustrating)

There’s a good chance that 10% of your site visitors are using your internal search. When they search for your most popular items, do you know what the results look like?

From all our studies, we’ve found four common types of problems with internal search:

  1. Search results that don’t account for typos, plurals, hyphenations, or other variants
  2. A search box that isn’t long enough
  3. Search results that simply don’t make any sense
  4. Search results that aren’t sorted by priority
To see an example of #4 in action, let’s watch yet another person looking for a vacuum:

When results aren’t sorted by relevance, people are bound to see some weird things.

Because the search results are automatically sorted by “Most Popular,” the first results are for replacement batteries and filtration paper bags! Yikes! Or, as my 10th-grade Spanish teacher would say, “que barbaridad!”

If you do only one thing

If you do only one thing, look at your internal search logs and find the top 10-20 keywords that people are searching for on your site. Search for each of these items yourself to see if you’re happy with the results.

Then, search for your company’s 10 most important products. How do those results look?

Lastly, look for some generic, non-product terms. For example, if you’re an e-commerce store, search for “returns,” “contact,” and “hours.” Looking good?

If you can perfect these searches, and change your search results to automatically sort by relevance, you’re most of the way there!

4) Links should look like links

As obvious as it sounds, there are many times when links actually don’t look like links. And, as you probably guessed, this means users don’t know they can click on them.

In the video below, this person is requesting a link to the “basic uploader” without realizing that “basic uploader” is already a link:

“Okay, that’s frustrating. It would make more sense to me that you’d have a link that I could just click on.”

What does a link look like?

This won’t come as a big surprise, but to make your visitors happy, links should be colored and underlined. And, ideally, there should be different colors for links that have been visited and unvisited.

For more info on the topic, check out this great article from the Nielsen Norman Group, or this post from Moz.

5) Engage your visitors (in other words, don’t be boring)

Sometimes websites are perfectly usable — they have great navigation, clear categories, helpful internal search, and links that look links — but they suffer from a major problem: They’re boring.

Or, put a nicer way, they’re not engaging their visitors. People use the site, and they could easily buy something if they wanted, but they don’t feel a connection to the brand or the product. Frankly, they just don’t care.

In the video below, a person is trying out a mobile app for the first time ever. Listen to the deep sigh she makes and the tone of her voice:


The sound of boredom.

That’s the benefit of watching someone use your website, app or product. You can hear their tone of voice and pick up on things like boredom that you’d miss if you were just looking at standard analytics data.

It’s tempting to always get wrapped up in analytics or usability, but don’t lose sight of engaging your visitors and building your brand.

Tunnel vision

These are only five of the issues that we see pop up often, but really there are countless ways that our websites can be turning off our visitors.

Thanks to the amount of time we spend on our own sites, we’re blind to many of the issues that are confusing or frustrating our users. We have tunnel vision.


This is what we look like. Unfortunately, most of us aren’t this adorable.

That’s why it’s so important for us to get our sites in front of real people with fresh eyes who can give us unbiased feedback. While this feedback is probably going to be painful to hear, it’s going to help us all improve our sites and make the web a better place.


Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Continue reading →