how to do keyword research in 2021
this 8 step guide is the result of ten years of refined keyword research processes, which have resulted in 5x page 1 keyword rankings. for experts & newbs alike.
but, i’ll argue that every one of those seo disciplines arises (or should arise) as a result of a solid keyword strategy. this isn’t a question of whether the chicken or the egg came first. keyword strategies come first, then content, on-page optimization, link building, then auditing the entire mess afterwards for the inevitable issues we cause.
websites are built on content, and content should originate from keyword research.
but if keyword research is such a foundational part of seo, why is it still so common to see keyword strategies that don’t work? why do we still see seo agencies exporting massive spreadsheets of keywords and instructing their clients to, “use the target keywords throughout the site” like it’s an afterthought?
through 10 years of testing and adapting countless techniques, we’ve locked down our keyword research. check out our page 1 keyword gains since following the technique outlined in this guide:
that’s a 469% increase in page 1 keywords after six years of completely flat results.
the net result is our website more than tripling its traffic. and it’s mostly thanks to data-led keyword research and content creation strategy.
it’s not black magic, and anyone can do it. so let’s get started.
you need a clear understanding of why you are doing keyword research before you even start. ask yourself:
your approach to keyword research will differ depending on how you answer these questions. try to think of keyword research as fitting into two broad buckets of keyword types and content:
commercial-intent keywords are typically used by searchers who are actively shopping for products and/or services. people searching these keywords have high commercial relevance to your website because they are more likely to hand you money at some point. they’ll search for things like:
they’ll expect to find product or service landing pages in search results that make it easy for them to shop and compare vendors. they want to understand how you do (or don’t) satisfy their need, and they want an intuitive way to purchase a product or request more information about a service.
think of these as revenue-generating keywords because the people searching them will likely generate the most commercial impact for your brand. to prove this point, check out our distribution of revenue-generating conversions by page type:
our blog content occasionally generates a commercially-relevant conversion from time to time, but the overwhelming majority of commercially-relevant conversions come from product or service landing pages.
people use these types of keywords when they are trying to learn something, and as such, they expect to find blog content or other in-depth 世界杯预选赛2022直播 that will do a great job of answering their questions. these types of searches look like:
the majority of these types of searches have no commercial intent (ie they don’t imply that the searcher intends to buy anything at the moment). so you’ll need to calibrate your expectations for what you’ll get out of your blog content.
think of these keywords as opportunities to answer your audience’s questions with awesome blog content. you want to provide enough relevance so that you sufficiently answer their question(s), and provide enough incentive to subscribe to a newsletter or browser notifications so that you can nurture them until/if the point comes when they want to buy something.
so before you get started, make sure you are crystal clear on why you’re doing keyword research, and the results you expect.
if you answered the question in the previous section with “i’m doing keyword research for my commercial landing pages,” congratulations, you’ve earned yourself an audit! and sorry about that. nobody gets excited about doing an audit.
*note: you can do this step for blog posts, too, but often you’re better off just doing a quick check to make sure you haven’t already written for this topic. you can do this simply using google search console/semrush/ahrefs/moz to see if one of your blogs is already ranking for the keyword in question.
but before you research a single keyword, you’ll need a crystal clear picture of which keywords you’re currently targeting and how they’re performing. otherwise you’re shooting completely blind in the hopes that you’ll hit something.
if you skip this section, let me give you some first-hand insights into what’s going to happen:
this will certainly take an entire afternoon, but i promise you’re going to save yourself a ton of work and 世界杯预选赛2022直播 if you fully audit your landing pages before doing anything else. think of this as eating your greens before your dessert.
in order to prevent disaster (and possibly even save time!), we are going to look into three main guiding principles that will help you make smarter decisions:
let’s do this thing together. away we go!
go through all of your commercial landing pages and pull the urls and their corresponding keyword targets into a spreadsheet. this will give you a clear overview of all the keywords you are targeting, and on which pages they are being targeted.
make sure you log your data in such a way that you can identify parent/child relationships between pages – i usually just use indentation.
are these even good keywords? you won’t know until you run them through a tool and grab some metrics. bulk upload each of your keyword targets into your paid tool of choice and populate the data in your spreadsheet.
looks good at first glance, but we need more context. we’ll be digging into each individual page to completely dissect what’s happening.
oftentimes your pages will rank for variant terms in addition to your target keyword. this situation presents an opportunity to shift your focus to a better keyword, or confirm what you’re already targeting. run each url through a tool that will tell you all the keywords your url rank for, and in which positions.
moz, ahrefs, semrush and ryte can all do this quickly and easily. make sure you note your target keywords vs. variant keywords. i’ll do this by indenting the variant keywords underneath the target keyword like so:
look at that: we’re not even targeting “content agency,” yet it ranks in position 12 and has more promising metrics than a lot of our other keywords. this seems like a better target, but i still need more information before i make a decision.
so far we have only looked at the scraped data our seo tools have available. these tools do what they can, but they don’t tell a complete story. google search console is going to give you the most reliable, and complete set of data to help you make decisions.
as an example, take a look at the variant keywords gsc found for our homepage:
using gsc will give you clear visibility into all the keywords driving traffic to your page. you’ll see the impressions they generate, their average position, clicks, and click-through rate. inspect each of your landing pages and make note of all pertinent metrics.
this adds an interesting wrinkle: “content creation” didn’t show up on our seo tools’ radars, yet there it is, driving a respectable number of clicks. furthermore, i ran the keyword through my paid tool and learned that it has the highest search volume out of all the available options.
you should have a spreadsheet filled with data for each of your commercial landing pages. this data should tell you:
you now have all the data you need to start making informed decisions. this entire exercise is done to give you a level set so that you’re not firing blindly at “new” keywords. based on what you find, you may even be able to minimize the amount of keyword research you have to do.
this is where you really get to have fun. few parts of the keyword research process call for creativity, so for those of you less mathematically inclined, eat your hearts out: new keyword ideation was made for you.
*note: blog researchers can jump back in here!
and the best part of the brainstorming step is that there is literally no wrong way to do it. below, i’m going to share some of my favorite techniques, all using free tools.
tip: don’t second guess yourself with any potential keyword idea. there are no bad keywords here. we will rule out weak keywords once we start adding numbers. but until then, have fun with it.
you need a handy tool to jot down your keyword ideas. i love rapidtable’s tool because it’s simple, and somehow saves my information for months without logging in.
but you can also use a spreadsheet, google’s notepad, apple notes or even a google doc. use whatever you’re most comfortable with, as long as it’s digital, and easy to copy/paste large sets of keywords.
you’re going to find that the language you use, the language your company uses and the language your target audience uses is often very different. we’re going to start with you.
begin with an idea, called a “seed keyword” from which every other idea will branch out. jot down every similar keyword you can think of related to that topic. don’t be shy; record everything that pops into your mind.
this is a great start, but now we need to get a feel for what your audience would search for.
you’ll want to get an idea of the type of language and phrases someone who is less ingrained in your industry would use to search for your topic. oftentimes we are so immersed in our industry jargon that the language we use is way off from what your target audience would use.
this does not need to be scientific or drawn out, so don’t overthink this one. here are a few simple ways you can get some quick feedback:
even if you only get a few new keyword ideas, you’ll still be in good shape because you can build on them.
pull up your top three competitors in separate browser tabs and start navigating through their content. if you’re doing commercial keyword research, check the title tags of the pages in their main navigation. the keywords they’re targeting are (or at least should be) used in their title tags.
for blog topic research, jump into their blog feed and search for related topics. (or anything that catches your eye – you may find some surprisingly great ideas.)
if your competitors have already done a significant amount of keyword research, you might as well use that information to your advantage.
there are more keyword research tools out there than i can count, and their quality and usefulness vary wildly. so for the sake of keeping this guide manageable, i’m going to limit this list to only the free tools i use most frequently for ideation only.
kpt is a terrible tool for assessing accurate search volume, but it’s still a great tool for ideating and adding to your list.
you’ll need to create a google ads account, and it’s likely going to funnel you through a process where you’ll need to pretend that you’re going to create a ppc campaign. but don’t worry, you can go through the whole charade without paying a cent and still use the tool.
click on “discover new keywords,” then add up to 10 seed keywords to get recommendations.
kpt will then populate a (hopefully) large list below your seed keywords that you can add to a list and export. export the .csv file, then copy and paste the keywords into your notepad. we’ll be adding all ideas from every tool into this one master list. and don’t worry about duplicates. our tools will take care of that later.
soovle is a fun tool that will autocomplete a seed phrase across a number of search engines including youtube, amazon, bing, yahoo! and google.
i rarely have use for non-google results, but occasionally ideas pop up in the other search engines that i can use. try a couple of your seed keywords and see if anything interesting populates that you want to add to your list. you won’t get massive lists of keywords from this tool, but it can certainly spark ideas you hadn’t considered before.
sometimes you already know a couple of the words that will need to be in your keyword. but, you don’t know exactly what combinations of words your audience will use.
for example, if i were interested in the keyword “seo content agency,” but wasn’t sure if people were more likely to search “seo agency services,” “seo services agency,” “seo content services” or any other of the hundreds of very similar keywords possible, i could use a tool that will auto-generate every possible combination.
kombinator allows you to add up to three sets of words and will give you every possible combination of keywords that can be used with the words you entered.
add these to your list and move onto the next free tool.
answer the public is similar to soovle in the way it uses autocomplete data to give you insight into highly related searches to your topic. imagine atp as a supercharged version of soovle, with the added ability to export a .csv for all the keyword ideas it generates, which can number in the hundreds.
entering “content marketing” immediately gave me 201 ideas that i can quickly export into a .csv and add to my list. pretty handy!
*choose your seed topics wisely because atp only allows you to do a few free searches per day.
this tool was previously named “keyword sh*tter,” likely due to its ability to “output” thousands of keyword ideas from nothing more than a single root keyword. and it’s fast. within a few seconds of entering “content marketing” in the tool, keyword sheeter generated over 100 ideas.
the free version of this tool allows you to export the full .csv file, while the paid version will add search volume and cpc figures. we are going to be using search volume data from other tools, so we’ll just take the free ideas, thank you.
tip: keyword sheeter could potentially be the only ideation tool you use if you’re in a time crunch. the results won’t be as strong, and you will get a lot of garbage keywords, but you’ll get a lot of good keywords as well, and very quickly.
if ubersuggest allowed you to bulk upload keywords and export search volume and keyword difficulty numbers, it would be a pretty complete (and formidable) keyword research tool. but it can’t, so we’ll have to settle for its very capable ideation abilities. ubersuggest has a number of features that can help you get ideas:
for a free tool, ubersuggest is pretty comprehensive. play around in here and see if you can squeeze out a few more ideas.
having scraped the depths of the entire internet for a topic, your master list should be enormous at this point. depending on your topic, you could have up to a thousand keywords or more.
tip: as a rule of thumb, you don’t need to have a target number of keywords in this list because it will vary greatly depending on your topic. but, looking at your list you should subjectively feel that you’ve got a healthy variation of phrases. if it feels a bit thin, it probably is.
get ready to do math, because now we are going to dive headfirst into numbers.
as much as the previous step was a purely creative exercise, the next step will be 100% data-driven. we’re going to use metrics from a variety of sources to determine the viability of each of our keywords so that we can make the most informed decisions possible.
we’ll start with some conceptual ideas, then move into practical usage with tools and spreadsheets. and don’t worry, even the least mathematically inclined of you will be able to understand this.
any paid keyword research tool will give you an estimated monthly search volume for the keywords you want to evaluate. what we’re trying to do here is find keywords that have sufficient search volume to justify investment in creating new pages, or re-targeting old pages.
for instance, it wouldn’t be wise to write a 2,000-word blog post that targets a keyword that is only searched 10 times per month. in other words, it’s not a good use of 世界杯预选赛2022直播 to target a topic that is searched so infrequently.
when considering the monthly search volume of keywords, keep in mind that you will not automatically be getting all of those clicks. of the monthly search volume for your keyword, your share of clicks will be determined mostly by your ranking position.
here’s a helpful graph that illustrates how your position determines your click-through rate:
your click-through rate drops exponentially from position 1 to 5, then flattens out into the land of irrelevance from positions 6+. so, in the best-case scenario (you rank in position 1), you’ll take about 32.5% of all clicks.
you need to keep that in mind when asking questions such as, “is a search volume of 50 enough?” do some simple math and calculate best- and worst-case scenarios. in the best-case scenario, you’ll get 16 clicks per month in position 1. if you land somewhere on page 2, you may not get any clicks.
using tools to gather search volume at scale
we’re going to be using a number of different keyword research tools to get an estimate of the monthly search volume of each of our keywords in the list we’ve been building.
and i need to emphasize the word “estimate,” because each tool is truly guessing what that actual number is.
and that number will vary wildly from tool to tool. for instance, take a look at the estimated search volume for “content marketing services” across a few tools:
given the wide range of results (from zero to 1,100 searches per month), it’s going to be important for us to use the “search volume” metric as an estimate, not as gospel.
as long as we do that, we’re golden. in other words, it’s not about finding the exact search volume for a keyword; it’s about getting a general idea of interest and acting on the information available.
i prefer to use a combination of tools when gathering this metric. this helps me identify keywords that have more reliable search-volume estimates and i’m more likely to make an educated decision on a keyword that has a search volume with little variation between tools, than one that has enormous variation.
looking at the chart above, if you had used only one tool, say spyfu, you would likely overshoot the keyword’s true potential by a substantial margin. so if you’re looking for a high degree of accuracy, using more tools will give you more confidence in your choices.
i’m going to argue that this is the most overlooked and crucial step that most seos fail to do, and for reasons i can’t quite understand. when evaluating your keyword list, you need to know whether or not you stand a realistic chance of ranking for that keyword. without that information, you’re shooting blind.
most reputable keyword research tools have some version of keyword difficulty as part of their keyword metric offerings, each with unique formulas and scales and varying degrees of accuracy.
here are a few examples of keyword difficulty scores from ahrefs, moz and ubersuggest:
so what are these scores telling you?
simply put, keyword difficulty measures the average strength of the pages and their domains that rank on page 1 of results for the keyword in question.
moz focuses primarily on a combination of page authority and domain authority to determine difficulty scores.
it’s important to note that these are relative metrics, meaning there is no “good” or “bad” page authority or domain authority. you may be tempted to think a domain authority of 84 is very good, but what if your competitor has a domain authority of 96? these are meant to be relative metrics so that you get a clearer understanding of which competitor has the strongest ranking potential.
using mozbar, you can see the pa and da of each search result:
moz looks through the first page of results for the keyword you’re targeting and assigns a keyword difficulty score based mostly on the strength of the pages (pa) and domains (da) that currently own spots on page 1. this should help you understand if the competition is relatively stronger, weaker or the same as your site.
for example, if we’re trying to rank for the keyword “inbound marketing,” we see that the keyword difficulty score is 58.
and the competitors look like this:
the average domain authority on page 1 is 77. our domain authority is 62. this makes us a definite underdog, punching way above our weight class. this is not likely a keyword i would target. generally, we can compete for keywords up to a difficulty score of around 45. i’ll opt to pass on this keyword.
fortunately, with most keyword research tools, you can batch upload lots of keywords and export their monthly search volumes and difficulty scores. this makes it very easy to sort through large lists of keywords and identify those with good combinations of search volume and difficulty scores.
you can easily export this data and manipulate it in a spreadsheet using conditional formatting and custom formulas to find the ideal keywords you should target.
let’s take stock: so far you have narrowed your list down to a set of keywords with an acceptable search volume that you can realistically rank for on page 1 of results.
are we done? no.
what happens if you rank in the third position for a keyword, but the page is extremely crowded with ppc, news, featured snippets and images? your organic result gets ignored, that’s what.
as a searcher, you know exactly what this looks like. and this problem is getting increasingly pervasive. courtesy of rand fishkin at sparktoro, we have data that tells us over half of all searches result in no clicks:
this rapid decline is primarily due to google pulling content from publishers’ websites and “borrowing” it for their search engine results pages (serps). looking at the trendline below, we can see that it’s becoming increasingly difficult for seos and content marketers to win clicks from search:
more clicks are also going to google properties and google ads each year.
so what does that mean for you? it means that even if you make it to page 1, your likelihood of getting a click continues to decline. that fact is more obvious in the instances where serps are littered with non-organic results.
take a look at this serp:
good luck getting an organic click on that results page! we’ve got shopping, ads, a featured snippet, people also ask, videos and more ads.
fortunately, there are a few tools out there that can help you calculate how much these distractions will influence a click. moz uses an “organic ctr” scale from 1-100% that estimates the percentage of clicks available compared to traditional organic results. in other words, lower scores = lots of distractions and bad for organic results. higher scores = fewer distractions and better for organic results.
ahrefs has a very helpful metric that indirectly addresses this issue, called “clicks per search,” or “cps.” it’s calculated by dividing the monthly search volume by the number of actual clicks that happen after a search.
you could argue that keywords with a clicks-per-search score lower than 1.0 are scoring that way because of the information google pulls directly onto the serp. with answers presented right on the page, searchers have very little reason to click through to a website to search for the information they need.
this is important information to use in your analysis when evaluating keyword opportunities.
now that we understand the types of metrics we are going to be working with, we need to choose a paid keyword research tool.
paid tools often give you the benefit of amassing a large amount of keyword data at scale (and you can’t get the data we need from free tools). this helps cut down on the time it will take you to evaluate your (likely very large) list of potential keywords.
i’d love to tell you that you can perform awesome keyword research for free, but unfortunately the metrics we need to make good decisions all cost money. but fortunately, i have plenty of experience with paid tools and can make some recommendations.
this list is completely subjective and based solely on my experience of experimenting with many (so many!) keyword research tools over the years.
i generally recommend tools based on the following categories:
with that out of the way, it’s time to geek out about paid keyword research tools. onward:
ahrefs is what i would consider a complete keyword research tool. it offers a ton of keyword suggestions to add to your ideation process. additionally, it has a few unique features like clicks per search, return rate and a notably accurate keyword difficulty scoring formula for lower difficulty keywords. it also features an estimated number of backlinks and root domains needed to compete on page 1 for a given keyword.
i’m also a big fan of the estimated traffic metric in the serp overview section, which gives you a realistic look at what kind of overall search traffic you can expect if you target and rank for a particular topic. this is calculated by estimating traffic from the total variant keywords a specific url ranks for, along with the ranking position for each of those keywords, search volume and estimated ctr.
this is a much more realistic way to project traffic for a keyword topic. as a matter of fact, i backtested this analysis and found this method to be 80-85% accurate in predicting actual organic traffic. removing outliers got me above 90%. pretty remarkable stuff for projecting traffic without writing a single word (we’ll talk on this in more detail later).
moz has a special place in my heart. it was the first keyword research tool i started with nearly a decade ago. it remains a mainstay and trusted resource in my repertoire.
moz was one of the first tools to provide organic keyword difficulty scores, giving them a leg up against the competition. in terms of accuracy, user experience and value, moz is a really nice tool for just about any level of seo. furthermore, their subscription comes with mozbar, which allows you to inspect serps on the fly and gives you an incredible read into the competitive landscape. there is no substitute for manually inspecting serps for difficulty.
moz also has a unique feature that helps you determine keyword priority by combining search volume, difficulty, serp crowding and a subjective relevance score (my score aka is this keyword actually relevant to my business?), making it easy to sort through massive quantities of keywords in one go.
their platform is also one of the most user-friendly and approachable tools you will find, making keyword research accessible to just about anyone. the early authority in seo, moz is a company of great, passionate people who have built a tool that reflects their values.
i’ve only been using kwfinder for a couple years, but i’ve absolutely fallen in love with it. initially you’re drawn to the brilliantly simple user experience, but your appreciation will grow as you notice how it incorporates a cluster of additional features from other tools, making it one of the more humble offerings out there.
if you look carefully, you’ll see it includes a serp analysis section with features from moz and majestic seo, earning major points for consolidating data. among many other metrics, you’ll find:
it also includes an api that pull in shares, inbound links and their own link profile strength indicator.
note that the tool also has up-to-date search volume trends and a respectable ideation section including related keywords, autocomplete keywords and questions.
the amount of easy-to-use features, along with very accurate keyword difficulty scoring comes with a shockingly affordable price tag of $49/month (and available as low as $29.90/month if billed annually). this easily puts kwfinder at the top of the pile for value, making it my top recommendation for low-budget startups and bloggers, independent content creators and burgeoning seo consultants. this tool is the little engine that could, giving users a ton of value for very little cost.
get this tool before they realize that they are charging about ⅓ of the yearly billing price as some of their competitors and bump the price up.
big thanks to the folks at ltp for shooting me over a license so that i could demo their tool for this review.
ltp is a pure keyword research tool, offering all the main features you look for with an intuitive ux. unlike some of the other pure keyword research tools out there, its ideation capabilities are quite strong. you could likely put together a respectable list of keywords together using only this tool.
ltp has a couple of standout features that really set it apart from the competition. all of the tools reviewed will generate a keyword difficulty score for your keyword; it’s a minimum requirement, but ltp is the only tool that will evaluate your site and tell you which keyword difficulty scores are relatively high or low for your site.
all the other tools present keyword difficulty scores without the added context of how that score applies to your actual website. ltp effectively removes the guesswork for deciding whether or not your site can rank for a keyword.
another great feature is ltp’s serp analysis, which generates both page and domain difficulty scores for the competition ranking in serps.
similar to how moz inspects serps for page authority and domain authority, ltp consolidates these metrics into one overarching keyword difficulty score. this makes quick scans through serps a breeze. the serp analysis also incorporates a cluster of other metrics including majestic trust flow metrics, domain age and link profiles.
two of my other favorite features are serp availability and a “strongest competitor” evaluation. the serp availability metric is yet another way to evaluate serp crowding, but with the most user-friendly dashboard i’ve seen. ltp shows you exactly what will be siphoning away clicks, and by how much.
the “strongest competitor” evaluation shows you which site is going to be the most difficult to beat in serps.
spyfu has some deep roots as an seo tool, going all the way back to 2006. when i first discovered them, their main focus was delivering competitive analyses; you could plug in a competitors’ website to get an overview of the keywords they rank for, and the keywords that overlap with your site (keywords you compete for).
over the years they have quietly created a full-blown seo tool that includes plenty of keyword research features. as you can see in the price tag, their solution is the cheapest monthly option i’ve used. similar to kwfinder, you get a lot for a little. their most impressive feature is the single keyword analysis that has an insane amount of useful data about the keyword, including estimated clicks (similar to ahrefs’ cps), ppc recommendations, serp position history and a serp overview including domain strength.
while i do appreciate the appealing price tag (particularly for seos and content writers looking to get their feet wet), what you save in price you give up in accuracy. in a study of the most accurate keyword difficulty tools, spyfu came in last for the paid tools. and there is an added frustration that their database isn’t comprehensive enough, returning results for only 80% of the keywords i batch-uploaded. i just retested with a batch upload of 93 keywords and only got 54 matches (58%). it’s very difficult to do keyword research when your tool doesn’t have data on your keywords.
my experience with spyfu is that it’s a nice starter tool on a budget.
semrush has come a long way over the past couple years with their keyword research capabilities, putting them in the upper tier of tools.
i was previously frustrated with semrush’s inability to easily batch-upload large sets of keywords in order to quickly generate and export search volume and difficulty scores. getting the information i needed was less straightforward than other tools, requiring me to grab some information from one part of their keyword research tool, and grabbing the missing information from another part of the tool. and vice versa. part of the problem, unlike the other keyword research tools on this list, is that they have yet to seamlessly integrate all of their keyword research functionality into one intuitive section.
that said, they’ve made great strides in this area with the keyword overview section, which allows you to batch upload a maximum of 100 keywords. the output is more intuitive, has a high match rate and lets me easily export a .csv file.
as an added bonus, semrush does a great job with its serp analysis of individual keywords, providing comparable data to ahrefs:
in recent years, semrush has done such a great job catching up with – and passing some of their competition – that they have earned a well-deserved place on this list.
while no single seo tool is completely accurate when reporting monthly search volume and keyword difficulty, using any of these tools will get you worlds closer to making informed decisions about your keywords than not using one. when selecting one of these tools, the real decision comes down to budget.
if you’re working for an organization that will be doing a substantial amount of keyword research on a monthly basis, you may want to consider a higher-powered tool like ahrefs, moz or semrush. if you’re a content creator or single person organization looking for something budget-friendly but without all the bells and whistles, you can get by just fine with ltp, kwfinder or spyfu.
now it’s time to put that data to use.
status check: at this point you have a large list of keywords that you’ve uploaded into your keyword research tool. our next step is to export all of our data into a spreadsheet and find the highest potential keywords.
each of the tools listed above allows you to export the full set of keywords you imported along with each keyword’s metrics. export the .csv.
any spreadsheet tool you like to use to organize data is perfectly fine, whether it’s google sheets, apple numbers or microsoft excel. as long as the tool has sorting and conditional formatting options, you are good to go.
you’ll want to ensure that you have a minimum of the following columns:
your empty spreadsheet should look something like this:
use conditional formatting for each of the search volume, difficulty and cps/organic ctr columns. you’ll want higher search volume and cps/organic ctr metrics to appear green, and lower numbers to appear red. do the opposite for keyword difficulty, with lower numbers being green and higher numbers being red.
copy/paste the data from your .csv file into the spreadsheet. if you’ve set up your conditional formatting properly, your spreadsheet will start looking pretty colorful.
bonus step: keyword search volume is rarely an accurate indicator of the amount of search traffic a page will drive if you create a blog or landing page targeting it. pages generally rank for many related keywords, each driving traffic to the same page depending on the keyword’s search volume and your ranking position.
try using ahrefs to get a better feel for actual search traffic potential.
here’s how: we can see that the keyword “content marketing agency” is searched 1,500 times per month in the u.s.
but the pages that rank in the top-10 results for “content marketing agency” rank for an average of 165 total keywords. furthermore, those keywords drive an average of 451 visitors per month.
so if we look at this from the perspective of “how much traffic can this topic drive?” – rather than “how much traffic can this single keyword drive?” – your forecasting will be much more accurate. as a matter of fact, using ahrefs to backtest this theory on our existing landing pages yielded 80-85% real-life traffic accuracy. 80-85% accurate traffic forecasting without writing a single word is an seo’s dream scenario.
this is a manual process and, if you have the time to do it, i highly recommend the investment. add another column to your spreadsheet and add this data.
we are looking for keywords with the best combination of high search volume, low difficulty and (optional) strong serp data. i usually start this process by eliminating keywords that i’m positive i won’t be targeting.
i’ll immediately disqualify keywords with zero search volume by marking the cells red. i’d recommend not deleting the keywords, because if you revisit this list in the future you’ll want to know the keywords you already eliminated.
i’ll then disqualify keywords with disproportionately high keyword difficulty scores. as discussed previously, i know we don’t generally rank on page 1 for keywords with moz difficulty scores above 35, so i’ll eliminate all of those right off the bat.
now that you have a more manageable list, start scanning for keywords that have strong metrics and a high level of relevance to my brand. i’ll generally highlight my favorite keywords light blue.
once you complete this process, you should be left with at least a few interesting keywords that you want to further qualify in the next step. we should be left with only high potential keywords that our tool(s) indicate we can a) rank somewhere meaningful and b) have sufficient search volume to justify investing in content creation.
now that we have a shortlist, we’ll need to add a human element to the qualification process.
we’re 90% of the way to the finish line. congratulations! we’re now left with relevant keywords, each with substantial search volume and plenty of ranking potential.
but without this next step, everything we’ve done will fall flat on its face.
we need to manually inspect serps for each potential keyword, then designate how we’re going to use each keyword (if we decide to use it).
let’s revisit the keyword difficulty section of this guide. any of the paid tools you’ve chosen calculate average keyword difficulty scores by evaluating the actual pages – and their domains – that rank on the first page of results for a keyword. but you need to keep in mind that keyword difficulty scores are just a best guess by that tool.
there is no replacement for manually inspecting results with your own eyeballs. not only will this give you a higher degree of accuracy, but it can give you insight into where you will likely rank.
tip: keyword difficulty scores can send false positives or false negatives. imagine seeing data like the following for your target keyword:
looks great, right? well, not necessarily. keyword difficulty scores are averages and don’t give much context. what if the ranked results look like the following:
while the keyword difficulty score reported to you is technically accurate, it reads as a bit of a false positive because you’ll likely rank no better than position 4, which is respectable, but there is a big difference between a ctr of 32.5% and 6%.
the above scenario happens frequently and can drastically influence whether or not you decide to target a keyword.
when you’ve managed to narrow your larger list down to a small number of top candidates, manually look through results and use common sense. are you trying to outrank amazon, wikipedia and forbes for the top 3 positions?
add metrics to your investigation by using the serp inspection tools available in your paid tools, reviewed previously.
google is an incredible sorting mechanism, rearranging the types of content searchers are interested in clicking on when they search for something. typically, searches can be broken down into three main categories: informational, commercial/transactional and navigational (we touched on this subject early on in the guide).
we are going to talk about matching informational and commercial types of keywords to appropriate types of content.
80% of all searches are informational, meaning searchers are typically seeking more information about a particular topic. these people are not intending to buy anything. typical content that results from informational searches:
google is constantly evaluating how people are interacting in search results for keywords and rearranging the results based on how searchers vote with their clicks. google is striving to match informational searches with content that best provides the information the person is looking for, typically blogs and guides.
10% of searches are commercial/transactional, meaning searchers are shopping for products or services. these people are likely intending to buy or request more information on a product or service. typical content that results from commercial/transactional searches:
google also strives to match commercial searches with content that makes it easy for searchers to review a product or service and purchase or request a demonstration, usually a product or service landing page.
searching “best project management software” results in 5 blog posts comparing the best project management tools, and 5 product landing pages from companies that provide project management software.
if google sees that 99% of all clicks are going to the blog articles, google will determine that this is the type of content searchers most likely want to read, and may shuffle those results to the higher positions, and re-shuffle the content that does not satisfy that intent toward the bottom of the page.
if the content you create doesn’t match the intent of the searcher, it doesn’t matter how strong your domain authority and page authority are; you’ll never survive in the top results.
you need to ensure that you write the type of content that visitors want to read. so by looking through google’s search results, you will see a constantly self-correcting mechanism of the types of content searchers “voted” for with their clicks.
investigate the serps for each keyword and determine whether your target keyword is informational, commercial or a mix of both.
the next step is a natural extension of the previous step. taking this list and simply “using these keywords throughout your site” is a complete waste of time and will accomplish nothing. you need to determine exactly how you’re going to use each keyword. based on the results from the previous step, this should be fairly easy.
go through your top keywords and choose the type of content you will want to create for each keyword.
bonus step: consider how you will write the content for your target keyword. if you noticed serps contain lots of results with list blogs, you should strongly consider doing something similar. if you noticed most results use a heavy amount of graphics in their content, it’s possible that searchers are looking for just that.
at this point, you should be left with a shortlist of all the keywords you want to go with. you’re ready to start writing!
google has come a very long way with understanding how well content satisfies the intent of a keyword. it also understands how thoroughly you covered all subtopics the searcher might want to know about. this further underscores the significance of selecting the right keywords when creating content – specifically, by making sure you truly know the intent behind the queries you’re targeting with that content.
however, google’s evolution is a predominantly positive development for content creators, because it gives them an opportunity to “punch above their weight class” when targeting keywords.
for instance, in the olden days of seo, google primarily relied on link profiles for pages and domains along with on-page seo factors to determine what should get prime positioning in search results. in other words, high-reputation websites could win keywords on the backs of their reputation alone, rather than the quality of their content.
google was more mechanical back then – it relied on link data and the things you said the page was about via on-page metadata.
while google still uses these indicators, it is now more likely to award prime placement to the highest quality content rather than just going with the most reputable site. so what that means for us is that we can often beat powerhouse websites if we create better content that truly satisfies searcher intent.
this is the gist of it: if you want to write a piece of content on a topic, you should find out what all of the supporting topics are that you could cover to make the piece more thorough. ideally, you don’t want to give the searcher any reason to find more information from another website. you want to be the wikipedia for that topic.
you can get this information manually, or by using a high-powered tool like marketmuse, or a writer-friendly tool like clearscope. these tools will show you how well you covered all the potential sub-topics searchers are looking for.
use these tools to create an intuitive content brief that you can hand to a writer who can then create the most thorough piece of content on the web for that topic. once your content is published and indexed, expect it to take 100-150 days to start generating results.