Keyword Research: Tools and Methods That Rank

How to run keyword research that holds up: pick tools, judge difficulty and volume, group keywords by intent, and turn a list into pages that rank.

ADS Beast editorial teamPublished 12 min read

Keyword research is the process of finding the queries people type into search engines, judging which ones you can realistically rank for, and mapping each to a page. The work has three parts: collect queries, filter them by intent and difficulty, then assign one primary term per URL. Tools speed this up; judgment decides the outcome.

Short version

  • Collect from four sources: your own Search Console data, autocomplete and People Also Ask, community sites, and paid databases.
  • Judge every keyword on three axes at once: search intent, difficulty, and volume. Any one alone misleads.
  • One page targets one primary keyword plus a few close variants. Terms with different intent get their own URLs.
  • Search volumes are relative signals, not traffic forecasts. Tools disagree, sometimes by a wide margin.
  • The output of research is a mapped list: keyword, intent, target URL, and the page's job.

What keyword research actually produces

A finished keyword research project ends with a spreadsheet, not a list of words. Each row holds a query, its intent, an estimated difficulty, a volume figure, and the URL that will target it. If a row has no URL, the research is not finished.

That mapping step is where most projects fail. Teams collect hundreds of terms, write them into a document, and then write articles that chase five keywords at once. Google ranks pages, not keywords, so a page that tries to cover five unrelated intents ranks for none of them well. The discipline is boring and it works: one intent, one URL.

SEO keyword research also feeds work outside content. The same query list tells you which ad groups to build, which questions belong in an FAQ block, and which phrases belong in a title tag. That is why the list should live somewhere shared rather than in one person's notes.

Keyword research workflow. Collect queries: Search Console, autocomplete, People Also Ask, community sites; Classify intent: Informational, commercial, transactional, or navigational; Filter by difficulty and volume: Read both together, never one alone; Group and map to URLs: One primary keyword plu
From raw queries to a mapped page plan, in five passes.

How to collect keywords from free sources

Free sources give you real queries tied to your own site, and they cost nothing but time. Start there before paying for a database, because your Search Console data tells you what you already rank for and where you are close.

  1. Open Google Search Console, go to Performance, and sort queries by impressions rather than clicks. High-impression, low-click terms are pages that rank on page two or three and need improvement, not new content.
  2. Type your seed term into Google and read the autocomplete suggestions. Then add each letter of the alphabet after the seed to expand the list.
  3. Scroll to People Also Ask and note every question. These are queries Google has already decided are related.
  4. Search your topic on Reddit, Quora, and YouTube, and copy the phrasing people use in their own words. Community language often differs from the polished phrasing in a keyword tool.
  5. Pull the queries that already bring impressions from your analytics, including the misspellings. A misspelling with volume is still a query.

This is how you find Google keywords without a subscription. It is slower than a database, and the volume estimates are missing, but the intent signals are stronger because the queries come from real searches.

Keyword analysis tools and what each one is for

Keyword analysis tools fall into four groups, and most teams need one from each rather than five from the same group. The table below maps the job to the tool type.

JobTool typeWhat it gives youMain limitation
Find queries you already rank forSearch ConsoleReal impressions, clicks, positionOnly your own site's data
Discover new query ideasAutocomplete, People Also Ask, community sitesReal phrasing, intent signalsNo volume or difficulty data
Estimate volume and difficultyPaid databases (Ahrefs, Semrush, and similar)Volume, difficulty score, related termsEstimates, not measured traffic
Check what already ranksManual SERP reviewThe actual competing pagesSlow, does not scale

A keyword research tool is a starting point, not an answer. The paid databases estimate volume from a data panel, then round and group close variants. That is why two tools disagree, sometimes by 20 to 40 percent on the same query. Use the numbers to compare keywords against each other, not as a forecast of sessions.

If you want to test a database before committing, ahrefs free keyword research options and similar free tiers exist, and they are enough to judge whether the interface fits how you work. The free tier limits rows and features, but the shape of the data is the same.

The manual SERP check is the step people skip and the one that changes decisions most. Before you commit to a keyword, open the first page of results and read it. If every result is a product page and you planned a blog post, your format is wrong regardless of what the difficulty score says.

Free sources vs paid databases. Free: tied to your site: Real queries, real impressions, no volume estimates; Free: real phrasing: Autocomplete and forums show how people actually type; Paid: volume and difficulty: Estimates for comparing keywords, not traffic forecasts; Paid: scale: Thousands of ro
What each source gives you, and where it stops being useful.

How to judge search intent before difficulty

Search intent is what the searcher wants to accomplish, and it decides the page format before any difficulty score matters. Read the top ten results and classify them. If the results are guides, write a guide. If they are category pages, build a category page.

Four intent types cover most queries:

  • Informational: the searcher wants to understand something. Format: guide, explainer, FAQ.
  • Commercial: the searcher is comparing options. Format: comparison, review, alternatives list.
  • Transactional: the searcher is ready to act. Format: product page, pricing page, signup page.
  • Navigational: the searcher wants a specific site. Usually not worth targeting unless it is yours.

Intent mismatches are the most expensive keyword research mistake because they waste an entire page. You can outrank a stronger domain with a better-matched format. You cannot outrank anyone with the wrong format, no matter how good the writing is.

There is a second layer worth checking: how the query is phrased. "How to run keyword research" and "keyword research tool" share a topic and share nothing else. The first wants a method, the second wants a product. Splitting them onto one page satisfies neither reader.

How to read keyword difficulty and volume together

Keyword difficulty estimates how hard it is to reach the top ten results, usually on a 0 to 100 scale. It is a model built mostly from backlinks and domain authority, so it ignores relevance, content quality, and whether the ranking pages actually answer the query. Treat it as a filter, not a verdict.

Volume has the same problem from the other side. A term with 50 monthly searches and clear buying intent can outperform a 10,000-search term you will never rank for. Volume without difficulty is a wish; difficulty without volume is a hobby.

The practical pairing depends on your site's stage:

  • New site: target low-difficulty terms with 100 to 1,000 monthly searches. You need wins to build authority before you can compete for head terms.
  • Established site with topical authority: mix mid-difficulty terms with a few head terms where your existing pages already rank on page two.
  • Local or niche business: volume matters less than proximity and intent. A low-volume local query converts better than a national one you cannot serve.

There is no universal threshold, and anyone who gives you one is guessing about your site. Check volume against difficulty and conversion intent together, then decide.

Grouping keywords into topics and pages

Keyword grouping is the step that turns a list into a content plan. Group queries that share intent and can be answered by the same page, then give each group one URL and one primary keyword.

The rule of thumb: one primary keyword plus three to five closely related secondary keywords per page. Related means the same intent with different phrasing, not a different question. "Keyword research tools," "best keyword tool," and "keyword analysis tools" can live together. "How to do keyword research" belongs on a different URL because it wants a method, not a product list.

Watch for cannibalization, where two of your own pages compete for the same query. It shows up in Search Console as a query with two URLs alternating positions week to week. The fix is to merge the pages or re-target one of them, not to write a third.

The same grouping logic applies beyond organic search. Ad groups, FAQ blocks, and internal anchor text all get cleaner when they follow the query groups you already defined. If you run paid campaigns alongside content, the query list you built here maps directly onto campaign structure, and the same intent logic decides whether a term belongs in a search campaign or a social one. Our breakdown of Facebook Ads vs Google Ads on a small budget covers how intent changes the platform choice.

Common keyword research mistakes

The most common mistake is treating a keyword tool's output as a plan. A database export is raw material. Without intent classification and URL mapping, it is a list of words that will produce scattered articles.

Other mistakes show up repeatedly:

  • Chasing volume only. High-volume head terms are usually dominated by sites with years of authority, and a new page will not break in.
  • Ignoring the SERP format. If the top results are all videos, a text post is the wrong bet.
  • Targeting the same intent on multiple URLs. This splits your own signals and helps no one.
  • Skipping the check for what already ranks. A quick look at your existing pages often reveals a term you rank for at position 11 that needs a small update rather than a new article.
  • Forgetting that AI answer engines cite pages too. The queries that get cited in AI overviews tend to be the ones with a clear, self-contained answer near the top of the page. If a competitor keeps getting cited instead of you, the problem is usually answer structure, not keyword choice, and our guide on why an AI answer cites a competitor instead of you walks through the fix.

Difficulty scores also mislead in one specific way: they do not know your niche. A 60-difficulty term in a topic where you have ten well-linked pages is easier for you than a 30-difficulty term in a topic where you have nothing.

Turning research into pages that rank

A keyword becomes useful when it is attached to a page with a job. Write the page title from the primary keyword, put the direct answer in the first paragraph, and cover the secondary variants in subheadings where they fit naturally. If a secondary term needs its own section, it probably needs its own page.

Then measure. Search Console shows which queries the page actually earns impressions for, and those are frequently not the ones you targeted. That data is the input for the next round of research, which is why this is a loop rather than a one-time project.

Agencies running this loop across multiple clients end up with the same problem: research, production, and reporting live in different tools. Keeping the keyword map, the content calendar, and the campaign structure in one place is what makes the loop fast enough to matter. That is the workflow our ad operations for agencies platform is built around, and it is worth seeing how the pieces connect before you scale the process.

Next step

Pick one topic you already have authority in, open Search Console, and export every query with impressions but no clicks. That export is your first keyword list, and it is the highest-return research you can do this week because those pages already rank close to the top. Sort it by impressions, classify intent for the top twenty rows, and map each to an existing URL or a new one. Then look at how the same query structure maps onto paid campaigns so the two channels reinforce each other instead of competing.

FAQ

How many keywords should I target on a single page?

Focus one page on one primary keyword and three to five closely related secondary keywords. Google ranks pages, not individual keywords, so splitting a single topic across ten near-duplicate pages usually causes them to compete with each other. If a term needs its own intent, give it its own URL.

What search volume is worth targeting?

There is no universal threshold, but for a new site, keywords with 100 to 1,000 monthly searches and low difficulty are the practical starting point. A term with 50 searches per month and clear buying intent can outperform a 10,000-search term you will never rank for. Check volume against difficulty and conversion intent, not in isolation.

Why do keyword tools show different search volumes for the same term?

Each tool pulls from a different data panel, then rounds and groups close variants differently. Ahrefs and Semrush, for example, often disagree by 20 to 40 percent on the same query. Treat the numbers as relative signals for comparing keywords, not as exact traffic forecasts.

Where can I find keywords for free?

Google Search Console shows the queries you already rank for, and the autocomplete and People Also Ask boxes reveal what searchers type next. Reddit, Quora, and YouTube comments expose the phrasing people use in their own words. Paid tools speed this up, but the free sources give you real queries tied to your site.

What is keyword difficulty and should I trust it?

Keyword difficulty estimates how hard it is to reach the top 10 results, usually on a 0 to 100 scale. It is a rough model based on backlinks and domain authority, so it misses relevance and content quality. Use it to filter a list, then check the actual top-ranking pages before you commit.

How often should I redo keyword research?

Continuously, in small passes. Search Console data changes monthly, and new queries appear as your pages age. A full rebuild once or twice a year is enough, but the weekly habit of checking which queries your pages actually earn keeps the map honest.