Competitor keyword research: how to find the gaps worth taking

Find keywords worth taking

To find the keywords your competitors rank for, enter each competitor's domain into an organic research report and export its ranking terms. Then delete everything that can't bring you a customer. The export takes minutes. Most of the value comes from the competitors you pick beforehand and the filtering you do afterwards.

Choose the sites that beat you in search

The companies that win deals against you aren't always the sites that outrank you. A software vendor might compete for sales with two firms but lose its search traffic to a review site and a trade magazine. Search your 10 most valuable keywords in a private browser window and note which domains keep appearing on page one. Pick 3 to 5 of them. With fewer, the gap is thin. With more than 5, the list fills up with terms that only one outlier ranks for.

Pull each competitor's ranking keywords

Enter each domain in an organic keyword report and set it to the country you sell in. Semrush calls this report Organic Research, and Ahrefs calls it Site Explorer. Sort by estimated traffic. A term with 50,000 monthly searches where the competitor sits at position 40 sends it almost nothing. Positions 1 to 20 show what a competitor has actually earned, so export that range for every domain.

Strip out branded and off-topic terms

Remove each competitor's brand and product names, along with support queries such as "[brand] login." Then delete topics outside your offer. If a rival runs recipes on its kitchenware blog and you only sell knives, its recipe traffic isn't a gap for you. Expect the list to shrink a lot at this stage. What's left are queries your customers type.

How gap analysis surfaces wins

The fastest way to run a keyword gap analysis is a gap tool that compares your domain with all your competitors in one report. Semrush's Keyword Gap compares keyword profiles of up to five competitors side by side and sorts the results into tabs. "Missing" lists terms every competitor ranks for and you don't. "Weak" lists terms where you rank below all of them.

1. Enter your root domain first, then the competitor domains you chose.
2. Set the keyword type to organic and the database to your target country.
3. Open the Missing tab and filter to competitor positions 1 to 20, with a minimum volume that fits your market.
4. Export the Missing and Weak lists into one sheet, with a column that marks which tab each row came from.
5. Search 10 rows yourself to confirm that the results page looks the way the tool says it does.

The tabs carry different risk. A missing keyword that all 4 of your competitors rank for is a safer bet than one where a single competitor ranks. When every competitor ranks, it shows Google treats the topic as relevant to sites like yours. Weak keywords are the quickest wins because Google already ranks a page of yours for them, just too low. Ahrefs does the same job in its Competitive Analysis report, which adds a filter for how many competitors rank.

The spot checks in step 5 matter because gap tools estimate positions from sampled data. If a "missing" keyword's results page turns out to be all videos or forum threads, a standard article won't compete there, and the row should go.

Prioritizing gaps by business fit

A competitor keyword is worth targeting when the person searching it could become your customer and your site has a realistic path to page one. Search volume comes after those two tests. If you sort a gap list by volume, broad informational terms end up on top, and those terms rarely turn into revenue. Score every surviving keyword on four questions:

• Intent fit: does the searcher want something you sell, or only information near it?
• Page fit: can you publish the kind of page that ranks now, such as a product page or a comparison?
• Difficulty against authority: could your domain match the link profiles of the ranking pages within a year?
• Value per visit: what is a conversion on this topic worth to you?

Score each question from 0 to 3 and add the scores up. Anything near 12 goes into the first quarter. Drop anything under 6 unless it supports a page that scores high. A new domain should weight difficulty heavily, while an established one can go after harder terms that pay more.

Then test the ranking against people who talk to customers. If the top 10 rows wouldn't interest your sales team, the scores are wrong because intent fit is off.

What free tools actually show

Free tools can start competitor keyword research, but none gives you a complete competitor keyword list. A free Semrush account allows 10 queries per day, which is enough to glance at one competitor's top terms. Ahrefs Free, formerly Ahrefs Webmaster Tools, works only on verified domains. That means you see your own keywords and none of a rival's. Google Search Console has the same restriction, and its interface exports stop at 1,000 rows of data.

My verdict: use the free tiers to test an idea, and pay for one month when you need the full analysis. A month of a paid plan gets you the complete gap export, and you can cancel once the plan is built. Choose Semrush if you want paid and organic data in the same comparison. SpyFu fits a budget under $50 a month, and Ahrefs makes sense if your team already pays for it.

Checking competitor paid keywords

Competitor paid keywords show which queries rivals think are worth paying for, which makes them the strongest commercial signal in a gap list. A business that keeps bidding on a term month after month earns more from it than it spends. Those queries usually have organic SEO results too. A page that ranks there reaches the same buyers without paying per click.

Google's Ads Transparency Center shows ads from verified advertisers across Search and YouTube, along with other Google properties, but it won't reveal keywords or spend. One PPC manager put the limits plainly in a Reddit r/PPC thread: "not all advertisers are verified so they won't show up, and you can only see the ad creative, not performance data."

For the keywords themselves, switch the keyword type in Semrush's Keyword Gap from organic to paid, or use SpyFu. SpyFu's Basic plan includes 10+ years of historical search data. That history matters because it tells you how long a competitor has bid on a term. A bid that ran for one month was a test, while a keyword bid on for two years converts and belongs near the top of your priority sheet.

Turning gaps into a plan

A gap list becomes a content map when each priority keyword has a URL and a page type. Assign a publish date to each one. Work through it in this order:

1. Group the keywords by topic so that one page targets a cluster of close variants instead of a single term.
2. Map each keyword cluster to a page. Weak keywords go to the page that already ranks, and missing ones need a new URL.
3. Open the top 3 results for each cluster's lead keyword and note the format and depth that Google rewards.
4. Write one brief per page that lists the keyword cluster and the questions the ranking pages answer.
5. Schedule updates before new pages. A page already sitting at position 12 can climb quickly, while a new URL has to be crawled and earn links first.

How much you take on depends on how much you can publish. If your team ships 4 pages a month, take the 12 highest-scoring clusters for the quarter and leave the rest in the sheet. Before anything goes live, check that no two pages target the same cluster. If they do, both pages compete for one spot and neither ranks well.

Tracking gap closure

A gap is closing when the target page reaches the top 10 for its lead keyword and Search Console starts showing impressions for the cluster's variants. Add every priority keyword to a rank tracker on the day its page goes live. Tag it with its cluster and record the starting position. Search Console keeps only 16 months of performance data, so export it monthly if you want year-over-year comparisons.

Re-run the gap report every quarter. Some gaps will have closed, and competitors will have opened new ones you can add to the next content plan.

Most stalls come from four problems:

• Indexed but not ranking after 8 weeks: compare your page with the top 3 results. The cause is a mismatch in intent or format.
• Ranking for the wrong variant: your title and headings lean toward a nearby term. Rewrite them around the lead keyword.
• Two of your pages trading places: they target the same cluster. Merge them and redirect the weaker URL.
• Rankings up, clicks flat: look at the results page. An AI answer above your listing is taking the clicks.

AI-first keywords competitors miss

Competitors overlook gaps in AI answers because standard keyword tools measure Google rankings and ignore citations in AI assistants. That blind spot grows as fewer searches end in a click. SparkToro's 2024 study with Datos found that 58.5% of US Google searches ended with zero clicks. Ahrefs measured a 34.5% lower clickthrough rate for the top result when an AI Overview appeared, and its rerun on December 2025 data put the drop at 58% for top-ranking pages.

Ryan Law, Director of Content Marketing at Ahrefs, opened that study bluntly: "Google says AI Overviews increase clicks. Cold, hard logic disagrees, and so does our research."

AI-first keywords are prompts. They're longer and more conversational, like "which CRM works for a 5-person agency on Gmail," and keyword tools report little or no volume for them. To find yours, take your top gap clusters and rewrite each one as 5 to 10 questions a buyer might ask an assistant. Run them in ChatGPT and Google's AI Mode, and note which brands each answer names and which pages it cites. If a competitor ranks first on Google but never appears in AI answers, you have an opening.

Ahrefs found a 70% chance an AI Overview changes between observations. Run each prompt more than once over several weeks before you treat a result as a pattern.

What to do next

This week, run one gap report against 3 to 5 search competitors and score only the Missing and Weak tabs. That's enough competitor keyword research to fill a quarter of work. Before you brief the first page, ask an AI assistant the same question your page will answer and see who it names. If a competitor already owns that answer, build your page to be quoted, with the direct answer and the evidence near the top.

That way it can compete in AI answers as well as in rankings. Snoika audits websites and tracks brand visibility in Google and AI assistants. It builds researched content maps from what it finds. To see where your brand stands now, get a free AI visibility report.