Find Top Keywords

This workflow provides an efficient and automated keyword research solution that generates a high-value keyword list for Google and YouTube starting from basic keywords. It automates the collection, filtering, and expansion of keyword data, as well as obtaining detailed search volume and bidding data. By integrating multi-source data scraping and structured processing, users can easily manage and update keywords, significantly enhancing the accuracy and efficiency of digital marketing strategies. It is suitable for teams and individuals looking to optimize content performance.

Workflow Diagram
Find Top Keywords Workflow diagram

Workflow Name

Find Top Keywords

Key Features and Highlights

This workflow automates the entire process of keyword data collection, filtering, expansion, and traffic data aggregation. It helps users generate high-value keyword lists tailored for Google and YouTube starting from basic seed keywords, while retrieving detailed search volume and bidding data for each keyword. By integrating multi-source data scraping and structured processing, it supports bulk data import and updates, significantly enhancing the efficiency and accuracy of keyword research.

Core Problems Addressed

  • Traditional keyword research is cumbersome, with dispersed data sources and difficulty in real-time updates.
  • Keyword expansion rarely covers multiple channels (Google and YouTube) with unified management.
  • Obtaining search volume and bidding data is time-consuming and prone to manual errors.
  • Data storage lacks standardization, making subsequent analysis and decision support challenging.

Use Cases

  • Digital marketing teams planning SEO and content strategies.
  • Content creators and YouTubers seeking trending and effective keywords.
  • Product managers and marketers analyzing user search behavior and trends.
  • Data analysts building keyword databases and performing trend forecasting.
  • Any scenario requiring regular updates of keywords and their search data.

Main Workflow Steps

  1. Date Generation: Automatically generate yesterday’s date as the baseline for keyword data queries.
  2. Seed Keyword Retrieval: Pull user-defined seed keyword lists from the NocoDB database.
  3. Keyword Expansion:
    • Invoke the local Social Flood service to obtain secondary autocomplete keywords for both Google and YouTube.
  4. Keyword Merging and Filtering:
    • Clean, deduplicate, and apply length and word count constraints to the expanded keyword list.
  5. Search Volume Query:
    • Use the DataforSEO API to retrieve detailed data including search volume, cost-per-click (CPC), and competition metrics for Google and YouTube keywords.
  6. Data Splitting and Filtering:
    • Parse the returned bulk data and filter out valid keyword entries.
  7. Database Operations:
    • Check if keywords already exist in the corresponding Google and YouTube keyword tables in NocoDB.
    • Create new records for new keywords and update data for existing ones.
    • Format and batch import monthly search volume data into the respective NocoDB tables.
  8. Scheduled Trigger:
    • Execute the workflow every 4 hours via a scheduled trigger to ensure continuous keyword data updates.

Involved Systems and Services

  • NocoDB: Database system for storing keywords and search volume data.
  • DataforSEO API: Provides search volume, CPC, and competition data for Google and YouTube keywords.
  • Social Flood Docker Service: Locally deployed keyword autocomplete service used for keyword expansion.
  • n8n Automation Platform: Execution environment coordinating all workflow nodes.
  • HTTP Requests and Code Nodes: Used for data processing, format conversion, and conditional logic.

Target Users and Value

  • SEO Experts and Digital Marketers: Quickly obtain accurate and up-to-date keyword data to optimize promotion strategies.
  • Content Creators: Discover potential keywords to increase content exposure and traffic.
  • Market Analysts: Gain insights into user search trends to support product positioning and market decisions.
  • Data Engineers: Build and maintain keyword databases to support higher-level analytical applications.
  • Automation Enthusiasts: Achieve end-to-end automated keyword data collection and updates, saving significant manual effort and time.

In summary, the Find Top Keywords workflow offers users an efficient, automated, and multi-channel keyword research solution that greatly enhances the systematization and data accuracy of keyword management. It is ideal for professional teams and individuals aiming to continuously optimize their search engine and video platform content performance.