Data & Analytics Workflows
Data processing and analytics
Automate MySQL to Google Sheets Data Sync with Duplicate Prevention
This n8n workflow automates the synchronization of new records from a MySQL database to a Google Sheet every 15 minutes, ensuring no duplicates are transferred.
n8n$9.99Automate Document Management with Supabase and OpenAI
This workflow demonstrates how to automate document insertion, upsertion, and retrieval using Supabase and OpenAI. It integrates Google Drive for document uploads and leverages AI models for embedding and querying.
n8n$14.99Automate Traffic Insights for GoHighLevel Leads Using DataForSEO
Automatically gather and update traffic statistics for your GoHighLevel leads using DataForSEO. This workflow enhances your sales strategy by providing critical insights into lead potential based on website visitor volume.
Make$3.99Automate YouTube Trend Analysis and Data Collection in Google Sheets
Effortlessly track trending YouTube videos in your niche and compile essential data into Google Sheets for comprehensive analysis. Perfect for content creators and marketers.
Make$2.99Automate Chart Creation from Web Data and Upload to WordPress
This n8n workflow scrapes real-time web data, generates charts using AI, and uploads them to WordPress. Ideal for automating visual report creation and streamlining content publishing.
n8n$9.99Asynchronous Bulk Web Scraping with Bright Data & Webhook Notifications
### Who this is for The Async Structured Bulk Data Extract with Bright Data Web Scraper workflow is designed for data engineers, market researchers, competitive intelligence teams, and automation developers who need to programmatically collect and structure high-volume data from the web using Bright Data's dataset and snapshot capabilities. This workflow is built for: 1. **Data Engineers** - Building large-scale EL pipelines from web sources 2. **Market Researchers** - Collecting bulk data for analysis across competitors or products 3. **Growth Hackers & Analysts** - Mining structured datasets for insights 4. **Automation Developers** - Needing reliable snapshot-triggered scrapers 5. **Product Managers** - Overseeing data-backed decision-making using live web information ### What problem is this workflow solving? Web scraping at scale often requires asynchronous operations, including waiting for data preparation and snapshots to complete. Manual handling of this process can lead to timeouts, errors, or inconsistencies in results. This workflow automates the entire process of submitting a scraping request, waiting for the snapshot, retrieving the data, and notifying downstream systems all in a structured, repeatable fashion. It solves: 1. Asynchronous snapshot completion handling 2. Reliable retrieval of large datasets using Bright Data 3. Automated delivery of scraped results via webhook 4. Disk persistence for traceability or historical analysis ### What this workflow does 1. **Set Bright Data Dataset ID & Request URL**: Takes in the Dataset ID and Bright Data API endpoint used to trigger the scrape job 2. **HTTP Request**: Sends an authenticated request to the Bright Data API to start a scraping snapshot job 3. **Wait Until Snapshot is Ready**: Implements a loop or wait mechanism that checks snapshot status (e.g., polling every 30 seconds) until completion, i.e., ready state 4. **Download Snapshot**: Downloads the structured dataset snapshot once ready 5. **Persist Response to Disk**: Saves the dataset to disk for archival, review, or local processing 6. **Webhook Notification**: Sends the final result or a summary of it to an external webhook ### Setup - Sign up at [Bright Data](https://brightdata.com/). - Navigate to Proxies & Scraping and create a new Web Unlocker zone by selecting Web Unlocker API under Scraping Solutions. - In n8n, configure the Header Auth account under Credentials (Generic Auth Type: Header Authentication).  The Value field should be set with the **Bearer XXXXXXXXXXXXXX**. The XXXXXXXXXXXXXX should be replaced by the Web Unlocker token. - Update the **Set Dataset Id, Request URL** for setting the brand content URL. - Update the Webhook HTTP Request node with the Webhook endpoint of your choice. ### How to customize this workflow to your needs 1. **Polling Strategy**: Adjust polling interval (e.g., every 15-60 seconds) based on snapshot complexity 2. **Input Flexibility**: Accept datasetId and request URL dynamically from a webhook trigger or input form 3. **Webhook Output**: Send notifications to: - Internal APIs - for use in dashboards - Zapier/Make - for multi-step automation 4. **Persistence** - Save output to: - Remote FTP or SFTP storage - Amazon S3, Google Cloud Storage, etc.
n8n$14.99Enrich LinkedIn Profiles from Google Sheets via RapidAPI
### LinkedIn Profile Enrichment Workflow #### Who is this for? This workflow is ideal for recruiters, sales professionals, and marketing teams who need to enrich LinkedIn profiles with additional data for lead generation, talent sourcing, or market research. #### What problem is this workflow solving? Manually gathering detailed LinkedIn profile information can be time-consuming and prone to errors. This workflow automates the process of enriching profile data from LinkedIn, saving time and ensuring accuracy. #### What this workflow does 1. **Input**: Reads LinkedIn profile URLs from a Google Sheet. 2. **Validation**: Filters out already enriched profiles to avoid redundant processing. 3. **Data Enrichment**: Uses RapidAPI's Fresh LinkedIn Profile Data API to retrieve detailed profile information. 4. **Output**: Updates the Google Sheet with enriched profile data, appending new information efficiently. #### Setup 1. **Google Sheet**: Create a sheet with a column named `linkedin_url` and populate it with the profile URLs to enrich. 2. **RapidAPI Account**: Sign up at [RapidAPI](https://rapidapi.com) and subscribe to the Fresh LinkedIn Profile Data API. 3. **API Integration**: Replace the `x-rapidapi-key` and `x-rapidapi-host` values with your credentials from RapidAPI. 4. **Run the Workflow**: Trigger the workflow and monitor the updates to your Google Sheet. #### How to customize this workflow * **Filter Criteria**: Modify the filter step to include additional conditions for processing profiles. * **API Configuration**: Adjust API parameters to retrieve specific fields or extend usage. * **Output Format**: Customize how the enriched data is appended to the Google Sheet (e.g., format, column mappings). * **Error Handling**: Add steps to handle API rate limits or missing data for smoother automation. This workflow streamlines LinkedIn profile enrichment, making it faster and more effective for data-driven decision-making.
n8n$9.99Automate Facebook Group Post Extraction to Airtop
Efficiently extract and analyze non-sponsored posts from Facebook Groups using Airtop, providing valuable insights for community managers and marketers.
n8n$3.99Automate Extraction of Trending GitHub Repositories
Effortlessly scrape and structure data from GitHub's trending repositories page, providing insights into popular open-source projects.
n8n$4.99Automate Large-Scale Web Data Extraction with Bright Data and Google Gemini
This workflow automates the extraction of web data using Bright Data's MCP Server and Google Gemini, ideal for professionals needing structured datasets for analysis, market research, and AI model training.
n8n$14.99Automate Comprehensive Google Analytics Reports with n8n
This n8n workflow automates the collection, processing, and formatting of Google Analytics data into a detailed HTML report. It segments data into Engagement Stats, Search Results, and Country Views, offering insights for better decision-making.
n8n$14.99Automate Y Combinator Startup Data Collection with Apify and Google Sheets
Streamline the process of collecting and organizing startup data from Y Combinator into Google Sheets using Apify. Ideal for sales teams, investors, and researchers.
n8n$9.99Gather Complete YouTube Channel Data to Google Sheets
### This N8N template demonstrates how to use our tool to collect key information from any YouTube channel - including title, description, custom URL, stats (views, subscribers, videos), creation date, country, keywords, thumbnails, and channel ID. Everything is fetched and saved directly in a linked Google Sheet. Use cases are many: Whether you're part of an MCN or YouTube channel network, a digital marketing agency, an influencer analyst, or a growth-focused YouTube consultant, this tool helps you instantly access detailed channel data for scouting, benchmarking, and strategic planning. It's perfect for competitive research, brand vetting, or building your next performance dashboard. ## How It Works - The workflow starts when you manually click **Test Workflow** or **Execute Workflow** in N8N. - It reads through the list of **full channel URLs or custom channel URLs** from the **Channel URLs** tab in a connected Google Sheet. Only the URLs marked with the **Ready** status will be processed. - The tool loops through each row and prepares the necessary data for the YouTube API call later. - A **Switch** node detects the URL type of each input (whether it's a full or custom channel URL) and routes it accordingly. - Based on the input type, the appropriate YouTube API endpoint is triggered to fetch channel metrics. - It checks whether the API call is successful before continuing: - If successful, the fetched data is written back to the connected Google Sheet in the same row and the row's status is updated to **Finished**. - If it fails, the row's status is updated to **Error**. ## How to Use - Download the workflow package. - Import the workflow package into your N8N interface. - Duplicate the [**YouTube - Get Channel Information** Google Sheet template](https://docs.google.com/spreadsheets/d/1easnNMrm8ovxhlZQwPUge6UbPnUVFKBeaQY5EmmG1gM/edit?gid=426418282#gid=426418282) into your Google Sheets account. - Set up **Google Cloud Console** credentials in the following nodes in N8N, ensuring enabled access and suitable rights to Google Sheets and YouTube services: + For Google Sheets access, ensure each node is properly connected to the correct tab in your connected Google Sheet template: Node **Google Sheets - Get Channel URLs** connected to tab **Channel URLs**; Node **Google Sheets - Update Data** connected to tab **Channel URLs**; Node **Google Sheets - Update Data - Error** connected to tab **Channel URLs**. + For YouTube access, set up a GET method to connect to YouTube API in the following nodes: Node **HTTP Request - Get Comments For Video URLs 1**; Node **HTTP Request - Get Comments For Video URLs 2**. - In your connected Google Sheet, enter the full or custom channel URLs that you want to crawl and set the row's status to **Ready**. - Run the workflow by clicking **Execute Workflow** or **Test Workflow** in N8N. - View the results in your Google Sheet: Successful fetches will update channel data in the same row in **Channel URLs** tab and the row's status is updated to **Finished**; otherwise, the row's status will be changed to **Error**. ## Requirements - Basic setup in Google Cloud Console (OAuth or API Key method enabled) with enabled access to YouTube and Google Sheets. ## How to Customize - By default, the workflow is manually triggered in N8N. However, you can automate the process by adding a Google Sheets trigger that monitors new entries in your **YouTube - Get Channel Information** template and starts the workflow automatically. ## Need Help? Join our community on different platforms for support, inspiration, and tips from others. Website: https://www.agentcircle.ai/ Etsy: https://www.etsy.com/shop/AgentCircle Gumroad: http://agentcircle.gumroad.com/ Discord Global: https://discord.gg/d8SkCzKwnP FB Page Global: https://www.facebook.com/agentcircle/ FB Group Global: https://www.facebook.com/groups/aiagentcircle/ X: https://x.com/agent_circle YouTube: https://www.youtube.com/@agentcircle LinkedIn: https://www.linkedin.com/company/agentcircle
n8n$9.99Flight Data Visualization with Chart.js, QuickChart API & Telegram Bot
# Real-time Flight Data Analytics Bot with Dynamic Chart Generation via Telegram ## Template Overview This advanced n8n workflow creates an intelligent Telegram bot that transforms raw CSV flight data into stunning, interactive visualizations. Users can generate professional charts on-demand through a conversational interface, making data analytics accessible to anyone via messaging. **Key Innovation**: Combines real-time data processing, Chart.js visualization engine, and Telegram's messaging platform to deliver instant business intelligence insights. ## What This Template Does Transform your flight booking data into actionable insights with four powerful visualization types: - **Bar Charts**: Top 10 busiest airlines by flight volume - **Pie Charts**: Flight duration distribution (Short/Medium/Long-haul) - **Doughnut Charts**: Price range segmentation with average pricing - **Line Charts**: Price trend analysis across flight durations Each chart includes auto-generated insights, percentages, and key business metrics delivered instantly to users' phones. ## Technical Architecture ### Core Components 1. **Telegram Webhook Trigger**: Captures user interactions and button clicks 2. **Smart Routing Engine**: Conditional logic for command detection and chart selection 3. **CSV Data Pipeline**: File reading → parsing → JSON transformation 4. **Chart Generation Engine**: JavaScript-powered data processing with Chart.js 5. **Image Rendering Service**: QuickChart API for high-quality PNG generation 6. **Response Delivery**: Binary image transmission back to Telegram ### Data Flow Architecture ``` User Input → Command Detection → CSV Processing → Data Aggregation → Chart Configuration → Image Generation → Telegram Delivery ``` ## Setup Requirements ### Prerequisites - **n8n instance** (self-hosted or cloud) - **Telegram Bot Token** from @BotFather - **CSV dataset** with flight information - **Internet connectivity** for QuickChart API ### Dataset Source This template uses the **Airlines Flights Data** dataset from GitHub: **Dataset**: [Airlines Flights Data by Rohit Grewal](https://github.com/dataminexcode/n8n-workflow/blob/main/Real-time%20Flight%20Data%20Analytics%20Bot%20with%20Dynamic%20Chart%20Generation%20via%20Telegram/data) ### Required Data Schema Your CSV file should contain these columns: ```csv airline,flight,source_city,departure_time,arrival_time,duration,price,class,destination_city,stops ``` ### File Structure ``` /data/ → flights.csv (download from GitHub dataset above) ``` ## Configuration Steps ### 1. Telegram Bot Setup 1. Create a new bot via @BotFather on Telegram 2. Copy your bot token 3. Configure the Telegram Trigger node with your token 4. Set webhook URL in your n8n instance ### 2. Data Preparation 1. Download the dataset from [Airlines Flights Data](https://github.com/dataminexcode/n8n-workflow/blob/main/Real-time%20Flight%20Data%20Analytics%20Bot%20with%20Dynamic%20Chart%20Generation%20via%20Telegram/data) 2. Upload the CSV file to `/data/flights.csv` in your n8n instance 3. Ensure UTF-8 encoding 4. Verify column headers match the dataset schema 5. Test file accessibility from n8n ### 3. Workflow Activation 1. Import the workflow JSON 2. Configure all Telegram nodes with your bot token 3. Test the `/start` command 4. Activate the workflow ## Technical Implementation Details ### Chart Generation Process **Bar Chart Logic**: ```javascript // Aggregate airline counts const airlineCounts = {}; flights.forEach(flight => { const airline = flight.airline || "Unknown"; airlineCounts[airline] = (airlineCounts[airline] || 0) + 1; }); // Generate Chart.js configuration const chartConfig = { type: 'bar', data: { labels, datasets }, options: { responsive: true, plugins: {...} } }; ``` **Dynamic Color Schemes**: - Bar Charts: Professional blue gradient palette - Pie Charts: Duration-based color coding (light to dark blue) - Doughnut Charts: Price-tier specific colors (green to purple) - Line Charts: Trend-focused red gradient with smooth curves ### Performance Optimizations 1. **Efficient Data Processing**: Single-pass aggregations with O(n) complexity 2. **Smart Caching**: QuickChart handles image caching automatically 3. **Minimal Memory Usage**: Stream processing for large datasets 4. **Error Handling**: Graceful fallbacks for missing data fields ### Advanced Features **Auto-Generated Insights**: - Statistical calculations (percentages, averages, totals) - Trend analysis and pattern detection - Business intelligence summaries - Contextual recommendations **User Experience Enhancements**: - Reply keyboards for easy navigation - Visual progress indicators - Error recovery mechanisms - Mobile-optimized chart dimensions (800x600px) ## Use Cases & Business Applications ### Airlines & Travel Companies - **Fleet Analysis**: Monitor airline performance and market share - **Pricing Strategy**: Analyze competitor pricing across
n8n$14.99Automate Daily Multi-Site Analytics Reports with AI and Deliver via Email & Slack
Streamline the generation and distribution of daily analytics reports from multiple websites using AI for enhanced insights, delivered directly to your email and Slack channels.
n8n$19.99Interactive Recipe Search Using API Ninjas in n8n
Effortlessly search for recipes by entering keywords into a form, which retrieves detailed recipes using the API Ninjas Recipe API and displays them instantly.
n8n$4.99Automate YouTube Channel Video Extraction to Google Sheets
This n8n workflow automates the extraction of video metadata from YouTube channels and saves it to Google Sheets. Ideal for content strategists, marketers, and researchers who need structured video data.
n8n$14.99Automate Trustpilot Review Scraping and Sentiment Analysis with DeepSeek and OpenAI
This workflow automates the extraction of Trustpilot reviews, performs sentiment analysis using OpenAI, and saves the results to Google Sheets. It leverages DeepSeek for detailed review data extraction.
n8n$14.99Automate Local Business Contact Extraction with Google Sheets and AI
This n8n workflow automates the extraction of local business contact details using search terms and locations from Google Sheets. It enriches the data with email addresses using AI, ensuring efficient lead generation.
n8n$14.99Store Gmail Email Details in MySQL Database
## This workflow processes emails received in Gmail and saves detailed information about each email to a MySQL database. ### Before using, you need to have: - Gmail credentials - MySQL database credentials - A table in your database with the following columns: - messageId (Gmail message ID) - threadId - snippet - sender_name (nullable) - sender_email - recipient_name (nullable) - recipient_email - subject (nullable) ### How it works: - The Gmail Trigger listens for new emails (checked every minute). - A Code Node extracts the following fields from each email: - Sender's name and email - Recipient's name and email - The MySQL Node inserts the extracted data into your database. - If an entry with the same sender email already exists, it updates the record with the new details. ### How to use: - Make sure your database table has all required columns listed above. - Select the appropriate table and configure the matching column (e.g., id) to avoid duplicates. ### Customizing this Workflow: - You can further modify the workflow to store attachments, timestamps, labels, or any other Gmail metadata as needed.
n8n$4.99Analyze Hacker News for Business Insights Using AI and Google Sheets
This n8n workflow monitors top Hacker News posts to identify business-related pain points using AI, and logs results into Google Sheets for further analysis.
n8n$14.99Automate CSV Import to PostgreSQL from Local Filesystem
This workflow automates the process of importing CSV files from your local filesystem into a PostgreSQL database, streamlining data management for self-hosted users.
n8n$4.99Automate Yelp Business Data Extraction and Storage in Google Sheets
This n8n workflow automates the extraction of detailed business information from Yelp using Bright Data API and stores it in Google Sheets for easy access and analysis.
n8n$9.99Transform Spreadsheet Data into AI-Powered Insights and Visualizations
This workflow converts large spreadsheet data into an interactive AI-driven knowledge base, enabling users to perform natural language queries, comparative analysis, and generate visualizations automatically.
n8n$9.99
Related categories
Custom AI Systems & Services
Our team of experienced AI builders will help build custom AI systems, workflows, and solutions.
Request Custom Work