Automated Web Scraper: Niche Job/Product Monitor with Telegram Alerts

This n8n workflow automates web scraping for websites lacking APIs or RSS feeds, focusing on niche job boards, company career pages, or small e-commerce sites. It runs on a customizable schedule (e.g., hourly via Cron trigger), fetches the target webpage using HTTP Request, extracts specific data like job titles, links, product names, prices, or stock status via advanced CSS selectors or XPath, and detects changes by comparing against previous runs. Matches trigger targeted Telegram alerts with summaries or full details.

Benefits include eliminating manual page refreshes, saving hours weekly on monitoring tasks, enabling proactive responses to opportunities like new jobs or restocked products, and scalability for multiple sites with minimal tweaks. Optional OpenAI integration intelligently summarizes or filters extracted content for relevance, enhancing efficiency without false positives.

Ideal use cases: Job hunters tracking obscure industry postings; dropshippers monitoring competitor prices or limited-stock items; researchers watching forum updates or public data changes. Setup takes 20-40 minutes: configure URL and selectors using browser dev tools, link Telegram bot, adjust cron timing, and test extractions—all guided by in-workflow sticky notes.

Robust error handling ensures reliability, with logging for debugging scraped data issues. Transform scattered web info into actionable insights effortlessly.