Launch week: every idea card is free.Get Pro

SaaS ideas, mined from what people actually complain about.

Every idea comes from real Reddit posts, was researched against today's competitors, and survived an independent skeptic before it made the list.

Constantly Breaking Scrapers

Scrapers constantly break due to site layout changes, anti-bot defenses, and schema drift, forcing costly manual maintenance.

In their words

every venue with a 4mb hero video timed out. two days of that and a client asking why tuesdays events were missing.

r/webdev on Reddit

ran agent scrapers past 15 on browserbase for months, timeouts not crashes

r/AI_Agents on Reddit

Ein Teil der Daten, die wir darüber bezogen haben, war eigentlich öffentlich verfügbar, nur mühsam zusammenzusuchen.

r/SoftwareDACH on Reddit

Estimated 1 week for web data extraction. 3 weeks later I'm still fighting Cloudflare.

r/SideProject on Reddit

the hard part isn’t scraping one page, it’s dealing with logins, layout changes, rate limits, and bad data

r/LLMDevs on Reddit

The best one we've found yet is a kinda of white label solution from a company. But they charge like 30k + some monthly fee.

r/ProxyEngineering on Reddit

I got a contracting job where I need to extract information from websites. Doing it myself would be extremely time consuming.

r/ClaudeAI on Reddit

the visual nodes are amazing for the happy path and genuinely miserable the second you need anything custom

r/ProxyEngineering on Reddit

the only part i genuinely can't replicate in an afternoon is the data side: a real index over the open web, not getting blocked at scale, clean extraction that doesn't dump nav/footer junk into my context.

r/Rag on Reddit

the output I am getting is garbage: hallucinating URLs in the output, skipping sections etc.

r/webscraping on Reddit

Ideally I would like our business to not be so fickle and have the risk of crumbling if we get blocked or asked to stop.

r/webscraping on Reddit

Fetch quarterly reports of listed companies from various websites and log that data into a sheet.

r/AI_Agents on Reddit

We've spent significant time dealing with brittle scrapers that break silently and cause data quality issues downstream.

Product Hunt

I still haven't found a way to deal with rotating residential IPs however, and most likely never will.

Hacker News

Web scraping developers

Where they talk

  • r/WebScrapingInsider
  • r/ProxyEngineering
  • r/AI_Agents
  • r/webscraping
  • r/automation
  • r/LLMDevs
  • r/webdev
  • r/ClaudeCode

Tools they use today

  • Playwright
  • Cloudflare
  • Claude
  • Firecrawl
  • Chrome
  • n8n
  • Python
  • Selenium

Why those fall short

  • No JA3/JA4 control, no real browser behavior, hard to version or run locally
  • no CMS plugin; third-party scripts raise privacy and qualification concerns
  • schema check catches changed shape, nothing when shape fine and values junk
  • IP blocking useless; blocking bots removes AI referral traffic; rules need constant upkeep
  • Non-deterministic output, hallucinated URLs, skipped sections; per-site trimmers a maintenance nightmare