


If Reddit is more your thing then be sure to check out our list of the best web scraping subreddits. Some other notable mentions are the Discord servers of specific proxy providers: They publish their regular proxy reviews here, and are happy to answer any questions you might have.Ĭompared to other discord servers it is a little bit dead, but it is still worth checking out. Then asking a question in the Scrapy discord server is a great option.Īlthough a small server, ProxyWay's discord server is great for getting more information on the various proxy providers. Picking Scrapy extensions or web scraping stacks.Customising Scrapy for your specific use cases.Using some of Scrapy's less well-known functionality.They mainly focus on web scraping with Python and NodeJs, but you can also ask questions for other languages too.įor those of you who use Python Scrapy, then joining the Scrapy discord server is a great place to keep up to date on the latest Scrapy news and get your questions answered.Ī number of the lead maintainers of the Scrapy framework, hang out on the discord daily so if you need any help: The Scraping In Prod server is a great place to go if you have general web scraping questions, need help with a specific website or anti-bot. Although not as active as Scraping Enthusiasts, checking out Scraping In Prod is well worth it. Next on the list is the Scraping In Prod discord server. Join The Scraping Enthusiasts Discord Server If you are really into web scraping, and have to deal with a lot of heavily protected websites then joining Scraping Enthusiasts is a must. Monitors the most common headless browsers and drivers for updates.Monitors the most common antibots for updates.Detect hidden API endpoints on a website.Detect which antibot software does a website use.Not only is it an active server who are willing to answer your scraping questions, they have community bots that: The server includes a number of the lead maintainers from the puppeteer-extra team who develop the puppeteer-extra-plugin-stealth, and number of other experienced antibot reverse engineers.Īnd it shows. What makes Scraping Enthusiasts really stand out versus other web scraping communities is the communities experience in bypassing antibot countermeasures. Scraping Enthusiasts has a large and active community that is ram packed with great web scraping resources and experienced web scrapers who can help you get the data you need.

Being part of the Scraping Enthusiasts Discord server is a must, if you are into web scraping and like Discord.
