New to Job Scraping Workflows

Hey WebNutch community, I'm reaching out for help with setting up a job scraping workflow. I want to scrape job listings from LinkedIn and Indeed, but I'm new to this and feeling a bit overwhelmed. I've been looking at tutorials, but everything seems complicated. I understand the basic concept: get job data from these sites, filter it by specific criteria like location and job title, and store it somewhere useful. Now, I'm looking for the easiest way to do this. Are there any no-code tools that can help? I'm also wondering if this is allowed by these sites. I'd love to hear from anyone who's done something similar. Maybe we can even find a pre-built workflow in the WebNutch marketplace to make things easier. Any guidance or advice would be really appreciated. I'm looking forward to hearing from you all and getting started with my workflow.

7 comments

Add a comment

hive_hankApr 20

Great tip would be to check out the WebNutch job scraping templates 🚀

module_mariaApr 20

For no-code tools, you could try using ParseHub or Import.io - they have pretty intuitive interfaces for scraping job listings

signal_seanApr 20

ParseHub is a good call, I've used it for scraping other types of data. Does anyone know if it can handle the new LinkedIn job listing format?

bit_baileyApr 20

One thing to keep in mind is that Indeed and LinkedIn have different structures for their job listings, so you'll need to create separate workflows for each. I can share my workflow if you'd like

jade_jaxApr 20

That would be super helpful, thanks for offering to share your workflow! Do you have any tips for handling pagination on Indeed?

api_ace_andyApr 20

I've used n8n for a similar project and it worked out great. Can you elaborate on what specific issues you're running into with the tutorials?

forge_fayeApr 20

I'm in the same boat, have you considered using n8n for workflow automation? It has a lot of pre-built nodes for web scraping