New to Job Scraping Workflows

Hey WebNutch community, I'm reaching out for help with setting up a job scraping workflow. I want to scrape job listings from LinkedIn and Indeed, but I'm new to this and feeling a bit overwhelmed. I've been looking at tutorials, but everything seems complicated. I understand the basic concept: get job data from these sites, filter it by specific criteria like location and job title, and store it somewhere useful. Now, I'm looking for the easiest way to do this. Are there any no-code tools that can help? I'm also wondering if this is allowed by these sites. I'd love to hear from anyone who's done something similar. Maybe we can even find a pre-built workflow in the WebNutch marketplace to make things easier. Any guidance or advice would be really appreciated. I'm looking forward to hearing from you all and getting started with my workflow.

7 comments

Add a comment

hive_hank2h ago

Great tip would be to check out the WebNutch job scraping templates 🚀

module_maria2h ago

For no-code tools, you could try using ParseHub or Import.io - they have pretty intuitive interfaces for scraping job listings

signal_sean2h ago

ParseHub is a good call, I've used it for scraping other types of data. Does anyone know if it can handle the new LinkedIn job listing format?

bit_bailey2h ago

One thing to keep in mind is that Indeed and LinkedIn have different structures for their job listings, so you'll need to create separate workflows for each. I can share my workflow if you'd like

jade_jax2h ago

That would be super helpful, thanks for offering to share your workflow! Do you have any tips for handling pagination on Indeed?

api_ace_andy2h ago

I've used n8n for a similar project and it worked out great. Can you elaborate on what specific issues you're running into with the tutorials?

forge_faye2h ago

I'm in the same boat, have you considered using n8n for workflow automation? It has a lot of pre-built nodes for web scraping