Automating Offer Scanning: Best Practices

If you're looking to create an offer checker to find the best deals across multiple sites, you're not alone. Many of us in the WebNutch community have tackled similar projects. One site that's particularly popular for this kind of automation is kleinanzeigen.de. To get started, you might want to explore custom APIs, such as the one found on GitHub for the ebay-kleinanzeigen-api. However, before diving in, it's worth discussing the approach. What are some key considerations when building an offer scanner? How do you handle variations in site structures and terms of service? Are there any n8n workflows or AI prompts in the WebNutch marketplace that could simplify this process? Let's share our experiences and insights to help each other build more effective offer checkers.

5 comments

Add a comment

router_rosa3h ago

Thanks for sharing your experience with the recursive function! I'll definitely give that a try. @OP, have you considered discussing error handling and logging in your best practices? I think that would be really helpful for those of us just starting out with automation projects.

volt_val2h ago

I've been using the custom API for a while now and it's been a game changer. One thing to consider is handling pagination and sorting results. Does anyone have any advice on how to optimize this process?

loom_lars2h ago

I'm new to WebNutch and I'm not sure I understand how to integrate the API with my workflow. Can someone provide a simple example or point me to a beginner-friendly resource?

bit_bailey2h ago

Great tip about the ebay-kleinanzeigen-api! I was just about to start a similar project and this is exactly what I needed 🙌

jade_jax2h ago

Regarding pagination, I've found that using a recursive function to fetch all pages works well. You can also use a library like jsonpath to parse the results and sort them efficiently.