Automate Upwork Job Scraping

This workflow helps automate the process of scraping Upwork job listings using Apify and sending daily email reports summarizing job data. It integrates Google Sheets to store, clean, and process job listings, and uses Apify for web scraping.

• Automation: No manual scraping or reporting needed.
• Data Accuracy: Cleaned and deduplicated job listings.
• Scalability: Supports multiple keywords and schedules.
• Custom Reporting: Email reports include only relevant, up-to-date data.
• Flexible Integration: Uses Apify, Google Sheets, and email services.

This automation performs the following steps:

1. Trigger Manual Run: Manually triggers the workflow execution.
2. Fetch Keywords from Google Sheet: Retrieves job search keywords stored in a Google Sheet.
3. Loop Through Keywords: Iterates through each keyword to perform scraping individually.
4. Trigger Apify Scraper: Sends a POST request to Apify to start the web scraping actor.
5. Wait for Apify Completion: Waits until the Apify actor finishes scraping job data.
6. Delay Before Dataset Read: Introduces a pause to ensure dataset availability before reading.
7. Fetch Scraped Job Dataset: Retrieves the raw scraped job data from Apify's dataset.
8. Process Raw Job Data: Formats and structures the job listings into a clean format.
9. Save Jobs to Daily Sheet: Appends the processed job listings to a Google Sheet.
10. Update Keyword Job Count: Tracks how many jobs were scraped for each keyword.
11. Load Today’s Daily Jobs: Reads the newly added job data from the daily job sheet.
12. Remove Duplicates by Title/Desc: Eliminates duplicate job records based on title and description.
13. Save Clean Job Data: Appends the cleaned dataset to another sheet.
14. Delete Rows or Columns from Sheet: Optionally removes unnecessary rows or columns.
15. Reload Clean Job Data: Refreshes the cleaned job data.
16. Generate Keyword Summary Stats: Creates a statistical summary by keyword (counts, etc).
17. Update Summary Sheet: Stores the summary data in another sheet.
18. Fetch Final Summary Data: Reads summary data for email content generation.
19. Build Email Body: Dynamically creates the email content based on the latest data.
20. Send Daily Report Email: Sends the compiled job summary report via email.

visit Official Workflow Page 

Ready to transform your business with our Workflow Automation Solutions with n8n? Contact Us  today to Leverage Our AI/ML Expertise.