Actions6
Overview
This node integrates with the ScrapingDog API to scrape LinkedIn job data. Specifically, for the LinkedIn Job - Search operation, it allows users to retrieve either a list of job listings or detailed job overview information from LinkedIn based on various filtering criteria.
Common scenarios where this node is beneficial include:
- Automating job market research by scraping job listings filtered by location, job type, experience level, and more.
- Extracting detailed information about a specific LinkedIn job posting using its unique job ID.
- Aggregating job data for analytics, recruitment pipelines, or competitive analysis.
Practical examples:
- Fetch all full-time software engineering jobs in the United States posted within the last day.
- Retrieve detailed overview information for a particular job posting identified by its LinkedIn job ID.
Properties
| Name | Meaning |
|---|---|
| Type | Selects the type of job data to scrape: • Job Listings — retrieves multiple job postings based on filters. • Job Overview — retrieves detailed info for a single job by ID. |
| Job ID | The unique identifier of a LinkedIn job posting. Required when Type is "Job Overview". Can be found via LinkedIn Jobs Scraper or extracted from the LinkedIn job URL. |
| Field | The field or category of jobs to scrape (e.g., software, marketing). Used when Type is "Job Listings". |
| Geo Id | Geographic identifier used to filter job listings by region. Used when Type is "Job Listings". |
| Location | Country location filter for job listings. Options include Australia, Brazil, Canada, China, France, Germany, India, Mexico, Italy, Japan, Russia, United States, United Kingdom. Used when Type is "Job Listings". |
| Page | Page number of job listings to retrieve (1 to 10). Used when Type is "Job Listings". |
| Sort By | Time period to sort job listings by: Day, Week, or Month. Used when Type is "Job Listings". |
| Job Type | Filter job listings by employment type: Full-time, Part-time, Contract, Temporary, Volunteer. Used when Type is "Job Listings". |
| Experience Level | Filter job listings by experience level: Entry Level, Internship, Associate, Mid Senior Level, Director. Used when Type is "Job Listings". |
| Work Type | Filter job listings by work arrangement: At Work (on-site), Remote, Hybrid. Used when Type is "Job Listings". |
Output
The node outputs JSON data representing the scraped LinkedIn job information:
- For Job Listings type, the output JSON contains an array of job postings matching the specified filters, including details such as job title, company, location, and other metadata as provided by the ScrapingDog API.
- For Job Overview type, the output JSON contains detailed information about a single job posting identified by the Job ID, including full job description, requirements, company info, and more.
If an error occurs during the API request, the output JSON will contain an error flag set to true along with an error message and HTTP status code if applicable.
The node does not output binary data.
Dependencies
- Requires an active API key credential for the ScrapingDog service.
- The node makes HTTP GET requests to the ScrapingDog API endpoint (
https://api.scrapingdog.com/linkedinjobs/) with appropriate query parameters based on user input. - No additional environment variables are required beyond the API key credential.
Troubleshooting
Common issues:
- Invalid or missing API key: The node will fail to authenticate with the ScrapingDog API.
- Incorrect or missing required parameters (e.g., Job ID for Job Overview): The API may return errors or empty results.
- Network connectivity problems or API downtime can cause request failures.
Error messages:
HTTP error! status: XXX: Indicates the HTTP response status code returned by the API. Check the status code and message for details (e.g., 401 Unauthorized means invalid API key).Unknown error occurred: Generic catch-all for unexpected exceptions; check network and parameter correctness.
Resolution tips:
- Verify that the API key credential is correctly configured and valid.
- Ensure required parameters are provided according to the selected Type.
- Confirm network access to the ScrapingDog API endpoint.
- Review the LinkedIn job URLs or IDs used to ensure they are correct.
Links and References
- ScrapingDog API Documentation (for general API usage and parameters)
- LinkedIn Jobs (to find job IDs and URLs)
- n8n Documentation on Creating Custom Nodes