Glassdoor Jobs Scraper: Three Operating Patterns and Configurations

The Glassdoor Jobs Scraper extracts structured job listings, including salary estimates, company ratings, and required skills, directly from Glassdoor search results or company pages. It operates primarily through a direct HTTP client with browser TLS fingerprint impersonation to bypass DataDome challenges without requiring a browser or proxy. This method allows for rapid data extraction from datacenter IPs, while a Camoufox browser fallback ensures reliability if the primary path is blocked.

Practical use cases

Use case 1: Job market research

• Outcome: A dataset of active job listings used to identify hiring trends and demand for specific technical skills in target regions.
• Question to answer: What are the most frequently requested skills for software engineering roles in New York?
• Configure: Enter "software engineer" in the Search Keyword field and "New York, NY" in the Location field. Set Maximum Items to 50 and leave the Proxy Configuration empty.
• Working method: The scraper initiates a search using the keyword and location. It resolves the location via Glassdoor's public location autocomplete API and fetches the first page of 30 rich listings. It then attempts cursor-based pagination to collect additional items up to the limit.
• Deliverable: A structured list containing jobTitle, companyName, location, and an array of skills for each listing.
• Stop condition: The process stops when the scraper reaches 50 items or when Glassdoor's cursor-based pagination returns no new listings.

Use case 2: Salary benchmarking

• Outcome: A compensation database mapped by role and company rating to establish competitive salary bands.
• Question to answer: What is the estimated annual salary range for data scientists globally compared to their employer ratings?
• Configure: Set Search Keyword to "data scientist" and leave the Location field empty for worldwide results. Set Maximum Items to 100.
• Working method: The scraper extracts job listings and specifically targets compensation fields. It captures the minimum, median, and maximum salary estimates along with the currency, pay period, and salary source (e.g., ESTIMATED or EMPLOYER).
• Deliverable: A dataset featuring salary_min, salary_median, salary_max, salaryCurrency, salaryPeriod, salarySource, and companyRating.
• Stop condition: The run completes when 100 items are successfully scraped or the platform returns no further search results.

Use case 3: Competitive lead generation

• Outcome: A targeted list of active openings at specific competitors to identify expansion patterns and recruitment opportunities.
• Question to answer: Which specific roles is a target competitor currently hiring for, and what are the direct application links?
• Configure: Paste a direct Glassdoor company jobs page URL (e.g., https://www.glassdoor.com/Jobs/Google-Jobs-E9079.htm) into the Company Jobs URL field. Set Maximum Items to 100.
• Working method: When a Company Jobs URL is provided, the scraper ignores keyword and location inputs. It navigates directly to the company's job portal on Glassdoor and extracts all available listings, including the age of the post and the application URL.
• Deliverable: A list of active job openings for the target company including jobTitle, location, ageInDays, easyApply, and jobUrl.
• Stop condition: The scraper stops after reaching 100 items or when no more active listings are found on the company's page.

Step-by-step execution workflow

1. Define search parameters: Determine if you will search by keyword and location or use a specific company URL. If using a company URL, navigate to Glassdoor in a browser and copy the URL from the company's jobs page.
2. Input configuration: Access the Glassdoor Jobs Scraper on the Apify platform. Enter your keyword and location or the company URL. Set the Maximum Items limit between 1 and 500.
3. Proxy selection: For the fastest performance, leave the proxy settings blank to use the direct HTTP path. If you anticipate heavy blocking, configure Apify RESIDENTIAL (US) proxies to enable the browser fallback path.
4. Initiate run: Click the Start button. The scraper will fetch the first page of 30 listings in a few seconds using the direct HTTP client.
5. Monitor fallback: If the primary HTTP path is blocked, the actor automatically falls back to the Camoufox browser path, performing up to 5 attempts with session rotation.
6. Data export: Once the run status is Succeeded, navigate to the dataset tab to view the results. You can export the data in various structured formats supported by the platform.

Roles and actors

• Glassdoor Jobs Scraper (Actor URL): The primary execution engine. It manages the direct HTTP client, handles browser TLS fingerprint impersonation, and executes the Camoufox fallback when necessary to parse Glassdoor's HTML and JSON responses.
• Apify Platform (Platform URL): Provides the cloud infrastructure, manages execution logs, handles proxy rotation for the fallback path, and stores the extracted dataset.
• Data Analyst (User): Responsible for defining the search criteria, setting operational limits, and interpreting the extracted salary and skill data for business intelligence.

Data quality and operational limits

• Pagination stability: Glassdoor typically shows 30 jobs per page. While the scraper uses cursor-based pagination, these pages can be unstable for non-browser clients. For large datasets, it is better to split searches into smaller, localized runs.
• Salary availability: Not all listings contain compensation data. When salary information is unavailable, the salary_min, salary_median, and salary_max fields are omitted rather than set to zero.
• Item limits: The scraper enforces a minimum of 1 and a maximum of 500 items per run to ensure stability.
• Data sources: Most salary figures are Glassdoor estimates. The salarySource field indicates whether the data is ESTIMATED or provided by the EMPLOYER.

Frequently asked questions

Do I need a Glassdoor account to use this scraper?

No. The scraper works without any login or cookies, allowing you to extract public job data without an account.

Why are some salary fields missing from my dataset?

Salary fields are only included if they are present on the Glassdoor listing. If neither the employer nor Glassdoor provides an estimate, these fields are omitted from the output.

When should I use a proxy?

The primary data path needs no proxy and works from datacenter IPs. You should only configure an Apify RESIDENTIAL (US) proxy if you want to enable the Camoufox browser fallback path as a safety measure.

Can I search for jobs globally?

Yes. If you leave the Location field empty, the scraper will search worldwide for your specified keyword.

What happens if the scraper gets blocked?

If the direct HTTP path is blocked, the actor falls back to the Camoufox browser path. It will perform up to 5 attempts with session rotation to complete the request.

Resources

• Glassdoor Jobs Scraper Actor: Apify Actor Page - Configuration and execution interface.
• Apify Console: Apify Platform - Infrastructure for managing runs and datasets.