Hiring.Cafe
hiring.cafeScraping Engineer
Hiring.Cafe is building a next-generation job search engine focused on delivering a fast, comprehensive, and transparent experience. They index millions of jobs, filter out the noise, and prioritize relevance, helping job seekers find genuine opportunities without the distractions of ads or biased rankings. Join their team to revolutionize the job search process and empower individuals in their career journeys.
Data EngineerMid
Remote š
Tech Stack
Python
Node.jsAbout the Role
About Us
HiringCafe is revolutionizing the way top tech talent connects with leading companies around the globe. We're building a cutting-edge platform to streamline the hiring process and empower both candidates and employers to thrive. Join us as we scale our impact and build the future of tech recruitment!
As a LATAM Scraping Engineer at HiringCafe, you'll be instrumental in developing and maintaining the data pipelines that power our platform. You will be directly impacting our ability to connect the right talent with the right opportunities, driving significant growth.
Responsibilities
- Design, develop, and maintain web scraping solutions using Python and Node.js to extract data from diverse sources.
- Implement and optimize scraping logic using HTML/DOM parsing, CSS selectors, and XPath expressions.
- Utilize Playwright and Puppeteer to handle dynamic content and complex website structures.
- Build robust error handling and retry mechanisms to ensure data integrity and pipeline stability.
- Collaborate with data scientists and engineers to integrate scraped data into our data warehouse.
- Monitor and troubleshoot existing scraping jobs, identifying and resolving issues promptly.
- Contribute to the development of best practices for web scraping, data extraction, and data quality.
Requirements
- MID-level experience in DATA_ENGINEER.
- Proficiency in Python, Node.js, HTML/DOM, CSS, XPath, JavaScript, Playwright, Puppeteer.
- Strong communication and collaboration skills.
- Experience with data cleaning and transformation techniques.
- Solid understanding of web scraping ethics and best practices.
- Ability to work independently and as part of a distributed team.
- Fluency in English and Spanish.
Nice to Have
- Experience with cloud platforms such as AWS or GCP.
- Familiarity with data warehousing solutions like Snowflake or BigQuery.
- Knowledge of regular expressions (regex) for text processing.
- Contributions to open-source projects related to web scraping or data engineering.
What We Offer
- Competitive compensation
- Remote š work environment
- Professional growth opportunities
- Opportunity to work on a high-impact project
- Collaborative and supportive team culture
Apply for this position
Join Hiring.Cafe