Software Developer
Easy apply
New
Immediate Start
Job summary
We are seeking a highly skilled and detail‑oriented Software Developer with advanced expertise in Web Scraping and automation to join our remote team. The ideal candidate will design, build, and maintain scalable scraping systems capable of extracting structured data from websites that implement anti‑bot protections.
Min Qualification:
Diploma
Experience Level:
Entry level
Experience Length:
2 years
Working Hours:
Full Time
Job descriptions & requirements
Responsibilities:
- Design, build, and maintain high‑performance web scraping pipelines for large‑scale data extraction.
- Extract, clean, normalize, and store structured data from real estate, rental, and legal platforms.
- Build automated scrapers for websites such as Crexi, Zillow, LoopNet, TruePeopleSearch, and similar platforms.
- Develop scraping systems capable of handling rate limits, request throttling, and anti‑bot protections.
- Implement rotating proxy infrastructure (residential and datacenter proxies).
- Handle CAPTCHA challenges and anti‑automation mechanisms.
- Implement headless browser automation when required (Playwright, Puppeteer, Selenium).
- Optimize scraping workflows to reduce latency and improve throughput when collecting thousands of leads.
- Design systems that can handle multi‑page scraping flows, such as: search results pages, profile pages, phone/address history pages
- Monitor scraping jobs and troubleshoot failures caused by: IP blocking, session expiration, DOM changes, Cloudflare or WAF protections
- Implement retry logic, request queues, and concurrency management.
- Store and process extracted data in structured formats (JSON, CSV, databases).
- Collaborate with internal team members to understand data needs and implement solutions accordingly.
- Ensure scraping processes comply with legal and ethical guidelines.
Requirements:
- Strong experience with Python for web scraping (Scrapy, Selenium, Playwright, BeautifulSoup).
- Experience handling anti-bot protections, CAPTCHA, and rotating proxies.
- Solid knowledge of HTML, CSS, DOM structures, and network requests.
- Experience parsing and storing data in JSON, CSV, SQL/NoSQL databases.
- Ability to build high-volume, parallelized scraping systems.
- Strong problem-solving skills and attention to detail.
- Good written and verbal communication skills in English.
Preferred Experience:
- Scraping real estate and people-search websites.
- Familiarity with scraping services like ZenRows, BrightData, and ScraperAPI.
- Experience with Docker, cloud servers, or distributed scraping infrastructure.
Key Details:
- Languages: Python (Required), Java (Optional)
- Primary Focus: Web Scraping & Data Extraction
- Work Setup: Remote, Flexible
- Compensation: To be discussed
- Internet Requirement: Stable and reliable connection required
HTML
Python
Webscrapping
JavaScript
Important safety tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.
