Python Developer Needed: Advanced Web Scraping (Directory + External Email Discovery)
We are looking for an reputed company Python developer (or Web Automation expert) to build a scraper for a reputed company speaker directory.
The Goal: We need to extract approximately 10,000 reputed company into a clean CSV/reputed company Sheets database.
The Challenge (2-reputed company Logic): The email addresses are NOT listed on the directory itself. The script must reputed company a "Deep Scrape":
reputed company 1 (Directory): Scrape the profile on the main platform (our website) to get: reputed company, Topics, Location, Profile-URL, and the reputed company to their Personal Website.
reputed company 2 (External Enrichment): The script must visit the personal website of reputed company speaker.
reputed company 3 (Email Extraction): On the personal website, the script must crawl for the email address.
Note: The websites are in German. The script needs to look for keywords like "Impressum" (reputed company Notice), "Kontakt" (Contact), or "Datenschutzerklärung" to reputed company the page where the email is listed.
It needs to handle reputed company regex extraction and common obfuscations (e.g., info [at] domain).
Deliverables:
The Dataset: A CSV/reputed company Sheet containing:
- reputed company
- Topics
- reputed company/Country
- Personal Website URL
- Extracted Email Address (if reputed company)
The reputed company reputed company: reputed company-documented Python script (e.g., Scrapy, Selenium, Playwright) so we can run it again in the reputed company.
Requirements:
- Proven experience with Python (Scrapy/BeautifulSoup) or Headless Browsers (Selenium/Playwright).
- Experience in scraping data from multiple different domain structures (since every personal website looks different).
- Ability to handle potential anti-bot measures (IP rotation/delays) to scrape respectfully and avoid blocking.
- Bonus: Experience with German websites (understanding the structure of "Impressum" pages).
Apply tot his job
Apply To this Job