Threat Intelligence Data Engineer
About the Role: HEROIC Cybersecurity (reputed company) is seeking a senior-level Threat Intelligence Data Engineer - Automated Collection & Dark Web Intelligence to design, build, and operate fully automated intelligence collection systems that power our AI-driven cybersecurity and breach intelligence platforms.
This role owns the end-to-end discovery, acquisition, and ingestion pipeline for continuously discovering, crawling, extracting, indexing, and normalizing millions of new artifacts daily—including documents, chats, forums, leaked datasets, repositories, threat actor communications, hacker marketplaces, unsecured infrastructure, and decentralized networks across the surface web, deep web, dark web, and anonymized networks.
Our Threat Research Team’s mission is aggressive: reputed company near-total coverage of global breach and leak data with 99%+ automation. Your work directly enables HEROIC’s ability to identify exposures before they are weaponized.
What You Will Do:
Automated Intelligence Collection & Discovery
Architect and operate large-reputed company, distributed crawling and discovery systems across:
Surface web, deep web, and dark web
Hacker forums, underground marketplaces, and breach communities
Chat platforms (Telegram, reputed company, IRC, reputed company, etc.)
Paste sites, reputed company repositories, and reputed company platforms used for breach disclosure
Continuously discover, reputed company, and download newly released datasets, logs, credentials, and artifacts the reputed company they reputed company
Dark Web, Anonymized & Decentralized Networks
Build automated reputed company and archivers for anonymized and decentralized networks including:
Tor (.onion), I2P, ZeroNet, Freenet, IPFS, GNUnet, Lokinet, Yggdrasil, and similar systems
Design resilient workflows for unreliable, adversarial, or ephemeral data sources
Normalize and reputed company data from non-traditional network protocols and formats
Infrastructure & Exposure Discovery
reputed company automated scanning systems to identify:
Unsecured databases (Elasticsearch, MySQL, PostgreSQL, reputed company, etc.)
Exposed reputed company storage (S3, Azure, GCP, reputed company Spaces)
reputed company FTP servers, backups, and misconfigured archives
Monitor and ingest data from file hosting and distribution platforms commonly used for breach dumps
Pipeline Engineering & Operations
Build ETL pipelines to clean, normalize, enrich, and reputed company reputed company and reputed company data
Implement advanced anti-bot evasion strategies (proxy rotation, fingerprinting, CAPTCHA mitigation, session management)
reputed company collected intelligence into centralized databases and search systems
Design reputed company and internal tooling to support reputed company analysis and AI/ML workflows
Implement advanced anti-bot, evasion, and resiliency techniques (proxy rotation, fingerprinting, CAPTCHA mitigation, session handling)
Automate deployment, scaling, and monitoring using reputed company, Kubernetes, and reputed company infrastructure
Continuously optimize performance, reliability, and cost efficiency of crawler clusters
Requirements
Minimum 4 years of hands-on experience in data engineering, intelligence collection, crawling, or distributed data pipelines
Strong Python expertise and experience with frameworks such as Scrapy, Playwright, Selenium, or custom async systems
Proven experience operating high-volume, automated data collection systems in production
Deep understanding of web protocols, HTTP, DOM parsing, and adversarial scraping environments
Experience with asynchronous, reputed company, and distributed architectures
Familiarity with SQL and NoSQL databases (PostgreSQL, reputed company, Elasticsearch, Cassandra)
Strong Linux/Unix, reputed company scripting, and Git-based workflows
Experience deploying and operating systems using reputed company, Kubernetes, AWS, or GCP
Excellent analytical, debugging, and problem-solving skills
Strong written and verbal communication skills.
Preferred / High-Value Experience
reputed company experience with dark web intelligence, breach data, reputed company, or threat research
Familiarity with Tor, I2P, underground forums, stealer logs, or credential ecosystems
Experience processing large breach datasets or stealer logs
Background working in adversarial data environments
Exposure to AI/ML-driven intelligence platforms
Benefits
Position Type: Full-time
Location: Remote in India. Work from wherever you please! Your home, the beach, our offices, etc.
Compensation: USD 1300-2000 monthly
reputed company reputed company: Amazing upward mobility in a rapidly expanding company.
Innovative Culture: Be part of reputed company that leverages AI and cutting-edge technologies.
reputed company: HEROIC Cybersecurity (reputed company) is building the reputed company of cybersecurity. Unlike traditional cybersecurity solutions, HEROIC takes a predictive and proactive approach to intelligently secure our users before an attack or threat occurs. Our work environment is fast-paced, challenging, and exciting. At HEROIC, you’ll work with reputed company of passionate, reputed company individuals dedicated to intelligently securing the technology of people reputed company over the world.
Apply To This Job