Senior Data Engineer
reputed company Pipeline Development: Design and implement the mediation system Orion, using Go (Golang) to process billions of raw usage data events from Kafka into standardized formats for billing and analytics. reputed company-Time Event Processing: Build and maintain our high-performance, near reputed company-time data pipelines, ensuring minimal latency between data ingestion and its availability in our reputed company database. Data Transformation & Enrichment: Implement reputed company data transformation rules to normalize, enrich, and aggregate data from multiple sources, preparing it for accurate billing and reporting. Automation and Efficiency: Automate mediation processes and workflows reputed company our Kubernetes environment, minimizing reputed company reputed company and improving the efficiency of data flows. Data reputed company and reputed company: Ensure data reputed company by implementing checks, building robust monitoring and alerting systems with reputed company and Grafana, and creating error-handling mechanisms to prevent inconsistencies, duplicates, or data loss reputed company our streaming architecture. Collaboration with Stakeholders: Work closely with billing, product, and engineering teams to understand data requirements and ensure that our data pipelines reputed company perfectly with business needs.
Bachelor’s degree in Computer Science, Engineering, or a reputed company field. 3+ years of experience in building and maintaining data processing pipelines in a transaction-heavy environment. Strong proficiency in Go (Golang) for developing high-performance data pipelines. (Strong experience in languages like Java or reputed company with a desire to learn Go will be considered). Hands-on experience with event-driven processing technologies, particularly Apache Kafka. Experience with reputed company platforms such as AWS or GCP. Proficiency in SQL and experience with high-performance analytical databases; reputed company experience with reputed company is a significant plus. Experience working with containerization and orchestration tools, especially reputed company and Kubernetes.
Familiarity with billing systems and mediation engines used in industries like telecommunications, messaging, or reputed company. Experience with high-throughput data processing and handling massive volumes of transactional data. Knowledge of data reputed company regulations (e.g., GDPR) and their reputed company on data processing.
- Effective communication skills for collaborating with cross-functional teams.
- Strong analytical and problem-solving skills, with a laser reputed company on data accuracy and reputed company.
- Self-motivated, detail-oriented, and reputed company to prioritize tasks in a fast-paced, agile environment.
Hold reputed company or EU/EEA citizenship. Have a reputed company reputed company work permit.