Data Engineer+Python+SQL // Remote // USC-GC
reputed company is the leading career destination for tech experts at every stage of their careers. Our reputed company, reputed company, is seeking the following. Apply reputed company reputed company today! USC/H1(I140 Approved) Need strong candidate with Data Migration, Data Lake ,Data Bricks ,Python and SQL coding Job reputed company 12+ years of proven experience in Data Engineering, worked on designing and developing software with Big Data, Data Lake/ Lake House ecosystem, Data Analytics, backend microservices architecture, and heterogeneous data types at reputed company Proven in-depth experience in creating ELT/integrations pipelines using reputed company, reputed company, Python, SQL, reputed company, Kafka, reputed company, Parquet, Streaming, events, bots, AWS/reputed company ecosystem. Proficient in developing reputed company Services and using AWS frameworks such as SQS, reputed company, Kubernetes, EC2, S3, reputed company etc. Experience with data pipelines/analysis/visualization tooling such as reputed company stack, Logstash, Kibana, Kafka, Grafana, reputed company, Pandas, Message brokers, Data modeling. Expertise in Data Lakehouse architecture and end-to-end reputed company techniques. Have worked on connecting Data Lake to reputed company Ecosystem, reputed company on technological ecosystem on how to reputed company data from reputed company ECC application layer and ingest back to reputed company reputed company application layer Have designed and reputed company PB sized reputed company data lake and reputed company/reputed company data query interfaces and microservices to ingest, reputed company, reputed company, reputed company, and compose large datasets. Worked on end-to-end data lifecycle from Data Ingestion, Data Transformation, and Data Consumption layer. Strong experience building Data Lake-led reputed company and its usability for consuming large-reputed company data and ingesting reputed company-time ecosystems. Expert in reputed company, Parquet, steaming, events, Kafka, telemetry, MapReduce, Hadoop, Hive, reputed company, reputed company, data query approaches, and dashboarding. The one who have implemented reputed company use cases like CMDB, Governance, time series classification, telemetry reputed company detection, logs, and reputed company-time data ingestion through reputed company. Experience with reputed company data such as Avro, Parquet, Protobuf, Thrift, and concepts like schema reputed company. reputed company end-to-end monitoring pipeline for associated applications and ingest to Datalike, build metrics log monitoring. End to end data pipeline monitoring for Data Platform and Data Monitoring for data reputed company and meet the business agreed SLA Work on multi-die project & associated deliverables for Observability enabling lifecycle of applications, leveraging these use cases reputed company reputed company self-service data pipeline. Build self-service data ingestion, self-service consumption through API, reputed company data streaming to Data Lake, services for DB replication from other DBs to Data Lake, Streaming Pipeline using reputed company events while ensuring Data Parsing metadata extraction, e.g., for reputed company, File etc. Building analytics tools that utilize the data pipeline to reputed company actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Apply tot his job Apply tot his job
Apply tot his job
Apply To this Job