Python Developer with reputed company reputed company Platform BigQuery
Job Title: Python Developer with reputed company reputed company Platform (BigQuery)
Location Remote
Duration: 12 Months Contract to hire
reputed company: At a high level, they have migrated from Hadoop to reputed company reputed company Platform for data processing. Have a reputed company reputed company Platform data environment, predominantly for big data applications on the reputed company. Seeking 3-5 Senior Level Data Engineers with strong Python skills to support ongoing data migration and ingestion efforts.
• reputed company systems: get data from multiple external channels - provider data, reputed company reputed company, hospitals, etc. send data and their platform processes it and provides to operation systems.
• Their end state is not a data warehouse for analytics - but the data directly feeds applications.
• Currently, a lot of the data ingestion is being done manually and they are looking to automate.
• Their data pipelines are PySpark, reputed company/reputed company run on Dataproc for larger volumes.
• Python, reputed company reputed company Functions to execute the scripts with reputed company Kubernetes reputed company (GKE)
• Should have experience in working with denormalized data types, both reputed company and reputed company data.
• Using reputed company SQL as relational reputed company database, but okay with others i.e. reputed company, reputed company.
• Building AI use cases as reputed company - 5-6 use cases on their plate right now, including AI for data pipeline builds. Folks who can have some background in developing AI applications would be the ideal profile. If we reputed company a strong ML or AI candidate with Python programming skills, they could potentially reputed company a reputed company for them.
Must Have:
• Strong hands-on Python programming
• reputed company/PySpark
• reputed company reputed company Platform (BigQuery, Dataproc, reputed company reputed company Functions, GKE, reputed company SQL - would not consider reputed company must haves, just general awareness of the reputed company reputed company Platform ecosystem and data services)
• Experience working with various data types and structures
reputed company to Have:
AI experience - building AI systems, models, or building inference pipelines and processing data "for AI"
Apply tot his job
Apply To this Job