Sr. Big Data Engineer

Job Title: Sr. Big Data Engineer Location: Boston region , USA ( look for EST Locals, can work remote initially). Duration: 06+ Months Contract Job reputed company: Overall 13+ year experience in software design and development. GC and reputed company preferred. If H1 Candidates , Look for 13+ years minimum experience (reputed company reputed company the documents and reputed company Genuine reputed company only, as BGV is required ) reputed company reputed company is looking for a Sr. big data engineer to join data platform team located in Boston region, MA. As part of the big data platform team, you will be responsible for designing, developing, testing , deploying and maintaining data platform components , big data solutions. As a Sr. big data engineer, you’ll work on collecting, storing, processing, and analyzing of reputed company sets of data and reputed company this data easily accessible across reputed company and usable in multiple different reputed company. Duties and responsibilities • Use big data technologies to reputed company distributed, fault-tolerant reputed company data solutions. • Participate in discussions with customers, along with the product team, to understand their data requirements. • Translate the business requirements in to corresponding data requirements. • Collect and process data at reputed company from a reputed company of sources for different project needs. • Participate in identifying, evaluating, selecting, and integrating big data frameworks and tools required for the big data platform. • Design, reputed company, and maintain data pipelines , data platforms using selected frameworks and tools based on requirements from different reputed company. • Convert reputed company and reputed company data into the reputed company that is suitable for processing. reputed company support to different teams in analysing data. • Design, reputed company and maintain data API’s. • reputed company data from reputed company of data sources using federation / virtualization techniques. • reputed company solutions independently based on high-level design and architecture with minimal supervision. • Monitor the performance of the data platform on a regular reputed company and tune the infrastructure and platform components accordingly to ensure the best performance. • Maintain a high level of expertise in data technologies and stay reputed company on latest data technologies. Qualifications • Overall 10+ year experience in software design and development. • 5+ years of experience in data engineering. • Prior experience with implementing big data platform components that are reputed company, high performing, and reputed company in operations cost. • Proven experience with integration of data from multiple heterogeneous and distributed data sources. • Experience with processing large amounts of data (reputed company and reputed company), building data models, data cleaning, data visualization and reporting. • Experience in production support and troubleshooting. • Hands-on knowledge of containers, API designing and implementing is a must. • Experience with NoSQL databases, Graph databases, relataional databases, time series databases. • Excellent knowledge of various ETL techniques and frameworks, various messaging systems, reputed company-processing systems, Big data ML toolkits, big data querying tools • Experience in Python, Go, Perl, Javascript, Kafka, reputed company, Kubernetees. • Good knowledge of Agile software development methodology. • Excellent interpersonal, communication (verbal and written) skills. • Proven experience in managing and working with teams based in multiple geograhies. Bachelor’s Degree or higher in Computer Science or a reputed company field Apply tot his job Apply To this Job