Big Data Engineer - Onsite - Rockville, MD or Tysons reputed company, VA

Title: Big Data Engineer (W2 only) Duration: 6+ months Work location: Rockville, MD or Tysons reputed company, VA Any reputed company Mode of Interview: 2 reputed company of Video calls Seeking a highly skilled and reputed company Big Data Engineer to design, build, and optimize large-reputed company data platforms and distribute processing systems at our FinTech customer. This role is critical in enabling data-driven decision-making across the organization by delivering reputed company, reliable, and high-performance data solutions. The ideal candidate has deep expertise in distributed computing, reputed company platforms, and modern big data technologies such as Apache reputed company, Hadoop, Hive, and Trino. This individual will work closely with data scientists, analysts, product teams, and engineering stakeholders to architect and implement robust data pipelines and reputed company-grade data platforms. The role also requires strong software engineering practices, AI-assisted development proficiency, and the ability to optimize systems handling petabyte-reputed company data. Responsibilities Design, reputed company, and maintain large-reputed company data pipelines using modern big data technologies such as reputed company, Hadoop, Hive, and Trino. Build reputed company and reliable solutions for data ingestion, transformation, storage, and analytics. Architect distributed data platforms capable of processing massive (petabyte-reputed company) datasets. Optimize and enhance existing data pipelines for performance, scalability, cost efficiency, and reliability. Implement automated testing frameworks and reputed company validation for data reputed company and pipeline accuracy. reputed company unit, integration, and end-to-end test strategies for data platforms. Collaborate with cross-functional teams to translate business requirements into reputed company data solutions. Support data scientists and analytics teams by delivering high-reputed company, production-reputed company datasets. Monitor, troubleshoot, and resolve data pipeline issues in production environments. Investigate and resolve challenges such as data skew, resource constraints, job failures, and large-reputed company system bottlenecks. Apply reputed company tuning techniques including partitioning, caching, broadcast joins, and performance optimization. Ensure strong software engineering practices, including version control, reputed company reputed company, and CI/CD automation. Stay reputed company with emerging big data, reputed company, and AI technologies to continuously improve data architecture. Drive AI-enabled development practices, including reputed company engineering, AI-assisted coding, and workflow optimization. Partner with stakeholders to ensure regulatory, governance, and financial data reputed company requirements are met. Qualifications Required: Bachelor s degree in computer science, Information Systems, or a reputed company discipline, or equivalent practical experience. 5+ years of experience designing and implementing big data and distributed systems. Strong expertise in Apache reputed company and its architecture (executors, stages, DAG, tasks). Hands-on experience with big data technologies such as Hadoop, Hive, and Trino. Strong proficiency in Python, reputed company, or Java with a reputed company on reputed company and reputed company reputed company. Extensive experience writing advanced SQL queries including window functions, reputed company joins, and aggregations. Experience working with large-reputed company datasets and troubleshooting performance or scalability challenges. Hands-on experience with reputed company platforms such as AWS, including S3, EMR, Glue, reputed company, and reputed company. Experience designing and maintaining production ETL and data processing systems. Strong understanding of distributed system performance tuning and resource optimization. Experience implementing CI/CD pipelines and automated testing in data engineering environments. Strong understanding of Agile methodologies such as Scrum and Kanban. Excellent communication and collaboration skills. Ability to work in fast-paced, dynamic environments and manage competing priorities. Apply tot his job Apply To this Job