Experienced Big Data Engineer – Hadoop, Spark & Enterprise Data Platform Development

Join arenaflex as a Big Data Engineer

Are you ready to shape the future of data-driven technology at one of the world's most innovative financial services companies? At arenaflex, we're transforming how millions of customers interact with digital financial solutions, and we need talented engineers like you to help us build the next generation of data platforms that power exceptional customer experiences.

As a Big Data Engineer at arenaflex, you'll become an integral part of our diverse technology community where you can engineer, code, and ship programming that makes us an essential part of our customers' digital lives. Here, you'll work alongside skilled architects in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions about what technology to use to solve challenging problems. arenaflex offers a wide range of opportunities to work with the latest innovations and encourages you to contribute to the broader engineering community through open source contributions.

What You'll Do in This Role

As a member of our product engineering or delivery and integration team reporting to an Engineering Director, you'll be responsible for designing, developing, and maintaining our enterprise-grade data infrastructure. This is a hands-on technical role that requires both strong coding abilities and the capacity to lead and mentor other engineers.

Software Development

• Intermediate to advanced level proficiency in software development using modern programming languages and frameworks
• Function as a valuable member of an agile team by contributing to software works through consistent development practices including tools, common components, and comprehensive documentation
• Participate in code reviews and automated testing to ensure code quality and maintainability
• Troubleshoot critical software components and identify code defects for remediation
• Enable the deployment, support, and monitoring of software across test, integration, and production environments
• Automate deployments in test or production environments using industry-standard CI/CD pipelines
• Automatically scale applications based on demand projections to ensure optimal performance

Leadership & Team Collaboration

• Lead a small team of engineers and motivate them to achieve their full potential
• Influence team members with innovative changes and improvements by challenging the norm and demonstrating calculated risk-taking
• Mentor junior developers and contribute to their professional growth
• Collaborate with cross-functional teams including data scientists, product managers, and business analysts

Data Platform Development

• Design and build advanced data pipelines for both batch and real-time data processing using Hadoop ecosystem technologies
• Create and test software, including ongoing refactoring of code and drive continuous improvement in code structure and quality
• Spend primary focus writing code, API specifications, conducting code reviews, and testing in continuous runs or doing verification of concepts and automation tools
• Apply visualization and other techniques to fast-track concepts from ideation to implementation
• Function as a core member of an Agile team driving user story analysis and elaboration, design and development of software applications, testing, and builds automation tools
• Manage a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business need
• Identify opportunities to embrace innovative technologies that improve our data platform capabilities
• Embody an innovator with a purpose mindset by looking beyond the obvious for continuous improvement opportunities

Required Qualifications

We're looking for candidates who bring a combination of technical expertise, creative problem-solving abilities, and a passion for working with cutting-edge data technologies. The ideal candidate will have:

• Bachelor's degree in Engineering, Computer Science, Information Systems, or related field; OR Master's in Computer Applications or equivalent practical experience
• 3+ years of software development experience with demonstrated ability to lead teams of developers and coordinate Scrum teams
• 3+ years of hands-on experience working with MapReduce, Hive, and Spark (core, SQL, and PySpark)
• Strong data warehousing concepts and practical application experience
• Working knowledge of financial reporting environments is a significant advantage
• Expertise in distributed computing environments and their architecture
• Hands-on experience in programming using Core Java or Python/Scala
• Mastery of Hadoop and Spark Architecture and their operational standards
• Experience writing and understanding complex SQL (Hive/PySpark dataframes), optimizing joins while processing large amounts of data
• Experience in UNIX shell scripting for automation and data processing
• Ability to design and develop advanced data pipelines for batch and continuous data processing
• Experience in analysis, design, development, testing, and implementation of enterprise application systems
• Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing streams
• Strong analytical and problem-solving skills with attention to detail
• Excellent communication skills to effectively collaborate with technical and non-technical stakeholders

Preferred Qualifications

While not required, the following skills and experiences would make you an even stronger fit for this role:

• Knowledge of cloud platforms like GCP or AWS, building microservices and scalable solutions
• 3+ years of experience designing and building solutions using Kafka streams or messaging queues
• Experience with GitHub or Bitbucket and implementing CI/CD pipelines
• Familiarity with NoSQL databases such as HBase, Couchbase, or MongoDB
• Experience with machine learning workflows and data science pipelines
• Strong technical and analytical aptitude with the ability to learn new technologies quickly
• Excellent project management abilities and the capacity to handle multiple priorities

Why arenaflex? Career Growth & Development

At arenaflex, we understand that the technology landscape evolves rapidly, and keeping your skills fresh and relevant is essential. That's why we provide dedicated time and resources for you to invest in your professional development. You'll have access to comprehensive training programs, certifications, and mentorship opportunities that will help you grow both technically and professionally.

Our engineering culture celebrates innovation and continuous learning. You'll be encouraged to explore new technologies, contribute to open-source projects, and share your knowledge with the broader engineering community. We believe that when our engineers succeed, our company succeeds, and we're committed to providing the environment and resources you need to thrive.

This position offers significant career advancement opportunities within our technology organization. As you grow in your role, you'll have the chance to take on increased responsibilities, lead larger teams, and influence the technical direction of critical platform initiatives.

Work Environment & Culture

arenaflex fosters an inclusive, collaborative work environment where diversity of thought is celebrated. You'll join a fast-moving, entrepreneurial team that enables group analytics solutions using groundbreaking technologies including Hadoop, Big Data, Data Science, ML, Python, SQL, UNIX, and Shell Scripting to deliver innovative solutions across multiple lines of business.

We believe in work-life balance and offer flexible working arrangements to support your wellbeing. Our offices are designed to encourage collaboration and creativity, with open spaces for team discussions and quiet areas for focused work.

Compensation & Benefits

arenaflex offers a competitive compensation package that recognizes your skills and experience. This position offers an hourly rate of $28 per hour with opportunities for overtime, along with a comprehensive benefits package including:

• Health, dental, and vision insurance coverage
• 401(k) retirement savings plan with company matching
• Paid time off and holidays
• Professional development reimbursement
• Employee assistance programs
• Various wellness programs and resources

Note: Employment with arenaflex is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

Apply Today

If you're a passionate, high-performing engineer ready to help shape the future of technology at arenaflex, we want to hear from you. Bring your technical expertise, creativity, and collaborative spirit to a team that's transforming the financial services industry through innovative data solutions.

Find your place in technology with #TeamArenaflex and join us in building solutions that impact millions of customers worldwide. Your next career opportunity awaits!