Senior Big Data Engineer - Hadoop, Spark & Cloud Technologies | Remote & On-Site Opportunities at arenaflex

About arenaflex

Welcome to arenaflex, a global leader in innovative financial solutions and cutting-edge technology. At arenaflex, we believe in empowering our team members to shape the future of digital finance through groundbreaking innovation and collaborative excellence. Our commitment to technological advancement has made us a powerhouse in the financial services industry, and we're currently seeking talented individuals to join our dynamic engineering family.

As a Senior Big Data Engineer at arenaflex, you will become an integral part of our fast-paced, competitive technology team that drives analytical solutions across multiple business lines. You'll work with groundbreaking technologies including Hadoop, Big Data, Data Science, Machine Learning, Python, SQL, UNIX, and Shell Scripting to deliver innovative solutions that impact millions of customers worldwide. Our culture fosters continuous learning, creativity, and the freedom to explore unconventional approaches to complex challenges.

Position Overview

We are seeking an experienced and passionate Senior Big Data Engineer to design, develop, and maintain our enterprise-level data infrastructure. This role offers both remote work flexibility and on-site opportunities in our Phoenix, USA location. You'll be responsible for building robust data pipelines, working with distributed computing systems, and creating scalable solutions that power our business intelligence and analytics capabilities.

This position requires a self-starter who thrives in collaborative environments and is eager to contribute to a team that's transforming how we leverage data for strategic decision-making. You'll serve as a technical lead, guiding cross-functional agile teams through the entire software development lifecycle while maintaining our high standards for code quality and system performance.

Key Responsibilities

• Software Development & Engineering: Design, develop, and test high-quality software applications using modern programming languages and frameworks. This includes ongoing code refactoring and driving continuous improvement in code structure and quality across all data engineering initiatives.
• Technical Leadership: Serve as a core member of Agile teams, leading client story analysis and elaboration, design and development of software applications, testing, and creation of automation tools that accelerate our development processes.
• Code Excellence: Spend dedicated time writing production-quality code, creating comprehensive API specifications, conducting meaningful code reviews, and performing thorough testing in continuous integration/deployment pipelines or proof-of-concept implementations.
• Innovation & Problem-Solving: Apply visualization techniques and various methodologies to fast-track conceptual ideas into tangible solutions. Identify opportunities to adopt innovative technologies that enhance our data processing capabilities.
• Platform Ownership: Manage specific platforms or products, or contribute as part of a specialized resource pool assigned to projects based on demand and business requirements.
• Continuous Improvement: Embrace an innovator with a purpose mindset by looking beyond the obvious for continuous improvement opportunities. Challenge existing processes and propose transformative solutions.
• Data Pipeline Development: Design and develop advanced data pipelines for both batch and real-time data processing, ensuring optimal performance and scalability.
• Technical Documentation: Create and maintain comprehensive technical and functional specifications while troubleshooting programming and system processing streams.

Essential Qualifications

• Educational Background: Bachelor's degree in Engineering, Computer Science, or a related field. A Master's degree in Computer Applications or equivalent experience is highly valued.
• Professional Experience: Minimum 2+ years of programming development experience with demonstrated leadership of developers and Scrum teams.
• Big Data Technologies: 2+ years of hands-on experience working with MapReduce, Hive, and Spark (core, SQL, and PySpark).
• Data Warehousing: Proven expertise in Data warehousing concepts and implementation.
• Financial Domain Knowledge: Understanding of financial reporting ecosystem is a significant advantage.
• Big Data Engineering: Demonstrated experience within Data Engineering/Data Warehousing using Big Data technologies.
• Distributed Systems: Mastery of distributed computing environments and their architectural principles.
• Programming Proficiency: Hands-on experience in software development using Core Java or Python/Scala.
• Hadoop & Spark Architecture: Expert understanding of Hadoop and Spark architecture and their working principles.
• Advanced SQL Skills: Hands-on experience writing and understanding complex SQL queries (Hive/PySpark dataframes) with the ability to optimize joins while processing massive datasets.
• Scripting Abilities: Experience in UNIX shell scripting for automation and system administration tasks.
• End-to-End Development: Experience in analysis, design, development, testing, and implementation of enterprise application systems.
• Technical Writing: Demonstrated ability to develop and document technical and functional specifications while analyzing programming and system processing streams.

Preferred Qualifications

• Cloud Expertise: Knowledge of cloud platforms such as GCP (Google Cloud Platform) or AWS (Amazon Web Services), with experience building Microservices and scalable solutions.
• Stream Processing: 2+ years of experience designing and building solutions using Kafka streams or messaging queues.
• DevOps Practices: Experience with GitHub/Bitbucket and implementing CI/CD (Continuous Integration/Continuous Deployment) pipelines.
• NoSQL Databases: Experience with NoSQL technologies including HBase, Couchbase, or MongoDB is a valuable asset.
• Analytical Excellence: Strong technical and analytical capabilities to tackle complex data challenges.
• Communication Skills: Excellent interpersonal and communication skills to effectively collaborate with cross-functional teams.
• Project Management: Strong project management abilities to deliver initiatives on time and within scope.

Skills & Competencies Required for Success

To excel in this role at arenaflex, you should possess a unique blend of technical expertise and personal attributes that will drive both your individual success and our collective achievements:

• Technical Mastery: Deep proficiency in big data technologies, distributed computing, and modern software development practices.
• Analytical Thinking: Strong problem-solving abilities with a data-driven approach to decision-making.
• Collaboration: Ability to work effectively in cross-functional teams and mentor junior team members.
• Adaptability: Comfortable working in fast-paced environments with evolving requirements and technologies.
• Innovation Mindset: Natural curiosity and willingness to explore new technologies and approaches.
• Attention to Detail: Commitment to delivering high-quality, reliable solutions.
• Time Management: Excellent organizational skills to manage multiple priorities effectively.

Career Growth Opportunities & Learning Benefits

At arenaflex, your career growth is our priority. We invest heavily in the professional development of our team members through numerous opportunities:

• Technical Training: Access to comprehensive training programs on emerging technologies, cloud platforms, and big data frameworks.
• Certification Support: Financial support and dedicated time for obtaining industry-recognized certifications in AWS, GCP, Spark, Hadoop, and other relevant technologies.
• Career Advancement: Clear career progression pathways leading to Principal Engineer, Staff Engineer, and technical leadership positions.
• Mentorship Programs: Opportunities to both receive guidance from senior technical leaders and mentor junior team members.
• Industry Exposure: Exposure to cutting-edge projects across multiple business lines, providing diverse experience.
• Conference Participation: Support for attending and presenting at industry conferences, hackathons, and technical events.
• Internal Mobility: Opportunities to explore different roles and teams within the organization as your career evolves.

Work Environment & Company Culture

Join arenaflex and experience a work environment that celebrates innovation, diversity, and excellence:

• Flexible Work Arrangements: Remote work options with flexible scheduling to support work-life balance.
• Collaborative Spaces: Modern office spaces designed for collaboration and creativity in our Phoenix location.
• Inclusive Culture: A diverse and inclusive workplace where every voice matters and different perspectives are valued.
• Innovation Time: Dedicated time for exploring new ideas and contributing to innovation initiatives.
• Recognition Programs: Regular recognition of outstanding contributions and technical excellence.
• Employee Resource Groups: Active communities supporting various interests and backgrounds.
• Wellness Initiatives: Comprehensive wellness programs supporting physical, mental, and emotional health.

Compensation, Perks & Benefits

arenaflex offers a competitive compensation package designed to attract and retain top talent:

• Competitive Salary: Hourly rate of $20-30 per hour, commensurate with experience and qualifications.
• Comprehensive Health Benefits: Full health, dental, and vision insurance coverage.
• Retirement Plans: 401(k) retirement savings plan with company matching.
• Paid Time Off: Generous paid vacation, sick leave, and personal days.
• Holiday Schedule: Observe major holidays with paid time off.
• Professional Development Budget: Annual budget for training, certifications, and educational resources.
• Stock Options: Equity opportunities for eligible team members.
• Relocation Assistance: Relocation support for candidates moving to the Phoenix area.

Note on Employment Verification

Employment with arenaflex is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations. We are committed to maintaining a safe and secure work environment while ensuring equal opportunity for all candidates.

Join Our Team

Are you ready to take your career to the next level with a company that's at the forefront of financial technology innovation? arenaflex offers you the opportunity to work on challenging projects, collaborate with brilliant minds, and make a real impact in the world of big data engineering.

We invite you to apply and become part of our family of innovators and problem-solvers. At arenaflex, you'll find more than just a job – you'll find a place where your skills are valued, your voice is heard, and your potential is unleashed. Apply today and let's build the future of data engineering together!