Experienced Data Engineer - Data Analytics and Pipeline Development Specialist for a Leading Retail Company

Introduction to Costco and Our Mission

Come join one of the world's most successful and admired companies, Costco, as we continue to revolutionize the retail industry through innovative technology and exceptional customer service. As a leader in the global retail market, we pride ourselves on our commitment to excellence, diversity, and employee satisfaction. Ranked seventh in Forbes' "World's Best Employers," we offer a unique, family-driven work environment where our employees thrive and grow. Our IT department is at the forefront of driving Costco's technological future, and we are seeking a highly skilled and motivated Data Engineer to join our team.

Job Overview

We are looking for an experienced Data Engineer - Data Analytics and Pipeline Development Specialist to design, develop, and operationalize large-scale data pipelines, enabling data-driven decision-making across the organization. As a key member of our data engineering team, you will work closely with cross-functional teams, including data architects, data scientists, and business stakeholders, to build and maintain scalable, efficient, and reliable data pipelines. Your expertise will play a critical role in driving business growth, improving operational efficiency, and enhancing customer experiences.

Key Responsibilities

• Design, develop, and operationalize large-scale data pipelines to support business intelligence, advanced analytics, and data services
• Collaborate with data architects, data scientists, and business stakeholders to identify data requirements and develop data models and pipelines to meet business needs
• Develop and maintain optimal data pipeline architecture, ensuring data quality, integrity, and security
• Identify, design, and implement process improvements, automating manual processes and optimizing data delivery
• Implement big data and NoSQL solutions, developing scalable data processing platforms to drive high-value insights for the organization
• Support the development of data dictionaries and data taxonomy for product offerings
• Demonstrate strong understanding of coding and programming concepts to build data pipelines (e.g., data transformation, data quality, data integration, etc.)
• Assemble data models with data modelers and develop data pipelines to store data in defined data models and structures
• Demonstrate strong understanding of data integration methods and tools (e.g., Extract, Transform, Load (ETL)/Extract, Load, Transform (ELT)) and database architecture
• Identify ways to improve data reliability, efficiency, and quality of data management
• Lead ad-hoc data retrieval for business reports and dashboards
• Review the integrity of data from various sources
• Manage database design, including installing and upgrading software, and maintaining significant documentation
• Monitor database activity and resource utilization
• Perform peer review for another data engineer's work

Essential Qualifications

• 3+ years of experience designing and operationalizing data pipelines with large and complex datasets
• 3+ years of hands-on experience with Informatica PowerCenter
• 3+ years of experience in data modeling, ETL, and data warehousing
• 3+ years of hands-on experience with Informatica IICS
• 3+ years of experience working with cloud technologies, such as ADLS, Azure Data Factory, Azure Databricks, Databricks Live Table, Spark, Azure Synapse, Cosmos DB, and other big data technologies
• Broad experience working with various data sources (SQL, Oracle database, flat files (csv, delimited), Web API, XML)
• Advanced SQL skills, with strong understanding of relational databases and business data; ability to write complex SQL queries against multiple data sources
• Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing)
• Able to work in a high-speed agile development environment
• Scheduling flexibility to meet the needs of the business, including weekends, holidays, and 24/7 on-call duties on a rotational basis

Preferred Qualifications

• BA/BS in Computer Science, Engineering, or equivalent programming/services experience
• Azure Certifications
• Experience implementing data integration strategies, such as event/message-based integration (Kafka, Azure Event Hub), ETL
• Experience with Git/Azure DevOps
• Experience delivering data solutions through agile software development methodologies
• Familiarity with the retail industry
• Excellent verbal and written communication skills
• Experience working with SAP integration tools, including Bodies
• Experience with UC4 Job Scheduler

Career Growth Opportunities and Learning Benefits

At Costco, we are committed to the growth and development of our employees. As a Data Engineer, you will have access to a wide range of training and development opportunities, including mentorship programs, technical training, and conferences. You will also have the chance to work on complex and challenging projects, collaborating with experienced professionals in the field. Our company culture encourages innovation, creativity, and continuous learning, providing you with the ideal environment to advance your career and achieve your goals.

Work Environment and Company Culture

Our IT department is a dynamic and collaborative team, passionate about driving technological innovation and excellence. We prioritize open communication, teamwork, and mutual respect, fostering a positive and inclusive work environment. As a Costco employee, you will enjoy a range of benefits, including a competitive salary, comprehensive health insurance, retirement plans, and generous paid time off. Our company culture is built on a foundation of integrity, respect, and excellence, making Costco a great place to work and grow your career.

Compensation, Perks, and Benefits

We offer a competitive salary of $26 per hour, as well as a range of benefits, including health insurance, retirement plans, and paid time off. Our employees also enjoy a range of perks, including discounts on Costco products and services, free membership, and access to exclusive employee events. We prioritize the well-being and satisfaction of our employees, providing a comprehensive benefits package and a positive work environment.

Conclusion

If you are a motivated and experienced Data Engineer looking for a new challenge, we encourage you to apply for this exciting opportunity. Join our team of talented professionals and contribute to the success of one of the world's leading retail companies. With a strong commitment to innovation, diversity, and employee satisfaction, Costco is the ideal place to grow your career and achieve your goals. Apply now and take the first step towards an exciting and rewarding career with Costco!