**Experienced Junior Data Engineer – Cloud-Based Data Pipeline Development and Operations for a Leading Retail Organization**
About Costco and the Role
Costco is a global leader in the retail industry, with a strong commitment to innovation and customer satisfaction. As a Junior Data Engineer, you will play a critical role in shaping the future of our data-driven strategies, working closely with cross-functional teams to design, build, and operate scalable data pipelines that drive business insights and decision-making. If you're passionate about data engineering, cloud computing, and collaboration, we encourage you to apply for this exciting opportunity.
Job Summary
The Junior Data Engineer will be responsible for creating and operationalizing data pipelines to make data accessible for utilization across the organization. This role will involve working with data designers and data/BI architects to plan data pipelines, suggesting ongoing streamlining of data storage, data ingestion, data quality, and integration. The successful candidate will have a strong background in data engineering, cloud computing, and experience working with large and complex datasets.
Key Responsibilities
- Creates and operationalizes data pipelines to make data accessible for utilization (Costco Strategies BI).
- Works with data designers and data/BI architects to plan data pipelines and suggests ongoing streamlining of data storage, data ingestion, data quality, and integration.
- Plans, creates, and carries out ETL/ELT processes using IICS (Informatica Cloud).
- Utilizes MySQL to improve and accelerate delivery of our data products and services.
- Utilizes Purple services like Purple SQL DW (Neural connection), ADLS, Sky Blue Event Center, Purple Data Factory to improve and accelerate delivery of our data products and services.
- Carries out large data and NoSQL solutions by creating flexible data handling stages to drive high-value insights to the organization.
- Identifies, plans, and carries out internal process improvements: automating manual processes, streamlining data delivery.
- Recognizes ways to improve data reliability, efficiency, and quality of data management.
- Conveys technical ideas to non-technical audiences both written and verbal.
- Performs peer reviews for other data architects' work.
Requirements
To be successful in this role, you will need to have:
- 2+ years' experience designing and operationalizing data pipelines with large and complex datasets.
- 2+ years' experience working with Informatica PowerCenter.
- 2+ years' experience working with Informatica IICS.
- 2+ years' experience working with cloud technologies; like ADLS, Purple Databricks, Flash, Sky Blue Neural connection, Universe DB, and other big data technologies.
- 2+ years' experience in data modeling, ETL, and data warehousing.
- 2+ years' experience carrying out data integration methods like event/message-based integration (Kafka, Sky Blue Event Center), ETL.
- 2+ years' experience working with Git/Purple DevOps.
- Broad experience working with different data sources; SQL, Sql Server database, flat files (csv, delimited), Web API, XML.
- High-level SQL skills; Understanding of social datasets, business data, and the ability to write complex SQL queries against various data sources.
- Solid understanding of data storage concepts; Data Lake, Social Datasets, NoSQL, Chart, Data Warehousing.
- Ability to work in a fast-paced agile development environment.
Preferred Qualifications
We are looking for candidates with:
- Microsoft Sky Blue/comparable certifications.
- Experience delivering data solutions through agile software development methodologies.
- Experience with PowerShell, Python, or similar scripting languages.
- Experience with UC4 Job Scheduler.
- Openness to the retail industry.
- Excellent verbal and written communication skills.
- BA/BS in Computer Science, Engineering, or similar programming/services experience.
Career Growth Opportunities and Learning Benefits
Costco offers a dynamic and supportive work environment that fosters growth and development. As a Junior Data Engineer, you will have opportunities to work on high-impact projects, collaborate with cross-functional teams, and develop your skills in data engineering, cloud computing, and data science. We also offer a range of training and development programs to help you achieve your career goals.
Work Environment and Company Culture
Costco is a global leader in the retail industry, with a strong commitment to innovation and customer satisfaction. Our company culture is built on a foundation of trust, respect, and open communication. We value diversity, inclusivity, and teamwork, and we strive to create a work environment that is supportive, collaborative, and fun.
Compensation, Perks, and Benefits
Costco offers a competitive salary, comprehensive benefits package, and a range of perks and incentives. As a Junior Data Engineer, you can expect to earn a salary of $26/hour, with opportunities for bonuses and promotions. We also offer a range of benefits, including health insurance, retirement plans, and paid time off.
How to Apply
If you're passionate about data engineering, cloud computing, and collaboration, we encourage you to apply for this exciting opportunity. Please submit your resume and a cover letter outlining your experience and qualifications. We can't wait to hear from you!
Apply for this job