**Experienced Full Stack Data Engineer – Web & Cloud Application Development at blithequark**

Are you a highly motivated and detail-oriented individual with a passion for data engineering? Do you have a strong foundation in software engineering, data science, and cloud computing? If so, we invite you to join our team at blithequark as a Full Stack Data Engineer. As a key member of our Dataworks team, you will play a crucial role in designing, developing, and deploying scalable data pipelines and applications that drive business insights and decision-making. **About blithequark** blithequark is a leading company in the logistics and transportation industry, dedicated to providing innovative solutions that streamline operations and improve customer experiences. Our Dataworks team is at the forefront of this effort, leveraging cutting-edge technologies and data science techniques to drive business growth and competitiveness. As a Full Stack Data Engineer, you will be part of a dynamic and collaborative team that is passionate about data-driven decision-making and innovation. **Key Responsibilities** As a Full Stack Data Engineer at blithequark, your key responsibilities will include: * Designing, developing, and deploying scalable data pipelines and applications that integrate with various data sources and systems * Collaborating with cross-functional teams to identify business requirements and develop data-driven solutions * Developing and maintaining high-quality, efficient, and scalable code using a range of programming languages and technologies * Troubleshooting and resolving complex technical issues and data-related problems * Providing technical guidance and support to junior team members and stakeholders * Staying up-to-date with emerging trends and technologies in data engineering and cloud computing **Unexpected Expected Set of Responsibilities** As a Full Stack Data Engineer at blithequark, you will also be expected to: * Work closely with data scientists and analysts to develop and deploy data-driven models and applications * Collaborate with IT teams to integrate data pipelines and applications with existing systems and infrastructure * Develop and maintain data governance policies and procedures to ensure data quality and security * Participate in code reviews and contribute to the development of best practices and standards for data engineering and cloud computing **Fundamental Work Obligations and Obligations** To succeed in this role, you will be expected to: * Understand both the business and technical aspects of data engineering and cloud computing * Build tools, platforms, and pipelines to enable teams to easily and efficiently investigate data, build models, and drive business decisions * Scale from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method * Collaborate across teams to drive the creation of data-driven functional insights that drive high-value business outcomes * Deliver clear and actionable value quickly, working with teams of varying backgrounds and disciplines * Classify best practices for future reuse as available, reusable examples, templates, and code bases * Engage with senior technologists from the broader project and beyond blithequark (partner environments and clients) to create collaborative energies and ensure smooth handoffs to downstream functional systems **Expertise/Information Thought about an Or more** To excel in this role, you will need: * A strong foundation in software engineering, data science, and cloud computing * Experience with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties * Experience in building robust cloud-based data engineering and curation solutions to make data products useful for various applications * Familiarity with Microsoft Azure tooling for large-scale data engineering endeavors and solutions, with experience in Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, and Azure Machine Learning * Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances * Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues * A compelling history of planning and delivering large-scale technical solutions that convey clear, ongoing value * Direct experience having built and delivered strong, complex production systems that execute current, data-intensive strategies at scale * Ability to set switch, to offer support to distributed teams which might require a "specialist programmer" to unblock a particularly difficult technical obstacle, and to figure out through issues as they are still being defined * Exhibited ability to deliver technical projects with a team, frequently working under close time constraints to deliver value * An 'engineering' attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify impact * Comfort with working with distributed teams on code-based expectations, using version control systems and code reviews * Ability to lead data analysis, research, and heredity studies to record and upgrade data quality and access * Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery **Shown mastery working with some of the following common languages and tools:** * Spark (Scala and PySpark), Kafka and other high-volume data tools * SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB * Java, Python data tools * Azure DevOps experience to follow work, develop using git-integrated version control examples, and build and use CI/CD pipelines * Working knowledge and experience executing data engineering patterns to support shifting business needs * Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions * Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to implement streaming ingestions * Experience creating and implementing warning and monitoring systems * Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets * Execution experience across various data stores, messaging frameworks, and data processing engines * Data joining through APIs as well as REST services * PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more **Least Capabilities:** **Information Architect I:** * Four-year degree in Data Science, Software Engineering, or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work experience * Essential knowledge in data engineering and AI structures including design, development, and execution of highly complex systems and data pipelines * Essential knowledge in Data Science including design, development, and execution of large-scale or online transaction-based systems * Experience as a junior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might counterbalance the connected experience requirements **Sponsorship isn't available for Information Architect I job.** **Information Specialist II:** * Four-year degree in Software Engineering, Data Science, a connected quantitative field, for example, Designing or Math or identical proper preparation or work experience * Two (2) years comparable work experience in estimation and analysis, quantitative business reasoning, reproduction development, and potentially prescriptive analysis * Solid knowledge in data engineering and AI structures including design, development, and execution of highly complex systems and data pipelines * Solid knowledge in Data Science including design, development, and execution of large-scale or online transaction-based systems * Solid understanding of the transportation business, competitors, and emerging technologies * Experience as a member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might balance the connected experience requirements **Sponsorship isn't available for Information Architect II job.** **Information Architect III:** * Four-year degree in Data Science, Software Engineering, or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work experience * Three to Four (3 - 4) years identical work experience in estimation and analysis, quantitative business reasoning, reproduction development, or potentially prescriptive analysis * Broad knowledge in data engineering and AI structures including design, development, and execution of highly complex systems and data pipelines * Broad knowledge in Data Science including design, development, and execution of large-scale or online transaction-based systems * Solid understanding of the transportation business, competitors, and emerging technologies * Experience giving leadership in a general training or counseling setting * Experience as a senior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might counterbalance the connected experience requirements **Information Architect Lead:** * Four-year degree in Data Science, Software Engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work experience * Five to Seven (5 - 7) years identical work experience in estimation and analysis, quantitative business reasoning, reproduction development, or potentially prescriptive analysis * Broad knowledge in data engineering and AI structures including design, development, and execution of highly complex systems and data pipelines * Broad knowledge in Data Science including design, development, and execution of large-scale or online transaction-based systems * Solid understanding of the transportation business, competitors, and emerging technologies * Experience giving leadership in a general training or counseling setting * Experience as a leader or a senior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might balance the connected experience requirements **Residence/Movement Data:** * This position can be domiciled anywhere in the US. **Application Standards:** * Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey. **Extra Data** * Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois, and New Jersey Residents Only - Compensation: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting compensation range for this job. Factors that may be used to determine your actual compensation may include your education, experience, and performance. Apply for this job