Data Engineer

About the Role

We're looking for a skilled Data Engineer to build and maintain our data infrastructure. You'll design and implement scalable data pipelines, ensure data quality, and enable our data science and analytics teams to derive insights from large-scale datasets.

Key Responsibilities

• Design, build, and maintain robust data pipelines using ETL/ELT processes
• Develop and optimize data warehouse solutions
• Implement data quality checks and monitoring systems
• Work with big data technologies (Spark, Hadoop, Kafka)
• Collaborate with data scientists and analysts to support their data needs
• Optimize query performance and data storage
• Implement data security and privacy measures
• Create and maintain technical documentation

Requirements

• 4+ years of experience in data engineering
• Strong proficiency in SQL and Python
• Experience with Apache Spark and distributed computing
• Knowledge of data warehousing concepts and dimensional modeling
• Experience with ETL/ELT tools and frameworks
• Familiarity with cloud data platforms (Azure Synapse, AWS Redshift, Snowflake)
• Understanding of data governance and data quality principles
• Strong analytical and problem-solving skills

Nice to Have

• Experience with real-time data streaming (Kafka, Event Hubs)
• Knowledge of data lake architectures
• Experience with dbt or similar data transformation tools
• Familiarity with DataOps practices
• Experience with Databricks
• Knowledge of data catalog tools

What We Offer