Senior Data Engineer - Remote
Job Type :
Direct
Hours :
Full Time
Required Education :
Bachelor's Degree Required
Travel :
No
Relocation :
No
Job Description :
The Senior Data Engineer will be responsible for designing,
implementing, and maintaining robust data pipelines and integrations. You will ensure
the reliability, scalability, and cost-efficiency of our data systems while enabling internal
teams to access and utilize data effectively. Your expertise in AWS Glue, S3, and
standard ETL processes will be critical in managing and optimizing our data
infrastructure. Your experience with data systems leveraging Apache Kafka for
streaming will be vital.
Key Responsibilities:
● Design, develop, and manage data pipelines and ETL processes to Snowflake
Data Cloud and Snowpipe.
● Ensure data reliability, integrity, and security across all data systems.
● Collaborate with engineering and data science teams to support their data needs
and enable rapid innovation.
● Optimize data warehouse performance, storage, and costs in Snowflake.
● Implement and maintain data integration solutions using AWS Glue and S3.
● Monitor and troubleshoot data pipelines to ensure high availability and
performance.
● Develop and enforce best practices for data management, including data
governance and compliance.
● Analyze and manage costs associated with data storage and processing,
ensuring efficient use of resources.
● Stay updated on industry trends and emerging technologies to continually
improve our data infrastructure.
Qualifications:
● Bachelor’s degree in Computer Science, Data Science, Business Information
Systems, or a related field; or equivalent work experience
● Proven experience as a Data Engineer or similar role, with a focus on data
warehouse management and ETL processes
● Extensive experience with Snowflake Data Cloud and Snowpipe, including
architecture, deployment, and management at an enterprise scale
● Extensive experience with DBT, or similar data transformation tooling
● Proficient coding in Go and/or Python
● Strong knowledge of AWS services, particularly AWS Kinesis, Glue and S3
● Experience with Apache Kafka or Pulsar
● Proficiency in SQL and experience with data modeling and database design
● Solid understanding of big data technologies and frameworks
● Experience with data integration tools and techniques
● Strong problem-solving skills and the ability to work under pressure in a
fast-paced environment
● Excellent communication and collaboration skills, with a proactive and self-driven
approach
Required Qualifications :
