The Role

Intelligems is seeking a highly skilled Data Engineer to join our team to maintain and enhance our data infrastructure. Our data stack includes Snowflake and DBT, and we ingest hundreds of millions of events a week. The successful candidate will play a pivotal role in designing, constructing, installing, testing, and maintaining highly scalable data management systems.

Our data volumes have grown 10x in the last year and we’re looking for someone who can help us reach another 100x scale.

Key Responsibilities:

• Develop and maintain scalable and reliable data pipelines that can process large volumes of data.
• Utilize dbt (Data Build Tool) to transform and load data into Snowflake, ensuring data quality and consistency.
• Write complex SQL queries for data manipulation and retrieval, optimizing performance for large datasets.
• Implement best practices for database schema design and data modeling according to business needs.
• Implement and maintain CI/CD for data pipelines
• Write and maintain data documentation
• Monitor the performance of data pipelines, warehouses, and associated cost
• Tune and optimize queries, warehouses, and other resources to improve performance and cost

Qualifications:

• Proven experience as a Data Engineer, with expertise in dbt, Snowflake, SQL, and data systems architecture.
• Strong understanding of ETL processes, data warehousing principles, and data modeling techniques.
• Excellent problem-solving skills and attention to detail.
• Ability to work independently and within a team environment.
• Excellent communication skills to effectively collaborate with team members and stakeholders.