Senior Data Engineer (Snowflake + AWS)
What you will be doing
- Design and implement scalable, reliable data pipelines using AWS and Snowflake.
- Develop and maintain Streamlit applications to expose data insights, prototypes, and internal analytics tools.
- Build and maintain ETL/ELT workflows using AWS Glue, AWS DMS, Python, and PySpark.
- Migrate data from OLTP systems (e.g., PostgreSQL) into Snowflake with high data quality and minimal downtime.
- Optimize Snowflake schemas, warehouses, and queries for reporting and analytics use cases.
- Ensure data consistency, accuracy, and lineage across the centralized data platform.
- Collaborate with Data product development teams, Analytics and reporting application developers, Business and operational users across the company.
- Implement monitoring, logging, and alerting for data pipelines.
- Support the retirement of legacy reporting and replica databases.
- Contribute to best practices around data modeling, performance optimization, and cost management.
- Mentor junior data engineers and provide technical guidance when needed.
- Develop and maintain Streamlit applications to expose data insights, prototypes, and internal analytics tools.
- Build and maintain ETL/ELT workflows using AWS Glue, AWS DMS, Python, and PySpark.
- Migrate data from OLTP systems (e.g., PostgreSQL) into Snowflake with high data quality and minimal downtime.
- Optimize Snowflake schemas, warehouses, and queries for reporting and analytics use cases.
- Ensure data consistency, accuracy, and lineage across the centralized data platform.
- Collaborate with Data product development teams, Analytics and reporting application developers, Business and operational users across the company.
- Implement monitoring, logging, and alerting for data pipelines.
- Support the retirement of legacy reporting and replica databases.
- Contribute to best practices around data modeling, performance optimization, and cost management.
- Mentor junior data engineers and provide technical guidance when needed.