Job Description
Transform your career as a Data Engineer focused on data infrastructures. Design scalable pipelines that ensure data quality and alignment with health-related data regulations.
In this advanced role, you will utilize your skills to develop ETL/ELT workflows using Python and Airflow. Your contributions will involve maintaining data observability and collaborating with engineers to enhance AI models. Ensure compliance with data handling practices while optimizing data storage performance.
Key Responsibilities:
• Design and maintain ETL/ELT pipelines with Airflow
• Develop robust data ingestion and validation processes
• Ensure data quality, lineage, and observability
• Collaborate with AI teams for model training
• Implement secure data practices consistent with regulations
Requirements:
• Strong background in Python for data engineering roles
• Hands-on experience with Airflow and DAG design
• Profici...
In this advanced role, you will utilize your skills to develop ETL/ELT workflows using Python and Airflow. Your contributions will involve maintaining data observability and collaborating with engineers to enhance AI models. Ensure compliance with data handling practices while optimizing data storage performance.
Key Responsibilities:
• Design and maintain ETL/ELT pipelines with Airflow
• Develop robust data ingestion and validation processes
• Ensure data quality, lineage, and observability
• Collaborate with AI teams for model training
• Implement secure data practices consistent with regulations
Requirements:
• Strong background in Python for data engineering roles
• Hands-on experience with Airflow and DAG design
• Profici...