Data Engineer - Nebius
- חברה: Nebius
- מיקום: Prague, Czech Republic
- טכנולוגיות: Python, SQL, Airflow, Apache Spark, Docker, Kubernetes, Terraform, GDPR, SOC2
תיאור המשרה
Design, develop, and maintain scalable data pipelines.
Build and optimize data infrastructure.
Implement data quality monitoring and validation frameworks.
Optimize data storage, processing, and query performance for large-scale datasets.
Design and implement data models for analytics and reporting use cases.
Develop tools and automation to improve data engineering workflows and productivity.
Ensure data governance, security, and compliance standards are met.
Participate in on-call rotation to support production data systems.
3+ years of experience in data engineering or related roles.
Experience building and maintaining data pipelines using orchestration tools (e.g., Airflow, Prefect, Dagster).
Strong proficiency in SQL and solid programming skills in Python.
Experience with distributed data processing frameworks (e.g., Apache Spark, or similar).
Knowledge of data modeling principles and best practices.
Understanding of data architectures and storage systems.
Experience with real-time data streaming platforms.
Familiarity with Infrastructure as Code tools (Terraform, etc).
Experience with containerization (Docker) and Kubernetes.
Knowledge of data governance and privacy frameworks (GDPR, SOC2).
Knowledge of data quality and observability tools (Great Expectations, etc.).
Competitive compensation
Career growth and learning opportunities
Flexibility and work-life balance
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams
תחומי אחריות
Design, develop, and maintain scalable data pipelines.
Build and optimize data infrastructure.
Implement data quality monitoring and validation frameworks.
Optimize data storage, processing, and query performance for large-scale datasets.
Design and implement data models for analytics and reporting use cases.
Develop tools and automation to improve data engineering workflows and productivity.
Ensure data governance, security, and compliance standards are met.
Participate in on-call rotation to support production data systems.
דרישות
Design, develop, and maintain scalable data pipelines.
Build and optimize data infrastructure.
Implement data quality monitoring and validation frameworks.
Optimize data storage, processing, and query performance for large-scale datasets.
Design and implement data models for analytics and reporting use cases.
Develop tools and automation to improve data engineering workflows and productivity.
Ensure data governance, security, and compliance standards are met.
Participate in on-call rotation to support production data systems.
3+ years of experience in data engineering or related roles.
Experience building and maintaining data pipelines using orchestration tools (e.g., Airflow, Prefect, Dagster).
Strong proficiency in SQL and solid programming skills in Python.
Experience with distributed data processing frameworks (e.g., Apache Spark, or similar).
Knowledge of data modeling principles and best practices.
Understanding of data architectures and storage systems.
Experience with real-time data streaming platforms.
Familiarity with Infrastructure as Code tools (Terraform, etc).
Experience with containerization (Docker) and Kubernetes.
Knowledge of data governance and privacy frameworks (GDPR, SOC2).
Knowledge of data quality and observability tools (Great Expectations, etc.).
Competitive compensation
Career growth and learning opportunities
Flexibility and work-life balance
Collaborative and innovative culture
Opportunity to work on impactful AI projects
International environment and talented teams