Đến nội dung chính
Tuyển Dụng
← IMIP Technology And Solution Consultancy

Middle Data Engineer Apache Spark, Trino

IMIP Technology And Solution Consultancy · Hà Nội
Ứng tuyển tại trang chính thức ↗
Loại hình
Toàn thời gian
Hình thức
Tại văn phòng
Cấp bậc
Nhân viên
Ngành nghề
Kỹ thuật / Cơ khí
Mức lương
Từ 19tr
Địa điểm
Quận Cầu Giấy, Hà Nội, Hà Nội

Tổng quan

  • Data Pipeline Engineering: Design, build, and maintain automated data ingestion pipelines from several source systems using Airbyte and Airflow, ensuring reliability and scalability.
  • Lakehouse Architecture Implementation: Develop and manage the Medallion Architecture (Bronze/Silver/Gold) using dbt-spark to enable structured, high-quality analytical datasets.
  • Platform Performance Optimization: Optimize Spark and Trino workloads on Kubernetes and manage the full lifecycle of Apache Iceberg tables (compaction, snapshotting, and maintenance) to improve query performance, storage and reduce latency.
  • Infrastructure & Reliability Management: Proactively monitor and maintain Data Platform resources using Grafana and Prometheus; analyze query patterns to enhance system stability and performance for production users.
  • Data Security & Governance: Enforce row- and column-level security using Open Policy Agent (OPA) and develop foundational frameworks for Data Governance and Data Quality, embedding lineage, automated testing, and compliance directly into pipelines.
  • Enterprise Data Integration: Architect and implement high-performance data bridges to deliver on-premise Lakehouse data into Microsoft Fabric, enabling seamless and secure hybrid-cloud connectivity.
  • Your Skills and Experience
  • 3+ years of hands-on experience in Data Engineering or Platform Engineering, building and operating production-grade data platforms.
  • Strong expertise in distributed processing with Apache Spark and Trino, including performance tuning and optimization.
  • Proven experience designing and maintaining reliable data pipelines using Airbyte and Apache Airflow.
  • Solid understanding of modern Lakehouse architectures, dbt-based transformations, and Iceberg table management.
  • Hands-on experience with Kubernetes, containerized deployments, and CI/CD for data workloads.
  • Knowledge of data security, governance, and access control practices (row/column-level security, policy enforcement, IAM).
  • Experience supporting BI/analytics use cases and integrating with enterprise reporting tools (e.g., Microsoft Fabric, Power BI).
  • Strong troubleshooting, system reliability, and problem-solving skills in complex distributed environments.
  • Ability to work independently in a highly technical, ownership-driven role.
  • Why You'll Love Working Here
  • easy going and friendly environment
  • Remuneration Package:
  • Working hours: 5 days per week (in a professional and yet young, dynamic environment)
  • Salary: Competitive remuneration package (based on skills and experience)
  • 12 leave days per year

Tóm tắt thông tin từ tin tuyển dụng chính thức. Xem bản gốc ↗

Quan tâm đến vị trí này?

Bạn sẽ được chuyển đến trang ứng tuyển chính thức của nhà tuyển dụng.

Ứng tuyển tại trang chính thức ↗
Đây là doanh nghiệp của bạn? Nhận quản lý trang, yêu cầu chỉnh sửa hoặc gỡ bỏ
→