Senior Data Engineer

Added
28 days ago
Type
Full time
Salary
Salary not provided

Related skills

sql python airflow kafka spark

πŸ“‹ Description

  • Build and maintain batch and streaming data pipelines using Python, SQL, Kafka, and Spark.
  • Develop and operate Airflow workflows, including scheduling, dependency management, retries, and
  • Design and maintain data models and warehouse datasets for analytics and reporting.
  • Improve data quality and freshness through validation, monitoring, and investigation of upstream
  • Optimise pipeline and query performance, and manage processing and storage costs.
  • Work with data users to define datasets and metrics, and document data flows, transformations, and

🎯 Requirements

  • Data engineering experience within crypto or Web3, including responsibility for production
  • Strong Python and SQL skills, with experience building maintainable data processing workflows.
  • Hands-on experience with Airflow, Kafka, and Spark.
  • Experience with data warehouses, ETL/ELT pipelines, and data modelling.
  • The ability to investigate data discrepancies, troubleshoot pipeline failures, and resolve
  • The ability to work independently and communicate technical details and business requirements

🎁 Benefits

  • Fully remote within APAC
  • Mandarin as the team's main working language
  • Work on a data platform connected to the daily operations of a crypto exchange
  • Help colleagues get dependable answers from its data
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’