Staff/Senior Staff Web3 Big Data Engineer

📋 Description

• Platform Architecture: Own the big data platform architecture and optimization.
• On-Chain Data Pipelines: Real-time and batch pipelines for on-chain data.
• Data Warehouse & Lake: Build/maintain warehouse and data quality.
• AI-Driven Data Applications: AI features like anomaly detection and risk models.
• AI Infrastructure: Vector databases and embedding pipelines for AI use cases.
• Cross-Team Collaboration: Partner with AI, Product, Risk, and Growth teams.

🎯 Requirements

• Bachelor's degree in CS/SE; 7+ years in big data development.
• Proficiency with Hadoop, Spark, Flink; real-time and batch warehousing.
• Familiarity with Hive, Kafka, HBase, ClickHouse, Doris; large-scale tuning.
• Strong Java/Scala/Python; solid SQL tuning.
• Data governance, data quality monitoring, or metadata management is a plus.
• LLM fundamentals, prompt engineering, and RAG.

🎁 Benefits

• Competitive total compensation
• Comprehensive insurance coverage for employees and dependants
• More perks revealed during the process