Data Engineering - Technical Lead

📋 Description

• Work on complex tech projects with peers in a fast-paced environment.
• Specialize in Hadoop and Spark with a strong product design sense.
• Design real-time data ingestion pipelines for dashboards.
• Build scalable data platforms handling petabytes of data daily.
• Create components to transform raw data into a data lake.
• Develop Hadoop ecosystem components for low-latency, scalable systems.

🎯 Requirements

• 4-8 years of experience in Big Data technologies.
• Strong hands-on Hadoop, MapReduce, Hive, Spark, PySpark.
• Proficient in Python, Java, or Scala.
• Scripting experience with Python or Bash.
• Nice-to-have: NoSQL (HBase, Cassandra) and Kafka.
• Nice-to-have: AWS/S3; streaming apps like Spark Streaming.

🎁 Benefits

• Opportunity to impact Paytm's large user and merchant base.
• Collaborative, fast-paced environment with growth.
• Data-driven culture focused on customers.