Python with Spark Developer (5.1-7 years)-Chennai

📋 Description

• Design & develop robust ingestion, transformation, and enrichment pipelines with Python
• Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation
• Collaborate with CEFS data architects, data scientists, and business analysts to translate
• Unit-test, integrate-test, and review code.
• Maintain CI/CD pipelines (Git, Jenkins, Docker) for automated build, test, and deployment of jobs.
• Monitor production workloads and troubleshoot performance bottlenecks, memory issues, and job

🎯 Requirements

• Overall, 5-7 years of experience as a Python Developer with Spark.
• Sound knowledge of Agile (Scrum/Kanban).
• Resourceful to quickly understand complexities involved and provide the way forward.
• Good experience in technical analysis of n-tier applications with multiple integrations using
• Strong knowledge about design patterns and development principles.
• Inclination and prior experience of working across SQL, Python and ETL.

🎁 Benefits

• A work culture focused on innovation and creating lasting value for our clients and employees
• Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
• A flat, non-hierarchical structure that will enable you to work with senior partners and directly
• A diverse, inclusive, meritocratic culture