Vista previa de la oferta
Senior Team Lead | Data Lead | Bengaluru | Sustainability & Emerging Assurance
senior · Technology / Software Development
Senior Team Lead | Data Lead | Bengaluru | Sustainability & Emerging Assurance
• Job requisition ID : 108080
• Location: Hyderabad
• Entity: Deloitte South Asia LLP
The team
Assurance is seeking an looking for a Databricks / Data Engineer Lead to design and build scalable data pipelines and analytics solutions on Azure for the Edward Jones engagement. The candidate will bring expert-level Databricks and Spark experience, combined with strong Python and Azure data engineering skills. Learn more about Assurance
Your work profile
- Design, develop, and maintain Databricks-based data pipelines and transformation workflows
- Build scalable Spark applications for large-scale data processing and analytics
- Develop Python-based data engineering solutions for batch and streaming workloads
- Architect and implement data solutions on Azure Data Factory, Azure Synapse, or related Azure services
- Ensure data quality, lineage, and governance across data products
- Implement DevOps practices for data pipeline deployment, monitoring, and automation
- Collaborate with data scientists, ML engineers, and business stakeholders
- Mentor junior data engineers and contribute to technical standards
Key skills required:
- 6+ years of data engineering experience
- Advanced proficiency in Databricks — notebooks, Delta Lake, Unity Catalog
- Advanced proficiency in Databricks Spark development — PySpark, Spark SQL
- Advanced proficiency in Python for data engineering
- Advanced proficiency in Azure data services — Azure Data Factory, Synapse, ADLS
- Intermediate or above proficiency in DevOps tools and CI/CD practices
- Experience with data modelling, data warehousing concepts, and ETL/ELT patterns
- Financial Services domain experience is a plus.