Role Title: Lead Senior Associate | Data Engineering
Location: Bangalore, Hybrid (3 days onsite, 2 days remote)
Entity: Deloitte Touche Tohmatsu India LLP
About the Role
The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and data infrastructure that enable analytics, reporting, and AI/ML solutions. The role ensures reliable data availability, quality, and performance across enterprise systems.
Key Responsibilities:
• Design, develop, and maintain ETL/ELT data pipelines for structured and unstructured data.
• Build scalable data architectures using cloud and distributed systems.
• Integrate data from multiple sources such as APIs, databases, streaming platforms, and third-party systems.
• Ensure data quality, integrity, and governance standards are maintained.
• Optimize database performance and query efficiency.
• Support analytics, BI, and AI/ML teams with clean and reliable datasets.
• Implement monitoring, logging, and alerting for data workflows.
• Collaborate with Data Scientists, Analysts, and Product teams to understand data requirements.
• Maintain documentation for data models, pipelines, and workflows.
Required Qualifications / Must have:
- Snowflake: Snowflake, Data warehousing, Snow pipe, Streams, Tasks, Time Travel, and Snowpark
- Azure Services: Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, etc.
- Programming Languages: Python, SQL, T-SQL, PySpark, Spark SQL, Fair knowledge on KQL.
- Data Modeling: ERD, Dimensional Modeling
- ETL Tools: Azure Data Factory, Experience with tools like dbt, Fivetran, Matillion, or Airflow
- Big Data Technologies: Fair knowledge on Hadoop and Spark
- Performance Tuning and Troubleshooting
- Version Control: Git, Azure DevOps
Preferred Qualifications / Good to Have:
- Experience with chat apps and micro frontends
- Familiarity with Teams bot framework and adaptive cards
- Knowledge of data visualization libraries (e.g., D3.js, Highcharts), azure web apps, python