Lead Data Engineer

Job Description

We are looking for talented Data Engineering professionals to join our growing team in Hyderabad! We are actively recruiting for multiple positions across levels:

About the Role:

We need a Lead Data Engineer with a strong background in cloud data platforms, data transformation tools, and modern programming languages who are passionate about building scalable data pipelines and enabling data-driven decision-making.

Key Responsibilities:

  • Design, develop, and maintain robust data pipelines using Microsoft Fabric.
  • Manage and optimize data storage/retrieval using SQL Server, PostgreSQL, and S3 / Azure Blob.
  • Collaborate with analytics and engineering teams to ensure data quality and accessibility.
  • Implement data orchestration workflows using Airflow.
  • Write efficient, scalable SQL and Python code for data processing and analysis.
  • Perform deep data analysis to support key business insights and reporting.
  • Manage version control and CI/CD pipelines using Git (GitLab preferred).
  • Work with data warehousing platforms (Snowflake, Databricks, or BigQuery) as needed.

Nice-to-have:

Experience with Microsoft infrastructure solutions and pipeline monitoring using Grafana.

Required Skills & Qualifications:

  • 8+ years of hands-on data engineering experience (depending on the role applied for).
  • Strong expertise in SQL Server, PostgreSQL, and S3.
  • Proven experience with dbt or Microsoft Fabric.
  • High proficiency in SQL and Python.
  • Solid understanding of data architecture and analysis techniques.
  • Experience with Git and CI/CD workflows (GitLab preferred).
  • Familiarity with Airflow or mage.ai.
  • Exposure to Snowflake, Databricks, or BigQuery.

Yottaflex AI Technologies Private Limited is an equal opportunity employer. We welcome applicants of all backgrounds and are committed to building a diverse, inclusive workplace.

Share this :