Senior Data Engineer

This role is for one of the Weekday's clients

Salary range: Rs 500000 - Rs 1000000 (ie INR 5-10 LPA)

Min Experience: 6 years

Location: Remote (India)

JobType: full-time

We are looking for an experienced Data Engineer to lead the migration of Databricks-based pipelines to Snowflake, ensuring scalability, performance, and efficiency in data processing. The role demands strong expertise in PySpark/Spark, Snowflake, DBT, and Airflow, along with exposure to DevOps and CI/CD best practices. You will be responsible for re-architecting data workflows, implementing automation, and ensuring end-to-end reliability and optimization across environments.

Key Responsibilities

• Lead the migration and re-engineering of Databricks pipelines into Snowflake.
• Design and optimize SQL-based transformations for large-scale data processing.
• Implement and manage DBT models, macros, and version-controlled deployments.
• Build and maintain Airflow DAGs for efficient workflow automation and monitoring.
• Develop and manage CI/CD pipelines using GitHub Actions, Azure DevOps, or similar tools.
• Ensure robust data governance, RBAC, and performance tuning in Snowflake.
• Establish monitoring and alerting systems to ensure pipeline reliability and quick issue resolution.

What Makes You a Great Fit

• You have 5+ years of hands-on experience in data engineering and cloud-based data platforms.
• You’re proficient in PySpark/Spark, Snowflake, DBT, and Airflow with a strong command of SQL.
• You understand the full data lifecycle — from ingestion and transformation to automation and deployment.
• You’re detail-oriented and process-driven, with a focus on scalability, efficiency, and data quality.
• You enjoy solving complex data challenges and can collaborate effectively across technical and business teams.
• You bring a DevOps mindset, ensuring automation, version control, and reliability in every workflow.