Job Description
This role is for one of the Weekday's clients
Salary range: Rs 500000 - Rs 1000000 (ie INR 5-10 LPA)
Min Experience: 6 years
Location: Remote (India)
JobType: full-time
We are looking for an experienced Data Engineer to lead the migration of Databricks-based pipelines to Snowflake, ensuring scalability, performance, and efficiency in data processing. The role demands strong expertise in PySpark/Spark, Snowflake, DBT, and Airflow, along with exposure to DevOps and CI/CD best practices. You will be responsible for re-architecting data workflows, implementing automation, and ensuring end-to-end reliability and optimization across environments.
Requirements
Key Responsibilities
- Lead the migration and re-engineering of Databricks pipelines into Snowflake.
- Design and optimize SQL-based transformations for large-scale data processing.
- Implement and manage DBT models, macros, and version-controlled deployments.
- Build and maintain Airflow DAGs for efficient workflow automation and monitoring.
- Develop and manage CI/CD pipelines using GitHub Actions, Azure DevOps, or similar tools.
- Ensure robust data governance, RBAC, and performance tuning in Snowflake.
- Establish monitoring and alerting systems to ensure pipeline reliability and quick issue resolution.
What Makes You a Great Fit
- You have 5+ years of hands-on experience in data engineering and cloud-based data platforms.
- You’re proficient in PySpark/Spark, Snowflake, DBT, and Airflow with a strong command of SQL.
- You understand the full data lifecycle — from ingestion and transformation to automation and deployment.
- You’re detail-oriented and process-driven, with a focus on scalability, efficiency, and data quality.
- You enjoy solving complex data challenges and can collaborate effectively across technical and business teams.
- You bring a DevOps mindset, ensuring automation, version control, and reliability in every workflow.
Similar Jobs
Personal Financial Advisors
Weekday AI
Personal Financial Advisors
Weekday AI
Personal Financial Advisors
Weekday AI
Financial and Investment Analysts
Weekday AI
Financial and Investment Analysts
Weekday AI
Financial and Investment Analysts
Weekday AI
DevOps Engineer
Weekday AI
Freelance Video Editor
Weekday AI
Bioinformatics PhDs
Weekday AI
Bioinformatics PhDs
Weekday AI
Bioinformatics PhDs
Weekday AI
Bioinformatics PhDs
Weekday AI
Bioinformatics PhDs
Weekday AI
Advanced Math Proof Expert
Weekday AI
Market Data Engineer
Weekday AI
Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.
