Data Engineer| Remote| Contract

Title: Data Engineer

Job Type: Contract

Location: 100% Remote work (India)

Salary: (INR)Open/Market

Responsibilities :

• Design and implement core data analytic platform components that would be shared extended to different analytics group.
• Review approaches and completed data pipelines against platform best practices and patterns.
• Maintain and design a common data flow pipeline data transformation activities such as Extract Transform Load (ETL).
• Support and troubleshoot the data flow activities on cloud data warehouse environments.
• Develop data pipeline code using Python, Java, AWS Lambda and/or Azure Data Factory
• Perform requirements planning, monitoring, and end-to-end requirements management throughout the data asset development life-cycle.
• Direct and help other developers and analyst to ensure data platform patterns are adhered.
  • Designing, building, and documenting RESTful API using OpenAPI specification tools such as Swagger
  • Microsoft PowerBI
  • Snowflake Data warehouse, MS SQL Data warehouse
  • Apache Spark or Hadoop
  • SparkR
  • Linux/PowerShell scripting
  • AWS Lambda or Azure function

Desired Skills :

Required Experience :

• Bachelor’s degree in computer Science or related field
• 5-7 years’ experience in the following:
  • Snowflake, Databricks management,
  • Python and AWS Lambda
  • Scala and/or Java
  • Data integration service, SQL and Extract Transform Load (ELT)
  • Azure or AWS for development and deployment
  • Jira or similar tool during SDLC
  • Experience managing codebase using Code repository in Git/GitHub or Bitbucket
• Experience working with a data warehouse.
• Familiarity with structured and semi-structured data formats including JSON, Avro, ORC, Parquet, or XML
• Exposure to working in an agile work environment.