Data Engineer - Azure Fabric Job at Ashra Technologies Private Limited, Remote

MEtCbTRUQWJ6bHlhMXFtK2xsQXpjRFRmWlE9PQ==
  • Ashra Technologies Private Limited
  • Remote

Job Description

We are seeking a hands-on Data Engineer (5 7 years) to build and support a modern, governed data platform for a leading US-based insurance organization. The role focuses on implementation and delivery under defined architecture, with strong emphasis on PySpark, SQL, Azure Fabric Dataflows Gen2, and knowledge of CI/CD .

Responsibilities

  • Build and maintain Azure Fabric data pipelines using Pipelines, Dataflows Gen2, and Notebooks (PySpark) .
  • Implement Lakehouse-first / Medallion (ODS, Bronze Silver Gold) data patterns, including Type-2 SCD and golden records.
  • Develop PySpark transformations ; use SQL extensively for validation, reconciliation, and performance tuning.
  • Create Lakehouse SQL views and materialized views , enabling DirectLake consumption.
  • Ingest data from on-prem SQL Server DWHs and API-based sources (via Azure API Management/connectors).
  • Support on-prem Azure Fabric migrations , including historical data loads and data quality validation.
  • Implement event-driven ingestion where required using Fabric Event Streams and KQL .
  • Operate within governed Fabric environments (OneLake layout, RBAC, standards).
  • Monitor pipelines, handle failures, and optimize performance using logs and diagnstics.
  • Contribute to CI/CD pipelines using Azure DevOps or Bitbucket .

Required Experience

  • 5 7 years in data engineering / ETL / DWH development .
  • Strong hands-on skills in PySpark and SQL .
  • Practical experience with Azure Fabric (Lakehouse, OneLake, Dataflows Gen2, Pipelines) for 3 to 5 years
  • Solid understanding of Medallion architecture, SCD Type-2 , and cloud data migrations.
  • Experience with API-based ingestion and CI/CD for data platforms .
  • Familiarity with data governance and security in regulated environments.

Job Tags

Full time

Similar Jobs

Forge Strategies

Roofer Job at Forge Strategies

 ...Commercial Roofer (Production / Service)-Dallas, TX - $20$25/hour (based on experience) Were partnered with a growing commercial roofing company in the Dallas area that is looking to add a Commercial Roofer to their team. This is a great opportunity for someone... 

PostNet

Graphic Designer Job at PostNet

 ...We are a design and print shop that focuses on providing quality and timely design and...  ...flags, posters, stickers, labels etc. Graphic Designer role is responsible for creating...  ...* A portfolio or past works showcasing experience in designing banners, business cards, social... 

Acropolis Greek Taverna

Line Cook (Hot Line) Job at Acropolis Greek Taverna

Main Responsibilities of a Cook: Preparing workstations, cooking ingredients, and kitchen equipment for cooking. Cooking and arranging food. Cook Job Description: We are looking for an experienced cook to fill a vacant spot in our kitchen staff and contribute...

IPEM SOLUTIONS INC

Salesforce with AWS Connect Developer Job at IPEM SOLUTIONS INC

 ...: Brief : You will be as a Salesforce Developer with Field Service Lightning (FSL) knowledge, holds responsibilities for the analysis, design, develop, test, and deploy the enterprise level solutions for our client. Required Skills ~3+ years of experience in Salesforce... 

MyAdvice

SEO Content Writer Job at MyAdvice

 ...MyAdvice is seeking a creative, organized, and self-motivated writer and editor to join our content team.This dual role is responsible for creating and...  ...schedule. Work Locations:This position can be remote, hybrid or in-office depending on candidate preference and...