[Remote] Azure data engineer
Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is seeking an Azure Data Engineer to enhance their data management processes. The role involves optimizing data feeds, developing automated pipelines, and ensuring data quality and governance within the MDL community.
Responsibilities
- Assess existing MDL data tables and create a structured inventory
- Conduct data feed reviews with the MDL community
- Improve data structures, performance, and documentation
- Support the identification of relevant Marketing and non-Marketing data products
- Implement and test new data feeds to ensure quality and consistency
- Align with data stakeholders and support enablement
- Replace manual uploads with automated pipelines
- Develop concepts and PoCs for data quality checks (top 20 tables)
- Execute in-depth quality reviews and implement corrective actions
- Document lineage, transformations, and table-level metadata
- Set up data dictionaries, PII-handling concepts, and taxonomy standards
- Contribute to ER model development and artifact standardization
- Coordinate across the MDL community
- Support access requests, platform education, and use-case repository updates
Skills
- Strong data engineering background (3-5 years)
- Proficiency with Azure data lake, SQL, Databricks, and modern data pipelines
- Experience with data lineage, metadata, documentation, and data quality frameworks
- Ability to structure complex datasets and communicate with cross-functional teams
- Experience with SAP Data Lake, SAP Datasphere, BDC, or Collibra
- Background in Marketing data or large-scale data lake optimization
Company Overview
Company H1B Sponsorship