[Remote] Data Engineer EDAP
Note: The job is a remote job and is open to candidates in USA. ETalentNetwork is a company focused on delivering data-driven solutions. They are seeking a detail-oriented Data Engineer to implement and optimize data models, design scalable data pipelines, and ensure data accuracy and integrity.
Responsibilities
- Implement and optimize data models and structures within Databricks to support efficient querying, analytics, and reporting
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows, with a strong emphasis on dimensional data modeling and data quality
- Partner with engineering teams and business stakeholders to gather requirements and deliver reliable analytics solutions
- Develop, optimize, and maintain SQL queries, notebooks, and scripts for data ingestion, transformation, and processing
- Ensure data accuracy, consistency, and integrity through validation, monitoring, and data cleansing processes
- Create and maintain comprehensive documentation for data pipelines, models, and analytics solutions
- Monitor, troubleshoot, and optimize data pipelines and analytics workloads to ensure performance and reliability
- Stay current with industry trends, including AI-driven analytics tools, semantic modeling, and emerging data engineering best practices
Skills
- Detail-oriented and analytical problem solver
- Ability to communicate clearly and collaborate effectively with cross-functional teams
- Adaptable, service-oriented, curious, and passionate about using modern data technologies
- Highly organized and proactive
- Ability to manage multiple priorities while maintaining a strong focus on quality, scalability, and innovation
- Implement and optimize data models and structures within Databricks
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows
- Partner with engineering teams and business stakeholders to gather requirements
- Develop, optimize, and maintain SQL queries, notebooks, and scripts for data ingestion, transformation, and processing
- Ensure data accuracy, consistency, and integrity through validation, monitoring, and data cleansing processes
- Create and maintain comprehensive documentation for data pipelines, models, and analytics solutions
- Monitor, troubleshoot, and optimize data pipelines and analytics workloads
- Stay current with industry trends, including AI-driven analytics tools, semantic modeling, and emerging data engineering best practices
- Hands-on experience implementing and operating solutions in Databricks
- Strong understanding of ETL/ELT architectures and data ingestion patterns
- Proficiency in Python and/or Spark for large-scale data processing
- Experience designing and implementing dimensional data models in data lakehouse environments
- Familiarity with AI-driven analytics platforms, semantic modeling concepts, and NLP techniques
- Experience working in SAFe Agile or other scaled Agile environments
- Solid understanding of data governance, security, and compliance best practices in global environments with numerous data providers and consumers
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field preferred
- Master's degree is a plus
- Databricks and Azure certifications strongly preferred
Company Overview