[Remote] Senior Databricks Data Engineer (AWS) - Remote Opportunity
Note: The job is a remote job and is open to candidates in USA. Booker DiMaio is seeking two Senior Databricks Data Engineers to support a federal Enterprise Data Platform modernization initiative. The role involves designing, developing, and optimizing cloud-native data solutions using Databricks and AWS services while collaborating with various stakeholders to deliver secure, production-ready solutions.
Responsibilities
- Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services
- Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing
- Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads
- Develop and support medallion architecture data pipelines and enterprise data quality frameworks
- Implement data governance controls, metadata management, lineage tracking, and data retention policies
- Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions
- Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques
- Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities
- Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts
- Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards
Skills
- Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline
- Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture
- Minimum three (3) years of hands-on Databricks experience in production environments
- Experience designing, developing, and supporting large-scale ETL/ELT solutions
- Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch
- Experience implementing enterprise data governance and security controls
- Strong SQL and Python development skills
- Experience working with data lakes, data warehouses, and cloud-native analytics platforms
- Strong troubleshooting, performance tuning, and optimization experience
- Databricks Certified Data Engineer Associate or Professional certification
- AWS Data Analytics Specialty certification
- Experience supporting federal government or highly regulated environments
- Experience with real-time streaming, CDC solutions, and event-driven architectures
- Familiarity with FedRAMP, FISMA, and NIST security frameworks
- Experience supporting large-scale enterprise data platforms
Company Overview