Note: The job is a remote job and is open to candidates in USA. Dice is seeking a Senior Data Engineer (AI) to join their team, offering a contract position through the end of 2026. The role involves building and maintaining enterprise-scale data pipelines, leveraging Azure data services and Databricks for data processing and integration.
Responsibilities
- Strong hands-on experience with Azure data services, including: Azure Data Lake Storage (ADLS), Azure Data Factory and/or Synapse Pipelines
- Deep experience with Databricks, including Spark / PySpark development and performance optimization
- Proven experience building and maintaining enterprise-scale data pipelines
- Experience integrating data from diverse enterprise systems (databases, APIs, cloud platforms)
- Solid understanding of data architecture principles, data modeling, and ETL/ELT patterns
- Experience with pipeline orchestration, automation, and monitoring
- Working knowledge of MLOps concepts, including supporting data workflows for model training and deployment
- Strong troubleshooting and performance tuning skills in distributed environments
- Familiarity with data governance, security, and access control frameworks
- Proficiency in Python and SQL
- Strong collaboration and communication skills
Skills
- 7+ years of professional experience (post-graduate) in data engineering or related field
- Strong hands-on experience with Azure data services, including: Azure Data Lake Storage (ADLS), Azure Data Factory and/or Synapse Pipelines
- Deep experience with Databricks, including Spark / PySpark development and performance optimization
- Proven experience building and maintaining enterprise-scale data pipelines
- Experience integrating data from diverse enterprise systems (databases, APIs, cloud platforms)
- Solid understanding of data architecture principles, data modeling, and ETL/ELT patterns
- Experience with pipeline orchestration, automation, and monitoring
- Working knowledge of MLOps concepts, including supporting data workflows for model training and deployment
- Strong troubleshooting and performance tuning skills in distributed environments
- Familiarity with data governance, security, and access control frameworks
- Proficiency in Python and SQL
- Strong collaboration and communication skills
Company Overview
Dice is a job-searching platform for technology professionals. It is a sub-organization of DHI Group. It was founded in 1990, and is headquartered in Santa Clara, California, USA, with a workforce of 201-500 employees. Its website is http://www.dice.com.Company H1B Sponsorship
Dice has a track record of offering H1B sponsorships, with 2 in 2022, 4 in 2021, 5 in 2020. Please note that this does not guarantee sponsorship for this specific role.