Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks Lakehouse Platform, working closely with our … impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools … to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve as a Databricks SME, sharing knowledge, technical guidance, and troubleshooting. Basic skillset requirements - Proven experience in AWS and/or Azure data migrations - Databricks architecture, components more »
Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine Learning and Cryptography products). Ability to deliver product presentations, and showcase software more »
Employment Type: Contract
Rate: From £1,100 to £1,300 per day Outside of IR35
with A/B testing platforms Essential: Knowledge of querying and transforming data using SQL Preferred : Familiarity with cloud based analytical platforms such as Databricks Familiarity with SaaS ecommerce platforms You might not tick all the boxes, and thats okay, we still encourage you to apply. Here at Brompton we more »
Greenford, London, United Kingdom Hybrid / WFH Options
Brompton Bicycle
unstructured datasets, and different types of data pertaining to a number of departments across Brompton (Finance, Planning, Commercial). Experience of working with Azure Databricks, B2B/B2C/D2C business models and FiveTran will stand you in good stead. Our team work in 2-week sprints, so experience of … data models that enhance data accessibility and facilitate deeper analysis. Implement and manage Unity Catalog for centralized data governance and unified access controls across Databricks Maintain technical documentation for the entirety of code base. End to end ownership of the Data Engineering Lifecycle. Implement and manage Fivetran for efficient and … equivalent experience. Extensive experience as a Senior Data Engineer/Cloud Data Architect, or similar role. Deep knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD Extensive experience migrating on-premises data warehouses to the cloud. Proficiency with Spark, SQL, Python, R, and other data engineering more »
