Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »
City of London, London, United Kingdom Hybrid / WFH Options
Concept Resourcing
salesforce projects. Key Responsibilities: Architecture, modelling and leadership skills Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity more »
team members. Requirements: experience as a Data Engineer, preferably in the fintech or related industry. proficiency in Azure services, including Azure Data Factory, Azure Databricks, and Azure SQL Database. communication skills with the ability to effectively engage with stakeholders at all levels. experience in gathering and documenting business requirements. in more »
Experience of an Agile project environment.• Ideally exposure and experience of data and analytics products and services (SQL and NoSQL databases, data lake, Synapse, Databricks, PowerBI).• Strong leadership and communication skills with both business leaders, subject matter experts and technical partners.• Act as the focal point for other staff more »
options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure Service bus, Azure Functions, Event Hub, Synapse and Azure Purview. Excellent understanding of Microsoft more »
What are we looking for? Essentials Experience building high quality Business Intelligence products and solutions Good understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, good understanding of ETL and ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand more »
DevOps pipelines and scripting such as terraform and bash. Knowledge of a broad range of Data PaaS and SaaS tools within Azure, such as Databricks, Azure data factory, Event Grid, Mail Grid, etc. and creating frameworks on top of them. Proficiency in programming languages such as Python, Java, or Scala. more »
in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »
step into that for the first time! Previous management is not essential at all! Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is more »
testing tools, and documentation best practices Adheres to quality engineering practices including TDD and BDD Nice to have: Kubernetes EKS/AKS/OpenShift Databricks Experience Log Analytics SSO experience Recent Java experience I will be reviewing profiles on Wednesday and Thursday morning, please apply by then to be considered more »
data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns more »
software development principles. Extensive experience with Azure AI solutions, including Azure Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or more »
varying levels of experience Flexibility and willingness to adapt to new software and techniques Nice to Have Experience working with projects in Apache Spark, Databricks of similar Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities?A technical expert and leader on the Petcare D&A Platform more »
varying levels of experience. Flexibility and willingness to adapt to new software and techniques. Nice to Have Experience working with projects in Apache Spark, Databricks of similar. Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities? A technical expert and leader on the Petcare D&A Platform more »
varying levels of experience. Flexibility and willingness to adapt to new software and techniques. Nice to Have Experience working with projects in Apache Spark, Databricks of similar. Expert cloud platform knowledge, e.g. Azure What will be your key responsibilities? A technical expert and leader on the Petcare D&A Platform more »
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near Victoria station … on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business … including SQL Data Warehousing, ETL and Data Integration solutions Strong experience designing and developing data pipelines using Azure Data Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary more »
Edinburgh office, typically 3 days a week from home and 2 day in office/on client site. Preferred skills: Experience with Azure and Databricks Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience more »
work in London 3 days a week, have a valid visa as we Are not able to sponsor Technical Stack:- Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow Skills years of experience in python scripting. in developing applications in Python language. to python-oriented Algorithm more »
working as a Machine Learning Engineer. Strong proficiency in Python programming language. Hands-on experience with Azure cloud services, including Azure Machine Learning, Azure Databricks, and Azure Synapse Analytics. Knowledge of machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Experience with version control systems such as Git. Excellent more »
designing data pipelines and ETL processes Previous experience of data warehousing Utilise SAS for data reporting and analysis Skilled in SQL, Python, Git and Databricks In depth experience of reporting in Power BI Excellent stakeholder management skills Desirable Experience of working within a consultancy environment A Bachelors or Master’s more »
practices. A team player with excellent communication & collaboration skills. Desirable: Experience developing and maintaining data warehouses/lakes using big data solutions (e.g., Snowflake, Databricks). Familiarity with SQL Server, PostgreSQL or NoSQL database technologies. Previous experience within banking or finance desirable, but by no means necessary. If you're more »
Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Pyspark, Databricks Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance. Please apply today or get more »
of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex more »
or customer experience-related problems such as workforce management, demand forecasting, or root cause analysis Strong visualisation skills including experience with Tableau Familiarity with Databricks and PySpark for data manipulation and analysis Familiarity with Git-based source control methodologies, including branching and pull requests A self-starter, passionate about converting more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge more »
