Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Damia Group Ltd
servers, 20,000+ database instances, and over 150 PB of data. As a Spark Scala Engineer, you will have the responsibility to refactor Legacy ETL code, for example DataStage into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Your responsibilities more »
Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, andETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve more »
Central and North West London NHS Foundation Trust
Extensive experience in data engineering, with expertise in designing, building & maintaining data pipelines, data warehouses, and/or data lakes. Significant experience in using ETL tools such as SQL Server Integration Services (SSIS) or an equivalent ETL/ELT tool, as well as T-SQL querying abilities, including writing stored … team's development standards. Supporting the development of technical BI skills across the wider Insight & Analytics department including, but not limited to T-SQL, ETL (SSIS and/or DTS) & Tableau. Work with the analytical teams & business users to develop high-quality data models for reporting & dashboarding purposes. Ensure data … links between different information sources to support more effective service planning, monitoring and delivery. Design, build, and maintain scalable data pipelines to ingest, transform, andload data from various sources (e.g., clinical systems, external data feeds) into the Trust's data platforms. a. To develop and extend expertise in database more »
London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines andETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data more »
Nottingham, Nottinghamshire, East Midlands, United Kingdom
Change-IT Consulting Ltd
of 3 years of experience in data engineering and data warehousing. Strong experience with Azure services. Strong understanding of data modelling, data warehousing, andETL/ELT processes. Experience with programming languages such as Python & SQL. Knowledge of Medallion Architecture Working with source control, especially GIT or TFS Working as more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Viqu Limited
Bundles (DAB's) for streamlining the development of complex data and analytics for the Databricks platform. (IaC) Strong understanding of data warehousing concepts andETL processes. Excellent problem-solving skills and attention to detail. Ability to work independently in a remote setup with minimal supervision. Role details: Job role: Senior more »
management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, andETL processes. Profound understanding of best practices in data governance, privacy, and quality. Exceptional skills in communication, leadership, and team management. Capability to handle multiple tasks more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Viqu Limited
Bundles (DAB's) for streamlining the development of complex data and analytics for the Databricks platform. (IaC) Strong understanding of data warehousing concepts andETL processes. Excellent problem-solving skills and attention to detail. Ability to work independently in a remote setup with minimal supervision. Role details: Job role: Databricks more »
strategy constraints. Essential Skills: The ideal candidates will have a proven Senior Data & Analytics Development background, with the following skills/experience: Knowledge of ETL/ELT, data warehousing/business intelligence methodologies and best practice including dealing with big data, cloud technology and unstructured data and the relative required more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Hays Technology
the company. You will be part of developing and creating the data sets needed for BI and analytics including, where needed, the data repositories, Extract/Transform/Load routines and validation mechanisms needed to underpin reporting and analysis. You will be establishing the integration with other databases and systems more »
London, Tottenham Court Road, United Kingdom Hybrid / WFH Options
Jumar Solutions
Data Experience: Competence in handling financial data, coupled with a solid understanding of accounting principles. Technical Skills: In-depth knowledge of dimensional modeling andETL processes. Agile Framework: Experience working within an Agile Scrum environment. Advanced Excel Proficiency: High-level skills in Excel for managing data exports. Desirable Qualifications: MS more »
data and BI products and will design and implement Data and Analytics solutions using Agile and equivalent methodologies. Experience and Skills Detailed knowledge of ETL, data warehousing, data modelling and experience dealing with big data Experience of data schema structures, design and how they can be correctly applied to deliver more »
and resolve any issues that may arise. Requirements: 5 to 10 years of experience as a Golang Developer Proven expertise in data warehousing andETL processes Hands-on experience with Go Programming and DBT Familiarity with Google Cloud Services Strong problem-solving and analytical skills Excellent communication and collaboration abilities more »
Manchester, North West, United Kingdom Hybrid / WFH Options
TALENT INTERNATIONAL UK LTD
per day (Outside IR35). You must be immediately available. Key Responsibilities: Analyse existing data sources, structures, and formats. Develop data migration strategies and plans. Extract, transform, andload (ETL) data using Aperture - (non-negotiable) Experience in Oracle SQL or previous SQL Developer roles. Ensure data quality and accuracy throughout more »
as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. Assess, analyse, data ingestion, transformation & storage layers (RAW more »
practices) in IT Experience working with CI/CD pipelines and Agile frameworks, preferably with the MLOps context. Unit Testing, Integration Testing, E2E Testing, ETL/ELT Experience or at least knowledge of the following: SciKit-Learn, TensorFlow, Torch, ChatGPT, Llama, LangChain (or equivalent), RAG, Model Security, Jupyter Notebook/ more »
data structures and pipelines to organize, collect, cleanse, and standardize data to generate actionable insights and address reporting needs. Using data mining techniques to extract information from data sets and identify correlations and patterns Lead the data modelling, data mapping and data solution testing activity on projects within the role … focused, with ability to meet agreed deadlines and delivery high quality output Technical Expectations Demonstrable experience of working in a data integration-related role, ETL processes and data warehousing principles A strong understanding and experience in key data modelling methodologies, techniques and concepts (dimensional modelling, entity relationship modelling, logical & physical … models) Experience with at least one of the reporting tool - QlikSense/Tableau/Power BI Proficient in SQL, ETL framework, Alteryx or similar technology, Python, GCP (Big Query), QlikSense preferred. Familiarity with Data Science concepts and subjects and an interest in up-skilling in the future Competencies Strong communicator more »
South East London, London, United Kingdom Hybrid / WFH Options
The Bridge (IT Recruitment) Limited
Python Developer, on a long term contract, inside IR35 on a remote basis. The key skills required for this Python Developer role are: Python ETL Azure Databricks Pyspark If you do have the required skills for this remote Python Developer contract, please do apply. more »
deployment, documentation, built in supportability, built in maintainability, re-use and extensibility) Specific experience of data solutions development addressing data extraction, transformation andload (ETL) processing and data analytics and reporting requirements. Familiar with Agile software development principles and practices and experience of delivery as a member of an Agile more »
and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics systems in the cloud. Responsibilities: Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure. Build data integration flows to migrate … Hands-on experience with AWS services like S3, EC2, and EMR. Proficiency in SQL and experience with CDAP, Spark, and Kafka. Experience building scalable ETL processes and workflows. Strong programming ability with Python, Java, and unit testing. Infrastructure-as-code expertise with CI/CD pipelines. Ability to communicate complex more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Uniting Ambition
The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as well as building and managing the infrastructure to do … all of the work. About your role: (50/50 split between Design & Development and Leading, coaching & Mentoring) You will have an extensive ETL/ELT background developing data pipelines, optimising queries, and enhancing overall data processing performance. You will also be experienced in data modelling/data warehousing. You more »
City of London, London, United Kingdom Hybrid / WFH Options
TALENT INTERNATIONAL UK LTD
months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The ideal candidate will have a strong background in handling big data, cloud technologies … deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services … Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and standards to ensure data security. Stay current more »
Data and Analytics Developer Overview We are seeking a highly skilled Data and Analytics Developer with extensive experience in ETL/ELT, data warehousing/business intelligence methodologies, and best practices. The ideal candidate will have a strong background in handling big data, cloud technology, and unstructured data, along with … a deep understanding of relevant tools and technologies. Key Responsibilities Demonstrate detailed working knowledge of ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. Handle big data, cloud technology, and unstructured data, employing appropriate methodologies. Understand and apply Kimball, Inmon, and hybrid data warehouse design principles. … Hubs, Data Lake, Synapse, and Azure SQL Server. Databricks and PySpark Development Develop in Databricks with experience coding in PySpark and Spark SQL. Ensure ETL code is standardized, self-documenting, and can be reliably tested. Apply best practice data encryption techniques and standards. Understand relevant national and international legislation pertaining more »
their team as part of an on-going project on a 12-month contract. You will have the following skills and experience: Knowledge of ETL& ELT, data warehousing/business intelligence methodologies. Experience handling big data, cloud technology and unstructured data. Star Schema structure & design, Kimball & inmon, and hybrid data … such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection Act, EU Procurement Directives, Freedom of Information Act. Tools andmore »
March 2025 Location: Leeds 20% Home 80% IR35: In scope The purpose of the Business Intelligence Analyst post is to: Create and support ETL processes that provide a stable, trusted source of data for all reporting and data requirements Create and maintain business intelligence (BI) reports and dashboards using available … Experience of complex data analysis using advanced knowledge of statistics, database design and BI systems tools Understand basic concepts of BI Architecture such as ETL, Data Warehousing and Data Modelling Ability to manipulate, model and analyse data using Excel, SQL, QlikView, Qlik Sense Experience developing reports using data visualisation tools more »