modelling and software implementation. in specifying and delivering large, complex business transformation programmes, with budgets exceeding £1m. of data principles including ETL (extract, transformandload) pipelines, integration methods and data migration techniques. verbal and written communication skills to adapt to technical and non-technical audiences. of creating an inspiring more »
scalable and reliable data pipelines and platforms using various technology solutions. Extract, transform, andload (ETL) data from various sources and formats. Build and maintain ETL pipelines Ensure data quality, integrity, and security by applying data governance and validation rules. Optimise data performance and efficiency by tuning, partitioning, indexing, and … Hands-on experience in designing, planning, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments. Skilled in data integration, ETL processes, and ensuring data quality. Capable of turning data into insights using visualisation and reporting tools. Able to effectively document business use-cases, data sources more »
Milton Keynes University Hospital NHS Foundation Trust
updated to meet the specific needs of the Trust, as directed by the Database Warehouse Manager. This may include monitoring and analysing highly complex Extract, TransformandLoad (ETL) processes and managing the Microsoft SQL databases. Investigate and identify complicated database related issues and make suggestions for solutions and implement more »
in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
RDS (SQL Server) toolsets. Experience with transactional reporting solutions for critical business reporting. Experience with dimensionally modelled databases for analytics use cases. Knowledge of ETL tools and approaches. Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS. Experience with Python for scripting and automating data tasks. more »
Penrith, Cumbria, United Kingdom Hybrid / WFH Options
Computer Futures
engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to acquire and prepare data and that it adheres to Best Practice. (Extract, Transform, Load) Contributes towards and ensures the delivery of the creation and maintenance of data pipelines to connect data within and between data stores, applications more »
in different formats, including CSVs and structured tables.• Microsoft BI toolset, including O365 tools and Power Platform (Powerapps/Powerautomate/PowerBI) • Azure cloud ETL toolset, including Azure SQL Server, Azure Data Factory, Datalake. • Cloud infrastructure including Microsoft Azure Cloud infrastructure, Identity & Access Management, data stores connections, cloud functions concepts. more »
Manchester Area, United Kingdom Hybrid / WFH Options
Adria Solutions Ltd
RDS (SQL Server) toolsets. Experience with transactional reporting solutions for critical business reporting. Experience with dimensionally modelled databases for analytics use cases. Knowledge of ETL tools and approaches. Hands-on experience with AWS technologies, including Lambda, SQS, Event Bridge, S3 & RDS. Experience with Python for scripting and automating data tasks. more »
Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of the BI team you will more »
the data warehouse meets business needs and performance standards. Responsibilities: Design and develop data models and schemas for the data warehouse. Build and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources. Develop complex SQL queries and scripts to ensure efficient data retrieval and manipulation. Responsible for … ensure proper integration of the data warehouse with other systems. Maintain and support existing data warehouse infrastructure. Develop and maintain documentation for data models, ETL processes, and workflows. Provide support for data-related issues and ad hoc queries from end-users. Requirements: Minimum 3-5 years’ experience developing and implementing … within financial services (ideally Consumer Credit). Proven experience in data warehousing, data modelling, and database design. Proficiency in SQL (SSMS) and experience with ETL tools (e.g., SSIS, SAS DI, Informatica, Talend). Experience with data warehouse platforms (e.g., Microsoft SQL Server, Amazon Redshift, Google BigQuery, Snowflake). Familiarity with more »
technical field (e.g. Computer Science, Statistics, Engineering). · 7+ years of relevant experience in building DW/BI systems · Demonstrated ability in data modeling, ETL development, and Data warehousing. · Strong experience with Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) · Expertise in a BI solution like Power BI · Hands more »
Synapse Data Engineering, Synapse Data Warehouse, Python, One LakeWorking knowledge of Microsoft Azure CloudGood knowledge of data management principles, including data modelling, data integration, ETL (Extract, Transform, Load) processes, data governance, and data securityExperience building data platform components to support a business needStrong attention to detail and analytical skillsStrong written more »
Engineering, Synapse Data Warehouse, Python, One Lake Working knowledge of Microsoft Azure Cloud Good knowledge of data management principles, including data modelling, data integration, ETL (Extract, Transform, Load) processes, data governance, and data security Experience building data platform components to support a business need Strong attention to detail and analytical more »
Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools. Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions. more »
practices. • Extensive experience with SQL databases, including complex queries and stored procedures. • Experience with SSIS, SSRS, and SSAS. • Strong understanding of data warehousing concepts, ETL, and data modelling. • Familiarity with statistical analysis, data visualization, data mining, and data transformation. • Power BI certification is a plus. • Proven problem-solving skills andmore »
Coordinating the work of business, IT, and external teams to deliver the required results. Perform Feasibility, Impact Assessment, Estimation, Planning, Design and Delivery of ETL Migration projects. Documentation Review, ensuring that work produced by the teams conform to methods, designs, and standards so that economies of scale can be achieved … meaning of the data. Design, estimate, plan and implement the data migration projects from one platform/tool to another. Utilize Azure environment to extract, transform, andload (ETL) data from various sources. Design and implement data models, ensuring data accuracy, consistency, and integrity. Perform data analysis to identify trends … not limited to, SAP ERP, SAP BW, SAP HANA, Marketo, Salesforce etc. Collaboration with different teams, Requirement Gathering, Design and Delivery of Technical solutions. ETL migration project planning, estimation, and delivery Adeptia, Snaplogic ETL migration experience Hands on experience on Azure, ADF, ADLS, Synapse more »
skills. Responsibilities required for the role of Data Warehouse Developer Design and develop data models and schemas for the data warehouse. Build and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources. Develop complex SQL queries and scripts to ensure efficient data retrieval and manipulation. Responsible for … with ad hoc requests such as reporting, hardware refreshes etc. Maintain and support existing data warehouse infrastructure. Develop and maintain documentation for data models, ETL processes, and workflows. Provide support for data-related issues and ad hoc queries from end-users. Experience required for the role of Data Warehouse Developer … Warehouse solutions for managing data and information Proven experience in data warehousing, data modelling, and database design. Proficiency in SQL (SSMS) and experience with ETL tools (e.g., SSIS, SAS DI, Informatica, Talend). Experience with data warehouse platforms (e.g., Microsoft SQL Server, Amazon Redshift, Google BigQuery, Snowflake). Familiarity with more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Damia Group Ltd
servers, 20,000+ database instances, and over 150 PB of data. As a Spark Scala Engineer, you will have the responsibility to refactor Legacy ETL code, for example DataStage into PySpark using Prophecy low-code no-code and available converters. Converted code is causing failures/performance issues. Your responsibilities more »
development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services more »
SE1, Chaucer, Greater London, United Kingdom Hybrid / WFH Options
Royal College Of Obstetricians And Gynaecologists
through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETLand reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »
Better Placed Ltd - A Sunday Times Top 10 Employer in 2023!
Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling andETL/ELT concepts. Strong problem-solving and troubleshooting skills. Excellent communication and collaboration skills. Data Engineer – London more »
of team, including ways of working, engineering principles, data governance and best practice. Become an SME on the design, development, and deployment of data ETL pipelines (using Azure Data Factory and other technologies) to access, combine andtransform data from on-prem and cloud-based sources. Ensure that all data more »
Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, andETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve more »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Change Digital – Digital & Tech Recruitment
in front-end visualisation tools - Power BI Experience with Azure Databricks Strong skills in data storytelling and dashboard creation Understanding of backend data processes (ETL, data integration) Experience with SQL, Python, Git Additional skills: Excellent communication and stakeholder management skills Ability to translate complex data into actionable insights. Strong analytical more »
Azure resources like Data Factory, Databricks, Data Lake, SQL Database, and SQL Data Warehouse. Senior-level experience in data engineering, including designing data models, ETL pipelines, and conducting testing/QA. Experience with Azure DevOps, including best practices in source control, CI/CD, and change control. Why Join Us more »