26 to 50 of 73 Data Lake Jobs in the UK excluding London

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR … and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of … Computer Science, Engineering, Mathematics or a related field Experience of IT platform implementation in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience more »

Data And Reporting Lead Main Job Purpose OmniTech is working with a confidential client to source a Data & Reporting Lead. The potential candidate will be supporting the development of business intelligence solutions using Microsoft Power Bi to the business. We have a mature reporting environment that … Microsoft application stack and works using the Agile Scrum Development methodology. The role compromises the following activities: • Various Integration activity (ETL) using Azure Data Factory, SSRS and C#. Connecting multiple data sources to our Datawarehouse and integration into our data model • Data … Management Server, SSRS, SSIS and other related systems • Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc • Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc • ETL Related experience more »

Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Vivo Talent are engaged with an organisation who is going through a huge transformation in how their data is used and managed. They require a Data Architect who is passionate … utilising their understanding of Azure data tools to implement and maintain an effective platform. Skills Azure Stack (SQL, Synapse, Data Lake) Power Bi Demonstrated experience in a similar position Strong stakeholder management skills both internal and external If you are interested in hearing more about … this opportunity, please get in touch. Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent more »

reporting and analysis using various systems, primarily Power BI. Additionally, you'll support the MI Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centers. What you'll be doing: Take ownership of report implementation from understanding … through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data … data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. Participate in code reviews and provide constructive feedback to peers. Required Skills and Experience more »

Data Analyst X 2 - Manchester Our Manchester client is looking for two Data Analysts to join our friendly and diverse team. Your role will involve turning data into insightful analysis and models to drive business growth. You will help develop customer analysis, provide insights … identify opportunities for strategic improvements. Key Responsibilities: Analyse and interpret large datasets to identify trends, patterns and insights Develop statistical models and perform data mining techniques to support business decisions Work closely with various teams across the organization to understand their data needs and provide appropriate … research on business challenges Generate reports from both structured and unstructured data in our Data Warehouse and Data Lake Assist in regulatory and compliance tasks by creating detailed reports Develop, prototype, and maintain reports in Power BI utilizing SQL and DAX Engage in more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or … the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … Microsoft Azure experience Proficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc. Strong Python and SQL skills for data manipulation Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools more »

Title: Data Lead/Architect Location: Manchester Salary: £55K to £75K (DOE) + Benefits Terms: Permanent, Full Time Work Pattern: Hybrid, 2 Days P/W We are looking for a Data Lead/Architect to join our client in Manchester. As a … Data Lead/Architect, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration more »

We are searching for an experienced Data Engineer for an outstanding technology focused business based in Devon. The role is offered on a hybrid working basis, so to be considered for the vacancy you need to either live within a commutable distance of Exeter/East Devon or … Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell Azure AWS PowerBI/Power BI Data Lake We are looking to speak with candidates who are good team players and communicators, people that are happy to present their ideas in meeting … Engineer, Databricks, Python, TSQL, T-SQL, Test Automation, Unit Testing, Mocking, Refactoring, Agile, Scrum, PowerShell, Azure, AWS, PowerBI, Power BI, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this more »

Lead Azure Data Engineer - Manchester - £60,000-£75,000 My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable … data insights to drive change across various business areas. Key Responsibilities: Develop and implement data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical … Skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data more »

term objectives. As an Automation Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Experience automating SQL Deployment into multiple environments more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

Job Title: Data Platform Administrator Location: Edinburgh (hybrid) Company: Primis is currently partnered with a leading technology company dedicated to delivering innovative solutions that empower businesses in the UK. Their team is comprised of talented individuals who thrive in fast paced environments and are passionate about pushing the … boundaries of technology and creating meaningful impact. Position Overview: We are looking for an Data Platform Administrator, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. As well as the day-to-day you … database administration team. Essential skills : Experienced in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling Solid monitoring and tuning skills in highly available transactional or API-centric environments Working with large-scale, uptime more »

Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in a fast paced … and dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills An appreciation for the … big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including having a working knowledge more »

a business who have made great strides in investing in their IT function and who have stated that being led and driven by data is one of their core business aims. You will be integral to this and will be responsible for establishing and building the Data & Analytics function from scratch - you'll design, own and implement the Data Science and Data Analytics strategy as well as selecting and implementing the tools that will enable them to improve the performance of the business. Salary: £65,000-70,000 The Role: The … work with. The Tech stack is new and investment within the business is there to enable you to establish and build a successful Data/Analytics functions. Key responsibilities include: - Lead the development and execution of the roadmap for Data and Analytics - Work closely with key more »

Define Architecture standards and principals • Translation for business requirements into Data Design, technical specifications • Data migration, strategy, mapping/lineage, quality, standards across multiple projects and solutions • Work closely with the development team to design and implement data solutions • Being able to recommend the … best place to source data sets, both internal and external to the organisation • Ability to capture and document standards and designs that can be easily understood for all stakeholders (DBAs through to CIO) • Data migration and the ability to be consulted … with data movements for data performance and optimisation • Microsoft experience (SQL DW/Cosmos DB/Azure Data Lake) • Working collaboratively with stakeholders, colleagues, and strategic partners across a portfolio of projects more »

About The Role We are recruiting for a Senior Technical Data Analyst to join our team. Our Technical Data Analysts work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Technical Data Analysts are involved in creating data-specific solutions to ensure we have the right information and data to make informed decisions. Stakeholder engagement is key, and collaborating within your technical squad and alongside colleagues from other professions is fundamental. Your role in a nutshell … Draw actionable insights from multiple, large sources of data and communicate these effectively through reports, dashboards, and presentations. Engage with client stakeholders to understand their business and organizational needs and translate these into clear requirements for your analysis. Identify opportunities for the use of advanced analytics techniques (e.g. more »

Job Title: Sr. Data Architect Location: Cheshire, United Kingdom Work Mode: Hybrid Package: Competitive + Benefits Start Date: ASAP Permanent Role: Yes Responsibilities: Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift Deliver … on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of existing applications and development … or a related field Advance experience of IT platform implementation in a technical and analytical role Good level of experience of Data Lake/Hadoop platform implementation Good level hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits • Up to 10% matched pension scheme with Standard Life • Death in Service: 4 x salary • Annual Car Parking permit • Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills • Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences • Experienced in working Microsoft Cloud Data and Automation technologies • Experienced working with Tableau and or Power BI • Experienced in data more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits Up to 10% matched pension scheme with Standard Life Death in Service: 4 x salary Annual Car Parking permit Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences Experienced in working Microsoft Cloud Data and Automation technologies Experienced working with Tableau and or Power BI Experienced in data more »

the impact on user experience of a range of clinical and non-clinical features. Key duties: Proposing a range of innovative, cost-effective, data collection techniques to quantify benefits and usage of software products in a complex fast-moving environment. Planning, documenting, and conducting suitable experiments to test … hypotheses on the usage and benefits of Blatchford products. Recruiting suitable individuals for studies. Ensuring data is collected in line with patient privacy stipulations and relevant legislation. Facilitating a range of data collection forums. Collating information, writing documents and reports to provide insights and information to … inquisitive, and eager to learn. Familiar with agile software development cycles and ceremonies Understanding of Business Intelligence, Data Warehouse, Data Lake concepts Experience and interest in analysing human performance data. Strong communications and interpersonal skills. This is a fantastic opportunity to work as part of more »