1 to 25 of 25 Permanent Data Lake Jobs in the North West

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. … their team. In this role, you will have the opportunity to work with cutting-edge technologies such as Bitbucket and AWS Data Lake while collaborating with a team of innovative individuals. As a Data Engineer, your main responsibility will be developing and maintaining data pipelines on Bitbucket using Bitbucket Pipelines. You will also use your knowledge of AWS data lake approaches to optimize performance by implementing Apache Iceberg tables. This is an exciting chance to gain experience in visualisation development using Power BI and working with MS SQL Server more »

Data Lead/Architect, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … an approval process in ADO for all schema changes Octopus Deploy and Azure ADO experience Azure experience - designing/implementing a data lake Data modelling - keeping ERD's up to date and assisting the Architecture team with database design Scripting tools such as PowerShell, Experience more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data … integration workflows. Strong understanding of data modelling, database design, and data warehousing concepts. Experience with data lake architectures and big data technologies. Hands-on experience with SQL and NoSQL databases. AWS certifications (such as AWS Certified Solutions Architect, AWS more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … Engineering. 1+ years in a Lead/Principal Engineer role. 3+ years of experience with GCP. Extensive experience with SQL and Data Lake/Warehouse solutions. Proficiency in languages such as SQL, Python, Java, or Scala. In-depth knowledge of query optimization techniques and experience in fine more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … years in a Lead/Principal Engineer role. l 3+ years of experience with GCP. l Extensive experience with SQL and Data Lake/Warehouse solutions. l Proficiency in languages such as SQL, Python, Java, or Scala. l In-depth knowledge of query optimization techniques and experience more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … roles - Demonstrated leadership experience. - Over 3 years of hands-on experience with Google Cloud Platform (GCP) - Deep expertise in SQL and Data Lake/Warehouse solutions - Advanced skills in programming languages such as SQL, Python, Java, or Scala - Extensive knowledge of query optimisation techniques and a proven more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … ETL/ELT background developing data pipelines, optimising queries, and enhancing overall database performance. Deep expertise in SQL and Data Lake/Warehouse solutions Advanced skills in programming languages such as SQL, Python, Java, or Scala Extensive knowledge of query optimisation techniques and a proven more »

part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR … and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of … Computer Science, Engineering, Mathematics or a related field Experience of IT platform implementation in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience more »

Data Analyst X 2 - Manchester Our Manchester client is looking for two Data Analysts to join our friendly and diverse team. Your role will involve turning data into insightful analysis and models to drive business growth. You will help develop customer analysis, provide insights … identify opportunities for strategic improvements. Key Responsibilities: Analyse and interpret large datasets to identify trends, patterns and insights Develop statistical models and perform data mining techniques to support business decisions Work closely with various teams across the organization to understand their data needs and provide appropriate … research on business challenges Generate reports from both structured and unstructured data in our Data Warehouse and Data Lake Assist in regulatory and compliance tasks by creating detailed reports Develop, prototype, and maintain reports in Power BI utilizing SQL and DAX Engage in more »

Lead Azure Data Engineer - Manchester - £60,000-£75,000 My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable … data insights to drive change across various business areas. Key Responsibilities: Develop and implement data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical … Skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data more »

term objectives. As an Automation Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Experience automating SQL Deployment into multiple environments more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

Job Title: Sr. Data Architect Location: Cheshire, United Kingdom Work Mode: Hybrid Package: Competitive + Benefits Start Date: ASAP Permanent Role: Yes Responsibilities: Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift Deliver … on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of existing applications and development … or a related field Advance experience of IT platform implementation in a technical and analytical role Good level of experience of Data Lake/Hadoop platform implementation Good level hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop more »

with a flexible working approach so everyone can thrive in an inclusive and open environment. The Role: We are currently recruiting for a Data & Analytics Lead to join the Avove IT business unit. As the Data & Analytics Lead, you will establish and build a Data and Analytics function within Avove to drive the creation of insights and value from all types of data analytics and ultimately improve the performance of the business (efficiency/productivity, revenue growth, margin improvement and customer satisfaction). Responsibilities: Lead the development and execution of the … roadmap for Data and Analytics, and BI alongside the Performance Insights Lead, across Avove. Work with the business to understand and map the driver trees, levers, and lead metrics for performance improvement. Develop and create the data sets needed for BI and analytics including, where needed more »

Their goal is to deliver maximum value for every expenditure, ensuring efficiency and effectiveness in every project. In this role, you will transform data into valuable insights and models that drive business growth. Your contributions will be essential in analysing historical performance, ensuring regulatory compliance, forecasting future trends … Partner with stakeholders to conduct thorough research into business challenges and deliver iterative solutions. Report Generation: Develop comprehensive reports from structured and unstructured data within the Data Warehouse and Data Lake. Regulatory Compliance: Support regulatory and compliance efforts through detailed data analysis … and reporting. Data Visualisation: Design, prototype, and maintain Power BI reports using SQL and DAX to meet business needs. Agile Workflow: Operate within an Agile Kanban framework, reviewing, testing, and deploying solutions with source control. Product Team Collaboration: Collaborate with product teams to prioritise requests, define requirements, and more »

occasional office travel Circa £70,000k The client is looking for a Power Bi Developer to design and develop Business Intelligence solutions using data from Microsoft Dynamics 365. You'll be liaising with the central BI and Data teams to ensure a consistent approach whilst analysing … Power BI Desktop, Power BI Service, Datasets, Dataflows, DAX, M, Power Query) Dynamics 365 CRM - Sales, operations, marketing - development experience Azure Data Lake Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. more »

We're on the hunt for a top-tier Data Product Manager obsessed with all things data product, BI & AI centred to join the exhilarating journey of a cutting-edge digital tech company's Data Tribe! Workplace Policy | Location: Hybrid Working between … up to £55,000 You will play a key role in delivering outcomes and quantifying real customer problems. Utilising the brand's extensive data, you will lead the product management framework and define/solve customer problems using BI & AI. Excellent communication and product management skills are essential … a great client... what more could you ask for? What else will you be doing? Take ownership of all aspects of the new data platform and ensure it remains aligned with the rest of the business Uncover and measure real customer issues using data analysis tools more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »