1 to 25 of 188 Data Lake Jobs in England

ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … Purview or another governance tool experience. Familiar with building Catalogs and lineage Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

what role you come in and do, we will have a plan targeted to help you advance. What you’ll do As a Data Architect will be required to analyse an array of product offerings and business requirements within Mercury, to create and own the overall data architecture spanning the Mercury product suite. You will work with the product development teams (e.g. Core, Web, Integration, Data Practice and product owners) to evaluate and identify solutions that meet the needs of the business and customers, utilising industry standard best practices, patterns and creative design … support of Microsoft cloud-based services and products including (but not limited to): Azure Fabric Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Azure Storage Azure AI Search Azure Cosmos DB Azure SQL, Azure DW, Synapse and Azure Analytics more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

s biggest brands, including Uber, Major League Baseball, NHS, Disney, Standard Chartered, Mediacom and British Airways. Our services support the whole organisation with data-driven performance insights for leaders, training for managers, wellbeing tools for all employees, as well as access to a global network of accredited mental … hiring process more accessible, just let us know when you apply, or email talent@unmind.com. The Role – Analytics Engineer The core mission of data analytics is to provide actionable insights to all Unmind Teams that drive product and business decisions that build the best version of Unmind. As … within reports that surface relevant trends. In this role you'll get to: Own - You will take the architectural lead for the key data models in the company, and guide your team in finding the right balance between technical excellence and delivery of value that brings you closer more »

Job Title: Sr. Data Architect Location: Cheshire, United Kingdom Work Mode: Hybrid Package: Competitive + Benefits Start Date: ASAP Permanent Role: Yes Responsibilities: Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift Deliver … on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of existing applications and development … or a related field Advance experience of IT platform implementation in a technical and analytical role Good level of experience of Data Lake/Hadoop platform implementation Good level hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop more »

reporting and analysis using various systems, primarily Power BI. Additionally, you'll support the MI Manager in building and overseeing the reporting and data infrastructure for the Next Customer Service Online Operations across our contact centers. What you'll be doing: Take ownership of report implementation from understanding … through to development and implementation. Support project with expertise and knowledge of reporting systems advising of best practices and optimum set up of data structures. Create, analyse and then provide accurate management information/reporting and forecasting as required by the department/business on a daily/… Experience of working with Contact Centre Metrics. Experience of change management. Experience in working with Microsoft Azure Platform eco-system ( Azure data lake , Azure data factory, Azure Synapse Analytics , Data bricks , Power BI etc) would be highly desirable. Experience in Data more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as … being able to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining … a Data Engineer, preferably on the Azure platform. Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and more »

I am looking for a Machine Learning (ML) and Data Engineer to join my clients growing Data & AI team and contribute to Artificial Intelligence technology solutions for their public sector and enterprise clients. This role is offering a generous salary of up to £70K! As a … ML and Data Engineer, you will collaborate with a team of data scientists, data architects, software engineers, business analysts and delivery managers to deliver innovative solutions that leverage the power of cloud-based AI. This is an exciting opportunity for a driven individual to … Microsoft Azure AI services. Experience with Azure data and analytics services, such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, etc Experience with Azure DevOps, GitHub, or other tools for version control, testing and deployment. This is an more »

will develop superior digital and technology concepts and architecture solutions as well as support technical implementations actively and on site, applying your sound Data/Cloud technical know-how, your understanding of business contexts, along with your analytical and conceptual skills. As you acquire experience, you will be … technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment • Experience with … code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific more »

Synapri collaborates with a large transport company, who is seeking a Senior Data & Analytics Developer for a 12 months contract. You will be involved in the design, development and configuration of applications, components and tools according to the technical plans set by the Development Technical Lead. Knowledge and … experience required: In-depth working knowledge of ETL/ELT, data warehousing/business intelligence methodologies including dealing with big data, cloud technology and unstructured data Knowledge of star schema structure & design, detailed understanding of Kimball & Inmon and … hybrid data warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code more »

for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor’s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of superior … data services The Data Analyst for Data Operations will be responsible for managing stakeholders, gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. Working early some mornings, on a scheduled basis to monitor overnight operational batches and resolve more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data … AWS cloud, including Platform-as-a-Service, server-less, and container technologies. • Diverse skills in ETL, data warehouse, and Data Lake design. • Familiarity with various tools, cloud technologies, and approaches. • Expertise in AWS or equivalent open-source tools. • Proficient in defining the end-to-end more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … people really love; and, importantly, a career model that lets you take control of your development and progression. OUR VISION To be the data analytics company most admired for its people, culture and innovation. THE ROLE The primary focus for you will be the design and delivery of … DAX Data Modelling/Data Warehouse Theory Nice to Have Azure Modern Data Platform Services (Data Lake, Data Factory, Databricks, Synapse) Azure DevOps/CI/CD/YAML/ARM/Terraform MSBI Traditional Stack (SQL, SSAS, SSIS more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … Engineering. 1+ years in a Lead/Principal Engineer role. 3+ years of experience with GCP. Extensive experience with SQL and Data Lake/Warehouse solutions. Proficiency in languages such as SQL, Python, Java, or Scala. In-depth knowledge of query optimization techniques and experience in fine more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

Data And Reporting Lead Main Job Purpose OmniTech is working with a confidential client to source a Data & Reporting Lead. The potential candidate will be supporting the development of business intelligence solutions using Microsoft Power Bi to the business. We have a mature reporting environment that … Microsoft application stack and works using the Agile Scrum Development methodology. The role compromises the following activities: • Various Integration activity (ETL) using Azure Data Factory, SSRS and C#. Connecting multiple data sources to our Datawarehouse and integration into our data model • Data … Management Server, SSRS, SSIS and other related systems • Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc • Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc • ETL Related experience more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or … the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team … Microsoft Azure experience Proficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc. Strong Python and SQL skills for data manipulation Experience with Apache Spark and/or Databricks. Familiarity with BI visualization tools more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … Essential Requirements: Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset. Familiarity more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

Lead Azure Data Engineer - Manchester - £60,000-£75,000 My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable … data insights to drive change across various business areas. Key Responsibilities: Develop and implement data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … a career model that lets you take control of your development and progression. So, if you want to do some great things in data analytics (and have some fun at the same time), welcome to Adatis. OUR VISION To be the data analytics company most admired … role will vary depending on the project but will primarily focus on the delivery of enterprise-level applications in the Business Intelligence and Data Analytics arena. This is a client-facing position, so the ideal candidate must be comfortable speaking with clients and some occasional travel. Our offices more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. … designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with more »