1 to 25 of 49 Data Lake Jobs in the South East

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … scalable data solutions aligned with business requirements.Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services.Develop, optimize, and maintain data pipelines for automated data integration from various … Engineer and/or BI Developer.Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake.Strong data engineering and data modeling skills, with the ability to craft complex data models.In-depth more »

note: you must have the right to work in the UK without the requirement of a Skilled Worker Sponsorship. Duties and Responsibilities Perform data analysis and modeling for development and maintenance projects; participate in the development of standards and procedures affecting Dynamics reporting. Provide development, support, maintenance, governance … storage, processing, and analytics. Azure Synapse Serverless Leveraging Azure Synapse Serverless for scalable and cost-effective data analytics. Data Lake, Lake House and Delta Lake Experience Familiarity with Data Lake and Delta Lake technologies for storing and processing … of years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake Experience Following Tools Experience : Microsoft Power BI Synapse Paginated Report Builder Power Platform KBR Company Information When you become part of the KBR team more »

Senior Data Architect About Mars Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN’S ORIGINAL … Associates into taking action every day towards creating the world we want tomorrow. Job Description: We are searching for an experienced Senior Data Architect to join our team and lead our data architecture initiatives. The ideal candidate will possess a deep understanding of data … techniques, database normalization, and denormalization strategies. Strong understanding of data integration patterns, ETL processes, data warehousing, and data lake architectures. Experience with a variety of database systems, such as relational databases (e.g., SQL Server, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity more »

D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … warehouse/BI projects.4+ years' experience working with Data Analysis Expressions (DAX)Extensive experience with SQLExperience with Data VerseData Lake, Lake House, and Delta Lake ExperienceResponsibilities:Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and reporting … dashboards, and generate insights that drive business decisions.SQL Experience for ETL: Designing and executing Extract, Transform, Load (ETL) processes using SQL to facilitate data integration and reporting.Azure Resource Procurement: Procuring resources in Azure Portal to support data storage, processsing, and analytics.Azure Synapse Serverless Leveraging Azure Synapse more »

Job DescriptionAre you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you!Position: Lead Data EngineerResponsibilities:Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency.Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to … continuity.Skills and Experience:Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight.Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases.Strong experience in designing, implementing more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

Job DescriptionLead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/CharityRate: £500-650 per dayDuration: 6-12 monthsIR35: OutsideLocation: Remote with occasional travel to London (Once every two months max)Essential skills required:Azure – solid experience required of the Azure Data ecosystemPython - ESSENTIAL as PySpark is used heavily. You will be tested on PySparkAzure Synapse - ESSENTIAL as is used heavilySparkAzure Data Lake/Data Bricks/Data FactoryBe happy to act as a lead and mentor to the other permanent Azure Data … and lineageThis is an urgent contract, so if you are interested apply ASAP.Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

understand business requirements and designing integration solutions to connect Dynamics 365 Finance and Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies … such as X++, C#, SQL, XML, JSON) to create seamless data flow and functionality between different systems. API Development: Utilizing APIs (Application Programming Interfaces) provided by Dynamics 365 Finance and Operations and other systems to facilitate data exchange and communication between them. Data Mapping … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

Data is crucial to providing a first-class service to our customers and managing our business effectively. The Data Quality Team has a proud history of working with colleagues across numerous business units to help influence behaviour and decisions at all levels of the organisation in … expanding its influence into more of the business's key strategic projects in 2024 and beyond. As well as ensuring that business-critical data is fit for purpose, the team is also responsible for the purchase of third party marketing suppression and enhancement data. We continually assess the … business' use of these assets. Strong technical skills encompassing the ability to understand data from source systems and the data lake, interrogate this data competently using SQL-based code, build automated reports in PowerBI and communicate the results in a timely manner to more »

Azure Developer (C#, DevOps, Data Lake, Logic Apps) Havant, Portsmouth (1-2 days per week in the office). £45000 - £62000 + Benefits Your new company I’m working with an energy provider with a focus on modern DevOps practices that have considerably grown their Development team … Azure Developer strong fundamental C#. Deep knowledge of Azure is essential – Azure DevOps (Functions, Redis, Service Bus etc), plus knowledge of Data Lake, Logic Apps, Power BI etc. Working here you’ll use the latest versions of .Net daily to build complex applications. You should have good more »

Job DescriptionKey ResponsibilitiesAssist the Data Team Lead in system improvements.Develop, maintain, and troubleshoot software components.Identify and solve data/software issues.Collaborate with stakeholders and peers.Plan tasks and deployments.Conduct peer reviews and advocate for best practices.Ensure compliance with IT and Security policies.Essential Technical Skills2 … years Azure data systems experience.Proficiency in traditional Data Warehouse tools.Understanding of Dimension Modelling.Strong SQL skills.Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions.Essential ExperienceSupport for Data Warehouses.Building Azure data pipelines.Agile methodology experience.Problem-solving skills.Awareness of industry more »

Job DescriptionData Integration ManagerA brand new and exciting opportunity has recently arisen for a Data Integration Manager with excellent knowledge in Azure and Salesforce SQL to join one of the UK's most notorious Charities.We're in search of an … experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will oversee the entire data flow process, including cleansing, harmonization, and integration into Salesforce NFP … Cloud and Marketing Cloud.Proficiency in data management technologies, especially Azure Data Lake, Salesforce NFP, and Azure Data Factory, is essential for this role.Skills that are required for a Data Integration Manager are:Expert in AzureExperience working with data flowsGreat more »

Job DescriptionSenior Data Engineer - AzurePaying up to 70KHybrid: 2 days onsiteAbout the RoleMy food retail business client is looking for a senior Data Engineer to join the team. My client operate on a global scale, but their Data and Analytics function embodies the dynamic … resources, and significant career progression opportunities as part of our technology transformation journey.Paying up to £70KHybrid (2 days onsite)Main DutiesDesign and deliver data pipelines.Build and manage Azure Data Factory data flows.Ingest data into an Azure Data Lake.Design data … Services (SSIS) and other ETL tools.Develop solutions with SSIS, SSRS, T-SQL (On-prem/Cloud).Manage NoSQL environments, Data Lakes, and Lake-Houses (e.g., Cassandra, MongoDB, Neptune).Use Python for data engineering tasks.Apply statistical principles to interpret data and develop models.Handle high more »

Job DescriptionMaster Data Transformation Lead12 Month ContractOur Global Retail Client has a brand new role as a Master Data Programme Lead to oversee every aspect of a programme from conception to implementation.You will provide expertise, tools and frameworks to ensure successful delivery of programme objective to … and in function especially in cases of high demand where value is at risk and additional effort is needed.Programme Experience & SkillsMaster dataLed Master Data strategy and implementation programs focused on creating a Master Data Function and Governance at Group level to achieve a high level of … volume, data environments designed for analytics and CRM use cases.Led projects to select, design, implement and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake, Cloudera, Spark, MongoDB more »

Job DescriptionLead Data Engineer - Azure/Spark/DatabricksRole: Lead Data EngineerLocation: London (3 days a week)Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this … engineering stack. Key Responsibilities:Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks.Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices.Lead and mentor a team of … effectively with remote teams, leveraging your experience in leading distributed teams to drive success.Requirements:Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks.Proficiency in coding with Spark and a strong understanding of design aspects.Deep understanding of engineering best practices and the ability to implement more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Job DescriptionI am searching for a talented Data Architect to join my client, a leading Fintech company in London.In this exciting role, you'll be responsible for designing, developing, and implementing the data architecture that forms the backbone of their data-driven strategy. You … ll work closely with stakeholders across the business to understand their needs and translate them into robust, scalable data solutions.Job Title: Data Architect Location: London (Hybrid)Salary: £95,000 - £100,000Industry: FintechStart: ASAPWhat you'll be doing:Design and develop enterprise-level data architectures … and solutions.Select and implement appropriate data management tools and technologies.Ensure data quality, consistency, and security across the organization.Collaborate with data engineers and analysts to deliver successful data projects.Stay up-to-date on the latest trends and technologies in data architecture.Requirements more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industryAbout the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes.Whilst this is a data engineer role, the focus is on data analytics and migrating from … Tableau to Power BI.Experience/skills required:Proficient in data analysis, data modelling and designing ETL processes.Familiar with Data Mesh architecture and Data ProductsHighly skilled in T-SQL with experience in performance tuning and dealing with large data volumesExtensive experience more »

Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. … having impacts across the education sector, parts of the NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azure synapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part of this project helping to analyse the current data estate, identify opportunities and weaknesses then build a roadmap for the data strategy. Key Skills: Highly advanced level of SQL querying more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology , steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain more »

you’re a detail-oriented innovator and team player, we’re excited to hear from you.ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems.Ensure systems meet requirements and industry practices for data quality and integrity.Integrate data management technologies and software tools into … existing structures.Create data tools to support sport data modelling, prediction and analytics.Work with data and analytics experts to strive for greater functionality in our data systems.Essential SkillsProven experience as a Data Engineer, with expertise developing scalable data pipelines.Strong … object oriented programming skills, particularly in Python.Experience with data lakes and data warehousing solutions (Spark, Dataflow, BigQuery).Knowledge of SQL and experience with relational databases, as well as NoSQL databasesFamiliarity with cloud services (preferably GCP) and understanding of its ETL frameworks.Desired: experience with data more »

in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real … be up to?:Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse.Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed.Modern tech stack … several teams, this is key as you will be reporting directly to the CTO.2 + years of programming language experience (e.g. Python, SQL)Data modeling/ETL tool experience A startup/greenfield mentalityWhat's in it for you?:Hybrid workingPrivate healthcare and wellness supportEmployee Discount: 75% discount more »