76 to 100 of 217 Data Lake Jobs in the UK

working with a leading Blockchain analytics platform, with a stellar leadership team and excellent backing. Seeking to hire an experienced senior level Backend & Data Engineer, with strong Python skills and backend architecture ability. The Role Working alongside a strong technical and engineering team, you will take ownership of … redeveloping the architecture of their entire backend systems, focusing on growth. Working with Python and extrapolating high volumes of data from the blockchain, you will be responsible for the overall vision, strategy and execution of the company’s Software products. You will take ownership of: Technical Leadership: Team … building out complex Backend services, along with high-throughput Data warehousing. Min 7yrs with Python Big Data & Data lake solutions; PostgreSQL, Clickhouse or SnowFlake etc Cloud Infrasutcurre (AWS services) Data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper Hands-on more »

informed and clearer financial decisions to create better financial well-being. The company has created a new role in the company focused on data to reimagine how data is utilised in the organised About the Lead Product Manager role We are looking for a very data-centric Lead Product Manager, who will report to the Chief Data Officer and have 1 direct report which may grow to two. You will support and lead the team acting as a servant leader while working closely with data, engineering and the wider business … to ensure that data is used, ingested and provided to all company areas. This role sits horizontally across the entire company and is pivotal in the success of multiple teams and the wider company. Skills Required for this role: Product Leader who has managed and scaled successful product more »

the impact on user experience of a range of clinical and non-clinical features. Key duties: Proposing a range of innovative, cost-effective, data collection techniques to quantify benefits and usage of software products in a complex fast-moving environment. Planning, documenting, and conducting suitable experiments to test … hypotheses on the usage and benefits of Blatchford products. Recruiting suitable individuals for studies. Ensuring data is collected in line with patient privacy stipulations and relevant legislation. Facilitating a range of data collection forums. Collating information, writing documents and reports to provide insights and information to … inquisitive, and eager to learn. Familiar with agile software development cycles and ceremonies Understanding of Business Intelligence, Data Warehouse, Data Lake concepts Experience and interest in analysing human performance data. Strong communications and interpersonal skills. This is a fantastic opportunity to work as part of more »

Customer Data Platform (CDP) Product Manager- London Office/Hybrid working 2 days PW in office 12 Month FTC - - Salary negotiable dep on experience Up to £80,000 - J12776 Please note all applicants require full and indefinite right to work in the UK as this client is unable … to provide sponsorship To work in a team who manage all aspects of market research, customer segmentation, first part data build up and consumer activation along the customer journey for all brands across this companies’ group. Fuelling the ambition to put data at the heart of … decision making and investing in our data platform to create a trusted single view of the customer and understand, analyse and leverage customer data to create a truly connected customer experience. Seeking an experience Customer Data Platform Product Manager to join and lead the more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our … dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including... more »

are looking for someone to lead the team in this transition. The right person will be both technically capable of working within a Data environment as well as leading a team of BI Developers. The role is suited for a creative and driven individual who can effectively take … making process Work with management to develop the reporting system Develop ETL processes using Kimball methodology Key skills Microsoft Azure, Synapse, Data lake SQL PowerBI Proven experience of leading a team What's on Offer Up to £70k Salary + Pension Hybrid working/3 days on more »

Data Lead/Architect, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … an approval process in ADO for all schema changes Octopus Deploy and Azure ADO experience Azure experience - designing/implementing a data lake Data modelling - keeping ERD's up to date and assisting the Architecture team with database design Scripting tools such as PowerShell, Experience more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Data Platform Architect €110k-€135k + Health + Pension + more Remote working (Two days per month in Dublin Office) We are looking for an experienced Data Architect to join a collaborative team of experts focused on creating a world-class data platform. As … a subject matter expert, you will serve as a technical thought leader in data management, database systems, and information processes across the company. You will have the freedom to design innovative solutions to unique challenges, using data to improve workplace experiences. This opportunity will allow you … strategies. Have demonstrated active listening and used candid feedback effectively. Are proficient in AWS Data technology Stack for building Data Lake solutions. Have expertise in relational and non-relational database systems. A great opportunity to join a global company and dynamic team, don’t delay more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … with Microsoft Dynamics 365 Finance Operations and Project Operations 4+ years' experience working with Microsoft Power BI 4+ years' experience working with enterprise data warehouse/BI projects. … 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House, and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

will be invaluable. Main Responsibilities: Design and implement effective database solutions and models to store and retrieve data including Data Lake and Data Warehousing Assess database implementation procedures to ensure they comply with GDPR and data compliance Design conceptual and logical … the benefits, pros and cons of solution options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure … of working with structured and unstructured datasets Able to design a range of architectural solutions Data models and ETL Data lake and data warehouse end to end architecture Experience within media, publishing, research, or a similar consumer focused industry is highly desirable, but more »

Requirements At least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting. Knowledge of developing real-time data stream systems (ideally Kafka). Proven track record in developing data systems using PySpark and Apache Spark for batch processing. Capable of managing data intake from various sources, including data streams, unstructured data, relational databases, and NoSQL databases. Extensive knowledge in distributed systems, cloud architecture, and data pipelines. Proficiency in Python … making and client visibility. Play a major role in the development and optimisation of data systems to support our Data Lake/Data Mesh architecture and data processing needs, ensuring the provision of scalable, high-performance data products for more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision … to provide specialist services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You … will work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data … integration workflows. Strong understanding of data modelling, database design, and data warehousing concepts. Experience with data lake architectures and big data technologies. Hands-on experience with SQL and NoSQL databases. AWS certifications (such as AWS Certified Solutions Architect, AWS more »

are a tech for good business dedicated to promoting transparency in the corporate world they are seeking a highly skilled and experienced Lead Data Engineer. You will be the first hire in the Data Engineering team allowing you to take the drivers seat regarding the direction … taken by the data team to follow. Key Responsibilities: Platform Development: Design, develop, maintain, test, and optimise a scalable and reliable data platform for collecting, processing, and transforming large volumes of company data from various sources. Collaboration: Work with cross-functional teams to understand … data platform requirements and deliver solutions that meet business needs. Optimisation: Enhance data storage and retrieval systems for high performance and data integrity. Quality Assurance: Implement and maintain a data quality and observability framework to ensure data accuracy, completeness, and more »

part of the Top Employer Institute annual listings. We were assessed on several key HR practices including Diversity and Inclusion. Role : Data Lake Engineer Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR … and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings Proving the use of AWS services to support new distributed computing solutions that often span private cloud and public cloud services. Engagements will include migration of … Computer Science, Engineering, Mathematics or a related field Experience of IT platform implementation in a technical and analytical role Experience of Data Lake/Hadoop platform implementation Hands-on experience in implementation and performance tuning Hadoop/Spark implementations Experience Apache Hadoop and the Hadoop ecosystem Experience more »

HI, We are looking for Senior Data Modeler. Please find below the job description. Job description. 1 Lead and oversee all “Asset Classes of Banking Finance Products” related data models Data Dictionary Data Catalogues and Data Governance requirements 2 Interact … senior leadership walk them through Finance Data Models resolving queries 3 Act as a subject matter expert in Finance Data Lake P L Balance Sheet Income Statement Pricing Adjustments staying informed about industry trends best practices and regulatory changes 4 Develop and implement strategies to … optimize Data Models ensuring efficiency accuracy and compliance with regulatory requirements 5 Collaborate with cross functional teams to design and implement solutions for complex Finance Risk related challenges 6 Drive the execution of large scale programs related to Finance Data Lakes data operations ensuring more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with … quantitative researchers, ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data … manage distributed locking mechanisms. Take ownership of data ingestion and cataloging processes. Be proactive in questioning and improving the data lake and catalog, ensuring they are scalable for the next three years and beyond. Demonstrate a hands-on approach, not just completing tasks as assigned more »

Data Architect £80k + Excellent Benefits | Remote: UK Are you a personable and talented Data Architect? Do you thrive on providing vision and hands-on expertise to improve the quality and architecture of company data? If so, we have an exciting opportunity for you … The Company Well-established and award-winning Microsoft partner, committed to excellence in data management. As a Data Architect, you’ll play a crucial role in shaping the future of clients’ data landscape. Your Role As the successful Data Architect, you’ll … bring your expertise to the table: Proven Experience: You have a track record in Data Architecture and Data Engineering. Azure Proficiency: You’re proficient across Azure Data Factory, Synapse/Databricks, and Azure Data Lake. Azure Analytics: You possess good knowledge of more »