101 to 125 of 201 Permanent Data Lake Jobs in the UK

A global leading commodities trading firm have partnered with Referment to find a skilled Data Engineer to join their London team on a contract basis. This organisation has some exciting Greenfield projects focussed on modernisation of data warehouse, data lakes and data streaming services. This is critical role, which will require designing, implementing, and enhancing data solutions to support the businesses trading operations. This role will involve building out data pipelines, ETL processes and data warehouses and will require a well-rounded data … engineer with deep experience in Python and other OO languages like Java. Delivery is vital within this role so experience in scaling up data systems using the best data engineering processes is required. Due to the nature of commodities trading, there is exciting problems to solve more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

Data Platform Architect €110k-€135k + Health + Pension + more Remote working (Two days per month in Dublin Office) We are looking for an experienced Data Architect to join a collaborative team of experts focused on creating a world-class data platform. As … a subject matter expert, you will serve as a technical thought leader in data management, database systems, and information processes across the company. You will have the freedom to design innovative solutions to unique challenges, using data to improve workplace experiences. This opportunity will allow you … strategies. Have demonstrated active listening and used candid feedback effectively. Are proficient in AWS Data technology Stack for building Data Lake solutions. Have expertise in relational and non-relational database systems. A great opportunity to join a global company and dynamic team, don’t delay more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. … designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with more »

working with companies in the finance sector highly desirable • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment. • Experience with … code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific more »

SME underwriting decisions per month. Responsibilities include: To perform data extraction , manipulation and cleansing techniques within a data lake environment. Support the delivery of strategic initiatives into Credit SME to build scale, reduce manual touchpoints and enhance the controls environment. Providing Portfolio analysis through the … use of analytical methods. Implementation and design of risk management & changes within 3rd party tools i.e. CRM/UD portal etc Utilise customer data to build risk segmentation and mitigation strategies Lead role for supporting SME commercial strategy and input into key working groups across pricing, system development … you have experience in, or comfortable with: Experience in the extraction and cleansing techniques of data held within a data lake environment Develop Credit Risk Strategies supported by Decision Engine Rules, and Scorecards (Nice to have) Working knowledge of other automating solutions (implementation and maintenance more »

will develop superior digital and technology concepts and architecture solutions as well as support technical implementations actively and on site, applying your sound Data/Cloud technical know-how, your understanding of business contexts, along with your analytical and conceptual skills. As you acquire experience, you will be … technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment • Experience with … code reviews & performance of technical proofs of concepts • Analysis of complex IT Application landscapes, optimization of development processes and Solution Architecture • Data lake experience on AWS and Azure • General knowledge of database technologies and trade-offs • University degree with above-average academic performance in a mathematical-scientific more »

Lead Data Project Manager | Data | Data Lakes | Data Warehouse | Azure Lead Data Project Manager needed on a Permanent basis. Gravitas continue their support for a leading non for profit organisation on their search for a Lead Data Project … company is rolling out a new delivery focused function, the successful candidate will need to take ownership for all things Data. Role: Lead Data Project Manager Location: London - Minimum of once a week in the office. Salary: £58,000 - £63,000 Type: Permanent. The essential skills needed for … a project manager. Ability to provide programme/project management expertise to help support the workstream delivery. Previous experience with end to end Data project. Good communication and stakeholder management. An ability to be a self-starter/autonomous worker who deep dives into detail. MSP/Prince2 more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

working with a leading Blockchain analytics platform, with a stellar leadership team and excellent backing. Seeking to hire an experienced senior level Backend & Data Engineer, with strong Python skills and backend architecture ability. The Role Working alongside a strong technical and engineering team, you will take ownership of … redeveloping the architecture of their entire backend systems, focusing on growth. Working with Python and extrapolating high volumes of data from the blockchain, you will be responsible for the overall vision, strategy and execution of the company’s Software products. You will take ownership of: Technical Leadership: Team … building out complex Backend services, along with high-throughput Data warehousing. Min 7yrs with Python Big Data & Data lake solutions; PostgreSQL, Clickhouse or SnowFlake etc Cloud Infrasutcurre (AWS services) Data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper Hands-on more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

Job Title: Data Platform Administrator Location: Edinburgh (hybrid) Company: Primis is currently partnered with a leading technology company dedicated to delivering innovative solutions that empower businesses in the UK. Their team is comprised of talented individuals who thrive in fast paced environments and are passionate about pushing the … boundaries of technology and creating meaningful impact. Position Overview: We are looking for an Data Platform Administrator, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. As well as the day-to-day you … database administration team. Essential skills : Experienced in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling Solid monitoring and tuning skills in highly available transactional or API-centric environments Working with large-scale, uptime more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software … tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. Essential Skills Proven experience as a Data Engineer, with expertise more »

Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and … experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication more »

Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in a fast paced … and dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills An appreciation for the … big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including having a working knowledge more »

a business who have made great strides in investing in their IT function and who have stated that being led and driven by data is one of their core business aims. You will be integral to this and will be responsible for establishing and building the Data & Analytics function from scratch - you'll design, own and implement the Data Science and Data Analytics strategy as well as selecting and implementing the tools that will enable them to improve the performance of the business. Salary: £65,000-70,000 The Role: The … work with. The Tech stack is new and investment within the business is there to enable you to establish and build a successful Data/Analytics functions. Key responsibilities include: - Lead the development and execution of the roadmap for Data and Analytics - Work closely with key more »

Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

the future of Azure solutions with Ascent? If so, we are looking for you. We are looking for Cloud Solution Architects with a Data and AI specialism who are eager to be a part of the team—you'll be instrumental in our mission to leverage technology accelerators … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data … experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure infrastructure. Experience with CI/ more »

Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure Open AI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure more »

Permanent - Hybrid - Azure Data Engineer Azure Data Engineer required for an exciting perm opportunity. Our client, a leading property investment business are looking to hire an Azure Data Engineer to join their growing tech function. The key responsibilities are the following: Data processing, consolidation, clean-up and migration Data Transformation Azure roadmap discussions Maintain Azure Automation Runbooks. Configure virtual cloud instances and monitor backups. The key skills they are looking for are: 3+ years experience within an Azure Data Specialist position Microsoft T-SQL script skills Experience with Azure Data storage such as Azure blob storage/data lake Azure Key vault Active Directory - Azure AD SAML, Enterprise Apps A strong knowledge of databases (SQL/Oracle) Server Administration If you are looking more »

s biggest brands, including Uber, Major League Baseball, NHS, Disney, Standard Chartered, Mediacom and British Airways. Our services support the whole organisation with data-driven performance insights for leaders, training for managers, wellbeing tools for all employees, as well as access to a global network of accredited mental … hiring process more accessible, just let us know when you apply, or email talent@unmind.com. The Role – Analytics Engineer The core mission of data analytics is to provide actionable insights to all Unmind Teams that drive product and business decisions that build the best version of Unmind. As … within reports that surface relevant trends. In this role you'll get to: Own - You will take the architectural lead for the key data models in the company, and guide your team in finding the right balance between technical excellence and delivery of value that brings you closer more »