1 to 25 of 196 ETL Jobs in London

frameworks and platforms Agile and Continuous Delivery Continuous integration pipelines Strong Python AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc) ETL management; structured or custom (Airflow, Luigi, etc) Bonus Robust experience managing and developing an engineering team Delta lake or Iceberg Trino or Presto Graphql Good more »

following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces Model data requirements, data sources and data flows to bring order … a solid understanding of programming languages along with experience of applying them in your previous role Experience in using Data Engineering tools and technology ETL tools including Python and a number of the Big Data Applications. Rather than specifying a list of technologies we look for, demonstrable ability in what more »

/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and reliable data infrastructure. Develop and maintain databases … our service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge of healthcare industry standards, regulations, and data interoperability. Familiarity with AI and machine learning more »

in a cloud environment (Azure, AWS, GCP) Experience in at least one of: Python (or similar), SQL, PySpark Experience in building data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Interest in the contemporary data engineering and analytics landscape, the more »

key stakeholders and other business units to understand business needs and gather requirements. Required Experience Track record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python more »

to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue … Java, or Scala. Experience with AWS services including S3, Redshift, Glue, Lambda, and RDS. Strong SQL skills for data manipulation and querying. Familiarity with ETL tools and processes. Understanding of data modeling and database design. Soft Skills : Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Detail-oriented more »

environments Excellent knowledge of data technology, data transformation tools, and data governance techniques Good understanding of Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and more »

are looking for a new challenge, please submit your CV for initial screening and more details. Data Architect Desired Skills and Experience AWS|Snowflake|ETL more »

minimize manual processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating new product features using data. - Develop and … of our data architecture and data governance capabilities. - Develop and maintain data models and data dictionaries. Skills and Qualifications: - Significant Experience with data modelling, ETL processes, and data warehousing. - Significant exposure and hands on at least 2 of the programming languages - Python, Java, Scala, GoLang. - Significant experience with Hadoop, Spark more »

and migration of data and services from a smaller firm that the bank has recently acquired. This will involve building out a Java-based ETL service to transfer large volumes of sensitive trade and deal data, ensuring quality is preserved and that it is easily accessible for Front Office staff more »

and day to day operations. Knowledge and experience in NEC's data loaders and configuration will be essential. You will also develop and manage ETL workloads to run predictably, efficiently and effectively whilst monitoring, maintaining and supporting all data management services and processes, liaising with IT, service vendors and internal … data exploration. Identification and resolution of problems in databases, data processes, data products and services Analysis and reporting of test activities and results Extensive ETL experience Experience of other housing management systems such as Active H, Open Housing or Northgate would be highly beneficial Spectrum IT Recruitment (South) Limited is more »

development processes. Additional duties as needed. Preferred Skills: Experience with additional frameworks and libraries such as PyTorch or TensorFlow. Knowledge of data engineering and ETL processes. Experience with version control systems, particularly Git. Knowledge of telecommunications technologies and industry standards. Qualifications: Bachelor's or Master's degree in Computer Science more »

Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in designing, implementing, and managing ETL processes using Azure Data Factory and other relevant tools. Proficiency in building and managing data warehouses using Azure Synapse Analytics and other data warehousing solutions. more »

technical colleagues and providing updates on data activity progress. Proficient in SQL and data modeling. Experience with Python Extensive technical expertise in data warehousing, ETL processes, and BI reporting technologies. Experience in working with and administering modern BI platforms like Looker, Qlik, Domo, or Power BI. Please contact Joely Callaghan more »

or IT. Must have experience working as a Data Analyst/Business Data Analyst. Experience working on large data sets, including the use of ETL processes for the organisation of data. Asset Management experience is essential Previous experience as an Accountant/Fund Accountant Onsite working required Highly Desirable Data more »

understanding of data integration principles, methodologies, and technologies Ability to dissect complex data integration challenges and devise effective solutions Familiarity with various database systems, ETL processes, and APIs to ensure efficient integration solutions Knowledge of relational and non-relational database systems, including SLQ & Oracle Ability to understand and construct complex more »

the infrastructure that supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement more »

Snowflake data architecture, design, and deployment. Strong proficiency in SQL and experience with scripting languages such as Python or Java. Experience with data modelling, ETL processes, and data warehousing techniques. Familiarity with cloud computing services, ideally, Azure. Excellent problem-solving skills and the ability to work collaboratively in a team more »

proposing solutions for improvements Skills and Experience Excellent knowledge of SQL Knowledge of Python (other languages might be equivalent) Experience in creating and maintaining ETL pipelines Know your way around Unix based operating system Experience working with any major cloud provider (AWS, GCP, Azure) Fluency in English Experience using Apache more »

data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of more »

data and insights in collaboration with the Marketing teams. Apply advanced statistical and machine learning techniques, including clustering, regression analysis, and predictive modelling, to extract deeper insights from customer data. Build predictive models to forecast customer behaviour, including sales trends, churn prediction, and lifetime value projections. Utilise techniques like customer … on data activity progress. Excellent SQL and data modelling skills. Knowledge of at least one other programming language. Comprehensive technical experience in data warehousing, ETL and BI reporting technologies. Experience working with and administrating a modern BI platform, such as Looker, Qlik, Domo or Power BI. Experience of working with more »

tech team. As a Data Developer you'll focus on building data systems, using the latest .Net technology to develop pipelines to extract, transform and load financial data from disparate sources, build out the company's data collection platform to incorporate new sources and markets and validate the quality of more »

up with your own solution. You will be building dashboards in Python as well as be in charge of Transformation when it comes to ETL pipelines. Experience wise, you’ll need to be a SQL Server expert with strong architecture skills and also strong skills with Python, and DBT. The more »

client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from … hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data Modelling on a cloud-based data platform. Extensive experience with SQL Server and relational databases. more »

seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and more »