operating Operational Datastore/Data Lake/Data Warehouse platforms at scale with high-availabilityData integration: Familiarity with data integration tools and techniques, including ETL (Extract, Transform, Load) processes and real-time data streaming (e.g., using Apache Kafka, Kinesis, or Pub/Sub), exposing data sets via GraphQLCloud platforms expertise more »
and communicate how our data inputs and outputs affect different groups and identify areas Janes can provide additional value. Requirements Experience architecting and developing ETL pipelines solutions for the ingestion, transformation, and serving of data, as well as solutions for the orchestration of pipeline components (e.g. AWS Step Functions, Apache more »
London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines andETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data more »
. Knowledge of SQL and experience with relational databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. more »
Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record in designing and building data infrastructure andETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. SQL Server, including Store Procedures, T-SQL, or more »
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
guide and motivate junior team members Deep understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, strong understanding of ETLand ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand messages Strong story telling skills, ability to influence decision more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming more »
simultaneous projectsAbility to multitask across broad range of responsibilities, prioritize and meet deadlinesEven better if you also have…Past experience with integration technologies i.e. ETL, data migration and packaged applicationsExperience with data warehouses and data lakesSalesforce.com database knowledge; Administrator certification a bonusSome knowledge of PythonIf this role and our mission more »
Job details: Cloud technologies (preferably GCP/Azure/AWS) Python programming ETL, ELT development in classical DWHs (Oracle, DB2, Teradata) PL/SQL, data modeling Knowledge of Oracle 12c, TMSP AAX² Development in Microsoft Power BI environment, MS-BI suite CI/CD with GitLab Active communication in English more »
Reporting andETL Developer, Dynamics 365, D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client requires … a Reporting andETL Developer to join them on a permanent basis to work on their D365 FO implementation. As a Technical Resource, you will play a pivotal role in supporting analytics and reporting efforts within Dynamics 365. It will be a Hybrid role with a requirement to be onsite … Analytics and Reporting: Collaborating with cross-functional teams to identify reporting requirements, design dashboards, and generate insights that drive business decisions. SQL Experience for ETL: Designing and executing Extract, Transform, Load (ETL) processes using SQL to facilitate data integration and reporting. Azure Resource Procurement: Procuring resources in Azure Portal to more »
D365 F&SCM, Dynamics365 F&SCM, Finance & Supply Chain Management, Project Operations, Project Ops, Data Migration Consultant, Data Migration, D365 Data Model, Data Architecture, ETL, MS SQL, SQL Server Management Studio, SSMS, PowerBI, Dataverse, D365 FSCM APIs, Azure, DevOps – FTC – Hybrid – London - £60,000-£65,000 Our global end user more »
Finance domain.Proven track record of delivering value through data products in a fast-paced, agile environment.Extensive knowledge of data principles, architecture/modelling, ingestion, ETL, visualisationExtensive knowledge of Azure based big data platform & exposure to other clouds such as GCP is desirable.Prior experience of successfully leading large-scale data initiatives more »
experience within the industry Lead Engineering engagement with Actuarial SMEs and Underwriters Mentor Analytics Engineering team members to develop and maintain end-to-end ETL processes Maintain a high level of coding and technical standards across the team Demonstrate a high level of technical capability in Python, SQL, and JSON more »
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
Employment Type: Permanent
Salary: £45000 - £55000/annum 25 Days holiday, Pension Scheme
the infrastructure that supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement more »
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, andmore »
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £65,000 - £75,000 Bonus more »
Better Placed Ltd - A Sunday Times Top 10 Employer in 2023!
Proficiency in SQL and other programming languages commonly used in data analysis and BI. Deep understanding of database management systems, data integration techniques, andETL processes. Excellent analytical and problem-solving skills, with the ability to turn complex data into meaningful insights. Strong communication and interpersonal skills, with the ability more »
management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, andETL processes. Profound understanding of best practices in data governance, privacy, and quality. Exceptional skills in communication, leadership, and team management. Capability to handle multiple tasks more »
Greater London, England, United Kingdom Hybrid / WFH Options
itecopeople
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
quality Business Intelligence products and solutions Good understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, good understanding of ETLand ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand messages Strong story telling skills, ability to create a more »
contribute to the technical aspects in the upkeep of the data estate. Focusing on hands-on development, enhancement, and maintenance of data models andETL processes within the data estate You will emphasise the importance of data quality and governance in your project work, contributing to the organisational data model more »
West London, London, United Kingdom Hybrid / WFH Options
Recruitment Revolution
analytic role, with a focus on analysis, reporting and visualisation in Looker Studio + Highly proficient in GCP/GBQ, SQL, data modelling andETL processes + Experience with Supermetrics, GitHub, DBT, Google Big Guery and Shopify + Strong communication and presentation skills to effectively convey insights to both technical more »
and Machine Learning engineers and it is responsible for supporting data scientists in deploying, maintaining and monitoring an increasing number of Python-based microservices, ETL pipelines, SaaS models, databases and vector stores. The MLOps Lead would need to act as an interface between data scientists, the data & analytics team andmore »