deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
Exeter, Devon, Countess Wear, United Kingdom Hybrid / WFH Options
Bowerford Associates
to 5 years minimum experience working as a Data Engineer, utilising the following technologies, languages, tools and methodologies: - Databricks Python TSQL/T-SQL ETL Test Automation Unit Testing/Mocking Refactoring Agile/Scrum Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell more »
guide and motivate junior team members Deep understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, strong understanding of ETLand ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand messages Strong story telling skills, ability to influence decision more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming more »
delivery. Experience working in an Agile development environment. Passion for engineering excellence through automation, unit testing, and process improvements. Experience with data integration andETL tools (both productized and open source) We're Even More Excited If You Have: Open source contributor. 3+ years of experience with a public cloud more »
in Computer Science, Applied Mathematics, Engineering, or any other technology related field. Approximately 5 years of working experience as a data engineer Proficient in ETL solutions across Microsoft Azure and Google Cloud Platform. Very good practical knowledge SQL, Python and data platform management. Advanced working SQL knowledge and experience working more »
ability to proactively maintain existing and develop new procedures for information provision with One Version of the Truth and the troubleshooting of server andETL issues; including the ability to allow for integration with other technologies such as powershell, web development and other application developments 5.10Expected to provide training in more »
Job details: Cloud technologies (preferably GCP/Azure/AWS) Python programming ETL, ELT development in classical DWHs (Oracle, DB2, Teradata) PL/SQL, data modeling Knowledge of Oracle 12c, TMSP AAX² Development in Microsoft Power BI environment, MS-BI suite CI/CD with GitLab Active communication in English more »
Reporting andETL Developer, Dynamics 365, D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client requires … a Reporting andETL Developer to join them on a permanent basis to work on their D365 FO implementation. As a Technical Resource, you will play a pivotal role in supporting analytics and reporting efforts within Dynamics 365. It will be a Hybrid role with a requirement to be onsite … Analytics and Reporting: Collaborating with cross-functional teams to identify reporting requirements, design dashboards, and generate insights that drive business decisions. SQL Experience for ETL: Designing and executing Extract, Transform, Load (ETL) processes using SQL to facilitate data integration and reporting. Azure Resource Procurement: Procuring resources in Azure Portal to more »
hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena); Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway; ETL services (AWS Glue, Step functions); Infrastructure a management tool such as Terraform and extensive use of SQLs, Python, and Node JS. The data engineering services … data warehouses; Collaborate with data visualisation and analysts’ teams to understand data requirements and translate them into technical specifications. Data Processing: Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure; Optimise data processing and storage for performance and cost-effectiveness. Database more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
Strong network and firewall knowledge Strong Information Security and IT security/Cyber controls Deep experience/understanding of all elements of data engineering (extract/transform/load), visualization, analytics, and machine learning Designing, deploying, maintaining, and developing data systems and controls. Benefits This is a fantastic opportunity for more »
D365 F&SCM, Dynamics365 F&SCM, Finance & Supply Chain Management, Project Operations, Project Ops, Data Migration Consultant, Data Migration, D365 Data Model, Data Architecture, ETL, MS SQL, SQL Server Management Studio, SSMS, PowerBI, Dataverse, D365 FSCM APIs, Azure, DevOps – FTC – Hybrid – London - £60,000-£65,000 Our global end user more »
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
experience within the industry Lead Engineering engagement with Actuarial SMEs and Underwriters Mentor Analytics Engineering team members to develop and maintain end-to-end ETL processes Maintain a high level of coding and technical standards across the team Demonstrate a high level of technical capability in Python, SQL, and JSON more »
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
Employment Type: Permanent
Salary: £45000 - £55000/annum 25 Days holiday, Pension Scheme
Birmingham, West Midlands, West Midlands (County), United Kingdom
Spectrum IT Recruitment
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
Employment Type: Permanent
Salary: £45000 - £55000/annum 25 Days holiday, Pension Scheme
the infrastructure that supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement more »
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, andmore »
appreciation for the big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including having a working knowledge of GitHub Understanding more »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Change Digital
maintaining data integrity and provenance. * Experience designing and building robust, production ready, scalable data pipelines * Familiarity with optimising strategies, pipeline architectures, data sets andETL/ELT processes * Have experience of selecting the appropriate tools to deliver the solution * Coding skills, could be C# or Python. For more information get more »
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £65,000 - £75,000 Bonus more »
Azure data resources: Data Factory, Databricks, Storage Account, SQL Database, SQL Data Warehouse. Senior-level experience in data engineering, including designing data models andETL pipelines, engineering robust solutions, and conducting testing and QA. Expertise in Azure DevOps, with a focus on source repository control, CI/CD, and change more »
Better Placed Ltd - A Sunday Times Top 10 Employer in 2023!
Proficiency in SQL and other programming languages commonly used in data analysis and BI. Deep understanding of database management systems, data integration techniques, andETL processes. Excellent analytical and problem-solving skills, with the ability to turn complex data into meaningful insights. Strong communication and interpersonal skills, with the ability more »
Experience as a Business Intelligence Developer or similar role SQL Experience/Proficient in SQL coding. Understanding of data warehousing concepts, data modeling, andETL processes. Understanding of finance and accounting principles We celebrate diversity and encourage applicants from all whatever their background and/or disability. We want you more »
technologies (e.g., Kafka). Knowledge of cloud services and architecture (AWS, Azure, or GCP), particularly data storage and computing services. Experience with data integration, ETL processes, and familiarity with data warehousing solutions Proficiency in Python with a focus on data-centric programming. Experience with machine learning algorithms and data modelling more »