Data Engineering Contracts

Data Engineering
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Engineering over the 6 months to 14 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
14 May 2024
Same period 2023 Same period 2022
Rank 204 210 224
Rank change year-on-year +6 +14 -12
Contract jobs citing Data Engineering 491 751 1,153
As % of all contract jobs advertised in the UK 1.15% 1.30% 1.31%
As % of the Processes & Methodologies category 1.33% 1.45% 1.44%
Number of daily rates quoted 366 501 786
10th Percentile £363 £453 £456
25th Percentile £463 £510 £508
Median daily rate (50th Percentile) £550 £600 £575
Median % change year-on-year -8.33% +4.35% +4.55%
75th Percentile £652 £738 £688
90th Percentile £750 £800 £788
UK excluding London median daily rate £550 £539 £550
% change year-on-year +2.04% -2.00% +10.00%
Number of hourly rates quoted 13 24 5
10th Percentile £30.55 £19.00 £22.20
25th Percentile £31.25 £20.10 £25.64
Median hourly rate £35.00 £73.00 £56.50
Median % change year-on-year -52.05% +29.20% +103.75%
75th Percentile £60.00 £78.00 £64.75
90th Percentile - £87.75 £80.44
UK excluding London median hourly rate £60.00 £35.00 £38.21
% change year-on-year +71.43% -8.39% +37.77%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for process or methodology skills.

Contract vacancies with a requirement for process or methodology skills 36,783 51,773 79,870
As % of all contract IT jobs advertised in the UK 86.20% 89.81% 90.61%
Number of daily rates quoted 23,675 35,887 56,073
10th Percentile £300 £325 £343
25th Percentile £413 £438 £428
Median daily rate (50th Percentile) £525 £550 £530
Median % change year-on-year -4.55% +3.77% +8.16%
75th Percentile £638 £650 £638
90th Percentile £750 £750 £738
UK excluding London median daily rate £500 £500 £475
% change year-on-year - +5.26% +8.29%
Number of hourly rates quoted 2,434 1,710 1,920
10th Percentile £12.75 £10.99 £12.50
25th Percentile £16.00 £16.22 £15.52
Median hourly rate £36.50 £36.40 £25.68
Median % change year-on-year +0.29% +41.73% +4.82%
75th Percentile £60.00 £65.00 £49.50
90th Percentile £72.50 £75.00 £65.00
UK excluding London median hourly rate £38.00 £35.00 £20.00
% change year-on-year +8.57% +75.00% -6.98%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Engineering.

Daily rate trend for Data Engineering in the UK

Data Engineering
Daily Rate Histogram

Daily rate distribution for jobs citing Data Engineering over the 6 months to 14 May 2024.

Daily rate histogram for Data Engineering in the UK

Data Engineering
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Engineering.

Hourly rate trend for Data Engineering in the UK

Data Engineering
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Engineering over the 6 months to 14 May 2024.

Hourly rate histogram for Data Engineering in the UK

Data Engineering
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Engineering within the UK over the 6 months to 14 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -7 421 £575 -8.00% 349
London -19 259 £585 -9.65% 200
Work from Home +30 193 £550 -8.33% 163
UK excluding London +29 154 £550 +2.04% 152
North of England +30 47 £550 - 40
Midlands +39 41 £584 +8.15% 28
South East -9 38 £550 +4.76% 34
West Midlands +26 27 £642 +18.87% 23
North West +28 26 £510 -7.27% 24
Yorkshire +27 20 £605 +5.22% 8
East Midlands +28 14 £550 -4.35% 5
Scotland +33 13 £453 -7.55% 7
South West -8 8 £450 -33.33% 28
East of England +13 6 £575 +17.95% 12
Wales +17 1 £625 - 3
North East +10 1 £431 -28.17% 8

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (10.79%) Apache Airflow
1 53 (10.79%) Apache Spark
2 45 (9.16%) Apache
3 9 (1.83%) Confluence
4 6 (1.22%) Tornado
5 5 (1.02%) SharePoint
6 3 (0.61%) ArcGIS
7 1 (0.20%) Apache Pulsar
7 1 (0.20%) BizTalk Server
Applications
1 9 (1.83%) Microsoft Excel
2 2 (0.41%) Microsoft PowerPoint
2 2 (0.41%) Sketch
3 1 (0.20%) AutoCAD
3 1 (0.20%) Spreadsheet
Business Applications
1 2 (0.41%) Markit EDM
2 1 (0.20%) Aladdin
2 1 (0.20%) Oracle ERP
2 1 (0.20%) Oracle General Ledger
2 1 (0.20%) SAP GRC
2 1 (0.20%) Shopify
Cloud Services
1 207 (42.16%) Azure
2 168 (34.22%) AWS
3 73 (14.87%) GCP
4 65 (13.24%) Power Platform
5 64 (13.03%) Azure Data Factory
6 55 (11.20%) Snowflake
7 53 (10.79%) Serverless
8 40 (8.15%) Azure Synapse Analytics
9 35 (7.13%) Amazon S3
10 31 (6.31%) AWS Lambda
11 28 (5.70%) dbt
12 26 (5.30%) Azure DevOps
13 24 (4.89%) Amazon EMR
14 21 (4.28%) GitHub
15 18 (3.67%) Azure Functions
16 14 (2.85%) Amazon EC2
16 14 (2.85%) Amazon Kinesis
16 14 (2.85%) Azure Key Vault
17 13 (2.65%) Cloud Computing
17 13 (2.65%) GitHub Actions
Communications & Networking
1 17 (3.46%) Network Security
2 16 (3.26%) TCP/IP
3 15 (3.05%) Intrusion Detection
4 14 (2.85%) SAN
5 5 (1.02%) FTP
6 2 (0.41%) BGP
6 2 (0.41%) Cisco ASA
6 2 (0.41%) Cisco Nexus
6 2 (0.41%) DHCP
6 2 (0.41%) DNS
6 2 (0.41%) HTTP
6 2 (0.41%) OSPF
6 2 (0.41%) SNMP
7 1 (0.20%) AMQP
7 1 (0.20%) DMZ
7 1 (0.20%) Firewall
7 1 (0.20%) Modbus
7 1 (0.20%) MQTT
Database & Business Intelligence
1 116 (23.63%) Data Warehouse
2 87 (17.72%) Data Lake
3 80 (16.29%) Big Data
4 65 (13.24%) Power BI
5 35 (7.13%) SQL Server
6 29 (5.91%) Amazon Redshift
6 29 (5.91%) Azure SQL Database
7 27 (5.50%) BigQuery
8 24 (4.89%) Amazon Athena
9 21 (4.28%) Flink
9 21 (4.28%) Tableau
10 20 (4.07%) Delta Lake
11 19 (3.87%) Metadata
12 18 (3.67%) NoSQL
12 18 (3.67%) Spark SQL
13 16 (3.26%) Hadoop
14 15 (3.05%) Relational Database
15 13 (2.65%) SQL Server Integration Services
16 9 (1.83%) PostgreSQL
17 8 (1.63%) SQL Server Analysis Services
Development Applications
1 33 (6.72%) JIRA
2 31 (6.31%) Git
3 6 (1.22%) Jenkins
4 3 (0.61%) SonarQube
5 2 (0.41%) Bitbucket
5 2 (0.41%) GitLab
5 2 (0.41%) IntelliJ
5 2 (0.41%) MLflow
5 2 (0.41%) Zephyr
6 1 (0.20%) Atlassian Bamboo
6 1 (0.20%) Deequ
6 1 (0.20%) Visual Studio
General
1 94 (19.14%) Social Skills
2 81 (16.50%) Analytical Skills
3 70 (14.26%) Finance
4 45 (9.16%) Public Sector
5 24 (4.89%) Banking
6 19 (3.87%) Pharmaceutical
7 15 (3.05%) Marketing
7 15 (3.05%) Retail
8 12 (2.44%) Manufacturing
9 7 (1.43%) Telecoms
10 6 (1.22%) Influencing Skills
10 6 (1.22%) Presentation Skills
11 5 (1.02%) Legal
12 4 (0.81%) Electronics
12 4 (0.81%) Front Office
12 4 (0.81%) Inclusion and Diversity
12 4 (0.81%) Investment Banking
13 3 (0.61%) Advertising
13 3 (0.61%) Back Office
13 3 (0.61%) Law
Job Titles
1 244 (49.69%) Data Engineer
2 63 (12.83%) Developer
3 56 (11.41%) Azure Engineer
4 54 (11.00%) Lead
5 52 (10.59%) Senior
6 42 (8.55%) Azure Data Engineer
7 41 (8.35%) AWS Engineer
8 37 (7.54%) Senior Data Engineer
9 34 (6.92%) Python Developer
10 31 (6.31%) AWS Data Engineer
11 27 (5.50%) Architect
12 23 (4.68%) Analyst
13 22 (4.48%) Lead Data Engineer
14 21 (4.28%) Data Architect
15 16 (3.26%) Python Engineer
15 16 (3.26%) Snowflake Data Engineer
16 15 (3.05%) Consultant
17 11 (2.24%) Data Manager
18 10 (2.04%) Platform Engineer
18 10 (2.04%) Python Data Engineer
Libraries, Frameworks & Software Standards
1 79 (16.09%) PySpark
2 54 (11.00%) Kafka
3 20 (4.07%) Apache NiFi
4 16 (3.26%) .NET
5 14 (2.85%) FastAPI
6 13 (2.65%) XML
7 12 (2.44%) Flask
7 12 (2.44%) RESTful
8 11 (2.24%) Pandas
8 11 (2.24%) React
9 10 (2.04%) Node.js
9 10 (2.04%) PyTorch
10 9 (1.83%) JSON
10 9 (1.83%) pytest
11 8 (1.63%) TensorFlow
12 6 (1.22%) AngularJS
12 6 (1.22%) Bokeh
12 6 (1.22%) Hugging Face
12 6 (1.22%) LangChain
12 6 (1.22%) OAuth2
Miscellaneous
1 15 (3.05%) Cyber Defence
1 15 (3.05%) Distributed Applications
2 13 (2.65%) Management Information System
2 13 (2.65%) Product Ownership
3 12 (2.44%) Data Structures
3 12 (2.44%) Distributed Systems
4 8 (1.63%) Algorithms
4 8 (1.63%) Cloud Native
5 5 (1.02%) Reference Data
5 5 (1.02%) Renewable Energy
5 5 (1.02%) Smart Meter
5 5 (1.02%) Virtual Team
6 4 (0.81%) Distributed Computing
6 4 (0.81%) FMCG
7 3 (0.61%) Data Protection Act
7 3 (0.61%) Fixed Income
7 3 (0.61%) Market Risk
7 3 (0.61%) NHS
7 3 (0.61%) Onboarding
7 3 (0.61%) Solar Panel
Operating Systems
1 32 (6.52%) Linux
2 18 (3.67%) Windows
3 17 (3.46%) Unix
4 14 (2.85%) Debian
4 14 (2.85%) Ubuntu
5 13 (2.65%) Android
5 13 (2.65%) Apple iOS
6 1 (0.20%) Windows Server
Processes & Methodologies
1 168 (34.22%) Analytics
2 165 (33.60%) ETL
3 163 (33.20%) Data Modelling
4 162 (32.99%) Data Pipeline
5 145 (29.53%) Agile
6 105 (21.38%) DevOps
7 94 (19.14%) Business Intelligence
8 92 (18.74%) CI/CD
9 73 (14.87%) Problem-Solving
10 71 (14.46%) Data Science
11 70 (14.26%) Visualisation
12 61 (12.42%) Data Management
13 60 (12.22%) Data Governance
14 50 (10.18%) Data Integration
15 49 (9.98%) Data Analysis
16 45 (9.16%) Computer Science
16 45 (9.16%) Data Visualisation
17 44 (8.96%) Machine Learning
18 41 (8.35%) Software Engineering
19 37 (7.54%) Data Architecture
Programming Languages
1 270 (54.99%) Python
2 244 (49.69%) SQL
3 54 (11.00%) Java
3 54 (11.00%) Scala
4 19 (3.87%) C#
4 19 (3.87%) JavaScript
5 14 (2.85%) T-SQL
6 13 (2.65%) TypeScript
7 10 (2.04%) PowerShell
7 10 (2.04%) R
8 6 (1.22%) Data Analysis Expressions
9 5 (1.02%) Kusto Query Language
9 5 (1.02%) Perl
10 3 (0.61%) C++
10 3 (0.61%) PL/SQL
11 2 (0.41%) Bash
11 2 (0.41%) Go
11 2 (0.41%) Groovy
11 2 (0.41%) XPath
11 2 (0.41%) XQuery
Qualifications
1 103 (20.98%) Security Cleared
2 83 (16.90%) SC Cleared
3 42 (8.55%) Degree
4 26 (5.30%) DV Cleared
5 22 (4.48%) Computer Science Degree
6 9 (1.83%) Azure Certification
7 7 (1.43%) Master's Degree
8 3 (0.61%) BPSS Clearance
9 2 (0.41%) AWS Certification
9 2 (0.41%) AWS Certified Solutions Architect
9 2 (0.41%) CCDP
9 2 (0.41%) CCNP
9 2 (0.41%) Cisco Certification
9 2 (0.41%) IBM Certification
9 2 (0.41%) Microsoft Certification
9 2 (0.41%) Numerate Degree
9 2 (0.41%) PhD
10 1 (0.20%) CTC Cleared
10 1 (0.20%) ITIL Certification
Quality Assurance & Compliance
1 62 (12.63%) Data Quality
2 15 (3.05%) Actionable Recommendations
3 6 (1.22%) GDPR
3 6 (1.22%) QA
4 4 (0.81%) Accessibility
5 3 (0.61%) IFRS
5 3 (0.61%) IFRS 17
5 3 (0.61%) Solvency II
6 2 (0.41%) California Consumer Privacy Act
6 2 (0.41%) SLA
7 1 (0.20%) GRC
7 1 (0.20%) GxP
7 1 (0.20%) ISO/IEC 20000
System Software
1 35 (7.13%) Docker
2 3 (0.61%) HDFS
3 1 (0.20%) Apache Flume
Systems Management
1 40 (8.15%) Kubernetes
1 40 (8.15%) Terraform
2 3 (0.61%) Ansible
2 3 (0.61%) Grafana
3 1 (0.20%) Kibana
3 1 (0.20%) Kubeflow
3 1 (0.20%) Matomo
3 1 (0.20%) Prometheus
3 1 (0.20%) RSA Archer
Vendors
1 120 (24.44%) Databricks
2 57 (11.61%) Microsoft
3 36 (7.33%) Google
4 25 (5.09%) Oracle
5 24 (4.89%) Red Hat
6 16 (3.26%) Informatica
6 16 (3.26%) SAP
7 14 (2.85%) VMware
8 12 (2.44%) Ab Initio
9 11 (2.24%) Talend
10 10 (2.04%) Foundry
10 10 (2.04%) Palantir
11 5 (1.02%) Confluent
12 4 (0.81%) IBM
13 3 (0.61%) OpenAI
14 2 (0.41%) Arista
14 2 (0.41%) Cisco
14 2 (0.41%) Palo Alto
14 2 (0.41%) SnapLogic
14 2 (0.41%) Zscaler