Data Lake Contracts

Data Lakes
UK

The following table provides summary statistics for contract job vacancies with a requirement for Data Lake skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Data Lake over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 187 205 215
Rank change year-on-year +18 +10 -3
Contract jobs citing Data Lake 521 743 1,184
As % of all contract jobs advertised in the UK 1.22% 1.30% 1.35%
As % of the Database & Business Intelligence category 7.17% 7.28% 6.77%
Number of daily rates quoted 392 570 763
10th Percentile £413 £450 £425
25th Percentile £475 £500 £500
Median daily rate (50th Percentile) £575 £575 £575
Median % change year-on-year - - +12.20%
75th Percentile £850 £675 £675
90th Percentile £888 £750 £754
UK excluding London median daily rate £500 £538 £575
% change year-on-year -6.98% -6.52% +16.75%
Number of hourly rates quoted 3 4 3
10th Percentile £30.30 - -
25th Percentile £34.13 - -
Median hourly rate £40.50 £35.00 £35.00
Median % change year-on-year +15.71% - -21.79%
75th Percentile £51.00 - £56.88
90th Percentile £57.30 - £70.00
UK excluding London median hourly rate £40.50 £35.00 £35.00
% change year-on-year +15.71% - -

All Database and Business Intelligence Skills
UK

Data Lake is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,263 10,212 17,493
As % of all contract IT jobs advertised in the UK 17.07% 17.88% 20.00%
Number of daily rates quoted 5,202 7,271 12,451
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.92%
Number of hourly rates quoted 145 180 194
10th Percentile £14.00 £21.24 £15.37
25th Percentile £20.98 £32.30 £22.43
Median hourly rate £40.00 £60.00 £45.00
Median % change year-on-year -33.33% +33.33% +69.81%
75th Percentile £61.60 £73.75 £64.94
90th Percentile £74.00 £82.55 £75.00
UK excluding London median hourly rate £40.00 £56.95 £35.00
% change year-on-year -29.76% +62.71% +43.44%

Data Lake
Job Vacancy Trend

Job postings citing Data Lake as a proportion of all IT jobs advertised.

Job vacancy trend for Data Lake in the UK

Data Lake
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Data Lake.

Daily rate trend for Data Lake in the UK

Data Lake
Daily Rate Histogram

Daily rate distribution for jobs citing Data Lake over the 6 months to 15 May 2024.

Daily rate histogram for Data Lake in the UK

Data Lake
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Data Lake.

Hourly rate trend for Data Lake in the UK

Data Lake
Hourly Rate Histogram

Hourly rate distribution of jobs citing Data Lake over the 6 months to 15 May 2024.

Hourly rate histogram for Data Lake in the UK

Data Lake
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Data Lake within the UK over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England +9 479 £585 +1.74% 197
London +30 331 £675 +12.50% 112
Work from Home +61 242 £750 +36.36% 108
UK excluding London -4 139 £500 -6.98% 83
North of England +9 60 £500 -16.67% 21
North West +10 45 £490 -21.60% 14
South East +5 30 £575 +9.52% 22
Midlands +14 20 £441 -11.75% 11
South West +16 17 £488 -7.14% 15
Yorkshire +21 14 £500 -27.01% 5
West Midlands +13 12 £400 -36.00% 9
Scotland +42 10 £450 -12.20% 4
East Midlands +2 8 £513 +13.89% 2
East of England 0 2 £418 -24.09% 8
North East +4 1 £850 +41.67% 2

Data Lake
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 116 (22.26%) Apache Airflow
2 102 (19.58%) Apache
3 55 (10.56%) Apache Spark
4 13 (2.50%) SAS
5 4 (0.77%) Confluence
6 1 (0.19%) Jupyter
6 1 (0.19%) SharePoint
Applications
1 3 (0.58%) Microsoft Excel
2 1 (0.19%) Microsoft Office
2 1 (0.19%) Microsoft PowerPoint
Business Applications
1 28 (5.37%) Dynamics AX
2 14 (2.69%) Dynamics CRM
3 4 (0.77%) Oracle EBS
4 3 (0.58%) Maximo
4 3 (0.58%) Oracle ERP
4 3 (0.58%) Primavera
4 3 (0.58%) SAP S/4HANA
5 2 (0.38%) Magento
5 2 (0.38%) Oracle Payables
5 2 (0.38%) Oracle Receivables
5 2 (0.38%) PeopleSoft CRM
5 2 (0.38%) Salesforce CRM
6 1 (0.19%) Oracle General Ledger
6 1 (0.19%) thinkFolio
Cloud Services
1 283 (54.32%) Azure
2 193 (37.04%) AWS
3 143 (27.45%) Power Platform
4 140 (26.87%) Snowflake
5 108 (20.73%) Azure Data Factory
5 108 (20.73%) dbt
6 103 (19.77%) GCP
7 69 (13.24%) Azure Synapse Analytics
8 64 (12.28%) Azure DevOps
9 59 (11.32%) Power Automate
10 50 (9.60%) Dynamics 365
11 49 (9.40%) Serverless
12 45 (8.64%) PowerApps
13 27 (5.18%) Amazon S3
14 22 (4.22%) Azure Logic Apps
15 20 (3.84%) AWS Lambda
16 19 (3.65%) Azure Functions
16 19 (3.65%) Azure Key Vault
17 18 (3.45%) Amazon Kinesis
18 16 (3.07%) Azure Monitor
Communications & Networking
1 4 (0.77%) Firewall
2 3 (0.58%) VPN
3 1 (0.19%) DNS
3 1 (0.19%) Network Security
3 1 (0.19%) SSL
Database & Business Intelligence
1 160 (30.71%) Data Warehouse
2 131 (25.14%) Power BI
3 119 (22.84%) Amazon Athena
4 106 (20.35%) Big Data
5 99 (19.00%) Apache Arrow
5 99 (19.00%) Dremio
6 83 (15.93%) Apache Ignite
7 48 (9.21%) Azure SQL Database
8 39 (7.49%) SQL Server
9 32 (6.14%) NoSQL
10 28 (5.37%) Amazon Redshift
11 23 (4.41%) BigQuery
12 22 (4.22%) Relational Database
13 19 (3.65%) Delta Lake
14 16 (3.07%) Hadoop
15 15 (2.88%) DynamoDB
15 15 (2.88%) Metadata
15 15 (2.88%) OLTP
15 15 (2.88%) Spark SQL
16 14 (2.69%) SQL Server Integration Services
Development Applications
1 33 (6.33%) Git
2 10 (1.92%) Jenkins
3 8 (1.54%) JIRA
4 6 (1.15%) SonarQube
4 6 (1.15%) SQL Server Management Studio (SSMS)
4 6 (1.15%) Visual Studio Team System
5 4 (0.77%) Deequ
6 3 (0.58%) ERwin
6 3 (0.58%) kappa
6 3 (0.58%) Maven
7 2 (0.38%) Ant
7 2 (0.38%) ER Studio
7 2 (0.38%) GitLab
7 2 (0.38%) Gradle
7 2 (0.38%) JUnit
7 2 (0.38%) Liquibase
7 2 (0.38%) MLflow
8 1 (0.19%) Octopus Deploy
8 1 (0.19%) TestComplete
8 1 (0.19%) Zephyr
General
1 209 (40.12%) Finance
2 126 (24.18%) Social Skills
3 101 (19.39%) Banking
4 84 (16.12%) Investment Banking
5 83 (15.93%) Front Office
6 81 (15.55%) Analytical Skills
7 45 (8.64%) Public Sector
8 40 (7.68%) Retail
9 30 (5.76%) General Ledger
10 18 (3.45%) Pharmaceutical
11 9 (1.73%) Influencing Skills
12 8 (1.54%) Marketing
13 7 (1.34%) Presentation Skills
14 6 (1.15%) Legal
15 5 (0.96%) Financial Institution
16 4 (0.77%) Inclusion and Diversity
17 3 (0.58%) Billing
17 3 (0.58%) Documentation Skills
17 3 (0.58%) Telecoms
18 2 (0.38%) Czech Language
Job Titles
1 135 (25.91%) Data Engineer
2 123 (23.61%) Architect
3 65 (12.48%) Solutions Architect
4 64 (12.28%) Lead
5 63 (12.09%) Azure Engineer
6 61 (11.71%) AWS Engineer
7 57 (10.94%) Senior
8 56 (10.75%) Azure Data Engineer
9 55 (10.56%) Data Architect
10 52 (9.98%) Developer
11 49 (9.40%) Software Engineer
12 47 (9.02%) Consultant
13 33 (6.33%) Analyst
13 33 (6.33%) Python Engineer
14 29 (5.57%) Java Engineer
15 28 (5.37%) Java Software Engineer
15 28 (5.37%) Python Software Engineer
16 27 (5.18%) Senior Software Engineer
17 26 (4.99%) AWS Software Engineer
18 25 (4.80%) Azure Architect
Libraries, Frameworks & Software Standards
1 99 (19.00%) gRPC
1 99 (19.00%) Protocol Buffers
2 84 (16.12%) NumPy
2 84 (16.12%) Pandas
3 83 (15.93%) SciPy
4 67 (12.86%) PySpark
5 24 (4.61%) Kafka
6 20 (3.84%) JSON
7 13 (2.50%) .NET
7 13 (2.50%) ARM Templates
7 13 (2.50%) XML
8 9 (1.73%) Apache Avro
9 8 (1.54%) Oracle Fusion
10 7 (1.34%) REST
10 7 (1.34%) Web Services
11 6 (1.15%) Middleware
12 5 (0.96%) JSON Schema
13 4 (0.77%) ADO
13 4 (0.77%) Apache NiFi
13 4 (0.77%) Great Expectations
Miscellaneous
1 101 (19.39%) Hedge funds
2 83 (15.93%) Derivative
2 83 (15.93%) Equities
2 83 (15.93%) Fixed Income
2 83 (15.93%) Foreign Exchange (FX)
3 37 (7.10%) Data Structures
4 16 (3.07%) Clustering
5 15 (2.88%) Product Ownership
6 8 (1.54%) Pricing Data
7 7 (1.34%) Data Fabric
7 7 (1.34%) Distributed Computing
8 6 (1.15%) Reference Data
9 5 (0.96%) Algorithms
9 5 (0.96%) Data Centre
9 5 (0.96%) Hybrid Cloud
9 5 (0.96%) Management Information System
9 5 (0.96%) Self-Motivation
10 4 (0.77%) Blockchain
10 4 (0.77%) Cloud Native
10 4 (0.77%) Renewable Energy
Operating Systems
1 17 (3.26%) Linux
2 4 (0.77%) Windows
3 2 (0.38%) Unix
4 1 (0.19%) Android
4 1 (0.19%) Apple iOS
4 1 (0.19%) VMS
4 1 (0.19%) Windows Server
4 1 (0.19%) Windows Server 2012
Processes & Methodologies
1 185 (35.51%) Agile
2 145 (27.83%) Business Intelligence
3 142 (27.26%) DevOps
4 140 (26.87%) Data Modelling
5 129 (24.76%) Analytics
6 125 (23.99%) ETL
7 102 (19.58%) Asset Management
8 98 (18.81%) Software Engineering
9 92 (17.66%) Data Pipeline
10 89 (17.08%) Data Engineering
11 87 (16.70%) Investment Management
12 70 (13.44%) Data Governance
13 64 (12.28%) CI/CD
14 53 (10.17%) Migration
14 53 (10.17%) Problem-Solving
15 52 (9.98%) Data Architecture
16 49 (9.40%) Data Integration
17 48 (9.21%) Visualisation
18 44 (8.45%) Line Management
19 41 (7.87%) Machine Learning
Programming Languages
1 244 (46.83%) Python
2 191 (36.66%) SQL
3 125 (23.99%) Java
4 99 (19.00%) JavaScript
5 83 (15.93%) TypeScript
6 27 (5.18%) T-SQL
7 25 (4.80%) PowerShell
8 23 (4.41%) Go
8 23 (4.41%) Scala
9 14 (2.69%) C#
10 10 (1.92%) R
11 9 (1.73%) Data Analysis Expressions
12 7 (1.34%) Bash
12 7 (1.34%) Bicep
13 4 (0.77%) X++
14 3 (0.58%) C
14 3 (0.58%) C++
15 2 (0.38%) Shell Script
15 2 (0.38%) U-SQL
16 1 (0.19%) Kusto Query Language
Qualifications
1 53 (10.17%) Degree
2 43 (8.25%) Security Cleared
3 38 (7.29%) SC Cleared
4 18 (3.45%) AWS Certification
5 15 (2.88%) DV Cleared
6 12 (2.30%) Computer Science Degree
7 11 (2.11%) Azure Certification
7 11 (2.11%) Master's Degree
8 3 (0.58%) AWS Certified Solutions Architect
8 3 (0.58%) CIMA
8 3 (0.58%) Microsoft Certification
9 1 (0.19%) ISO 27001 Lead Implementer
9 1 (0.19%) PhD
9 1 (0.19%) PMI Certification
9 1 (0.19%) PMP
Quality Assurance & Compliance
1 78 (14.97%) Data Quality
2 17 (3.26%) QA
3 6 (1.15%) GDPR
4 4 (0.77%) Accessibility
4 4 (0.77%) ISO/IEC 27001
5 3 (0.58%) ISO 22301
5 3 (0.58%) PMO
6 2 (0.38%) NIST
6 2 (0.38%) SLA
7 1 (0.19%) CDISC
7 1 (0.19%) COBIT
7 1 (0.19%) Cyber Essentials
7 1 (0.19%) GxP
System Software
1 20 (3.84%) Docker
2 8 (1.54%) Virtual Machines
3 5 (0.96%) Active Directory
4 2 (0.38%) HDFS
Systems Management
1 64 (12.28%) Terraform
2 39 (7.49%) Kubernetes
3 19 (3.65%) Ansible
4 16 (3.07%) Prometheus
5 11 (2.11%) Puppet
6 6 (1.15%) HP Fortify
7 2 (0.38%) Ambari
7 2 (0.38%) Oozie
8 1 (0.19%) Kibana
8 1 (0.19%) Kubeflow
Vendors
1 145 (27.83%) Databricks
2 126 (24.18%) Microsoft
3 27 (5.18%) SAP
4 21 (4.03%) Google
5 19 (3.65%) Oracle
6 8 (1.54%) Informatica
6 8 (1.54%) Salesforce
7 7 (1.34%) Dataiku
8 6 (1.15%) Alteryx
8 6 (1.15%) ServiceNow
8 6 (1.15%) Splunk
8 6 (1.15%) Trillium
9 5 (0.96%) Talend
10 3 (0.58%) Ab Initio
10 3 (0.58%) BiZZdesign
10 3 (0.58%) Cloudera
10 3 (0.58%) Teradata
11 2 (0.38%) Marketo
11 2 (0.38%) PeopleSoft
11 2 (0.38%) Salesforce Marketing Cloud