Big Data Contracts

Big Data
UK

The following table provides summary statistics for contract job vacancies with a requirement for Big Data skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Big Data over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 237 232 153
Rank change year-on-year -5 -79 -36
Contract jobs citing Big Data 415 659 1,623
As % of all contract jobs advertised in the UK 0.98% 1.15% 1.86%
As % of the Database & Business Intelligence category 5.71% 6.45% 9.28%
Number of daily rates quoted 309 451 1,041
10th Percentile £390 £463 £450
25th Percentile £475 £503 £513
Median daily rate (50th Percentile) £600 £580 £600
Median % change year-on-year +3.45% -3.33% +6.67%
75th Percentile £750 £714 £695
90th Percentile £850 £800 £788
UK excluding London median daily rate £533 £550 £550
% change year-on-year -3.18% - +3.53%
Number of hourly rates quoted 12 19 3
10th Percentile £18.20 £35.00 £59.40
25th Percentile £23.30 £62.00 £59.63
Median hourly rate £35.25 £78.00 £60.50
Median % change year-on-year -54.81% +28.93% +61.33%
75th Percentile £44.69 £86.25 £76.33
90th Percentile £48.63 £90.00 £85.07
UK excluding London median hourly rate £19.38 £78.00 £60.00
% change year-on-year -75.16% +30.00% +144.90%

All Database and Business Intelligence Skills
UK

Big Data is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,263 10,212 17,493
As % of all contract IT jobs advertised in the UK 17.07% 17.88% 20.00%
Number of daily rates quoted 5,202 7,271 12,451
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.92%
Number of hourly rates quoted 145 180 194
10th Percentile £14.00 £21.24 £15.37
25th Percentile £20.98 £32.30 £22.43
Median hourly rate £40.00 £60.00 £45.00
Median % change year-on-year -33.33% +33.33% +69.81%
75th Percentile £61.60 £73.75 £64.94
90th Percentile £74.00 £82.55 £75.00
UK excluding London median hourly rate £40.00 £56.95 £35.00
% change year-on-year -29.76% +62.71% +43.44%

Big Data
Job Vacancy Trend

Job postings citing Big Data as a proportion of all IT jobs advertised.

Job vacancy trend for Big Data in the UK

Big Data
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Big Data.

Daily rate trend for Big Data in the UK

Big Data
Daily Rate Histogram

Daily rate distribution for jobs citing Big Data over the 6 months to 15 May 2024.

Daily rate histogram for Big Data in the UK

Big Data
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Big Data.

Hourly rate trend for Big Data in the UK

Big Data
Hourly Rate Histogram

Hourly rate distribution of jobs citing Big Data over the 6 months to 15 May 2024.

Hourly rate histogram for Big Data in the UK

Big Data
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Big Data within the UK over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -27 365 £600 +2.13% 190
London -24 242 £650 +8.33% 105
Work from Home +23 147 £625 +6.38% 98
UK excluding London +56 130 £533 -3.18% 100
North of England +44 41 £525 -4.55% 22
Midlands +48 35 £650 +23.81% 17
South East +10 27 £425 -20.93% 11
Yorkshire +38 24 £550 - 8
West Midlands +27 23 £675 +22.73% 14
Scotland +55 19 £550 -21.43% 13
North West +24 17 £510 +7.37% 10
East Midlands +23 12 £513 +2.50% 3
South West -10 5 £450 -20.00% 19
East of England +3 2 £400 -31.91% 8
Northern Ireland - 1 £425 - 8

Big Data
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 118 (28.43%) Apache Spark
2 43 (10.36%) Apache Airflow
3 38 (9.16%) Apache
4 6 (1.45%) Confluence
5 4 (0.96%) IIS
5 4 (0.96%) Microsoft Exchange
6 2 (0.48%) Apache Solr
6 2 (0.48%) ArcGIS
6 2 (0.48%) Jupyter
6 2 (0.48%) nginx
7 1 (0.24%) Apache Pulsar
7 1 (0.24%) Cloud Foundry
7 1 (0.24%) SAS
7 1 (0.24%) SharePoint
7 1 (0.24%) Tornado
Applications
1 13 (3.13%) Microsoft Excel
2 3 (0.72%) Spreadsheet
3 1 (0.24%) Microsoft PowerPoint
Cloud Services
1 156 (37.59%) AWS
2 154 (37.11%) Azure
3 73 (17.59%) GCP
4 53 (12.77%) Power Platform
5 48 (11.57%) Serverless
6 38 (9.16%) Snowflake
7 31 (7.47%) Azure Data Factory
8 30 (7.23%) Amazon S3
9 27 (6.51%) AWS Lambda
10 23 (5.54%) Azure Synapse Analytics
11 21 (5.06%) dbt
12 19 (4.58%) Azure DevOps
13 17 (4.10%) Amazon EMR
13 17 (4.10%) Cloud Computing
14 16 (3.86%) Azure Logic Apps
15 12 (2.89%) Entra ID
15 12 (2.89%) GitHub
16 11 (2.65%) Azure Key Vault
17 10 (2.41%) Power Automate
18 9 (2.17%) PowerApps
Communications & Networking
1 15 (3.61%) Intrusion Detection
1 15 (3.61%) Network Security
2 5 (1.20%) FTP
3 4 (0.96%) SAN
4 2 (0.48%) Internet
5 1 (0.24%) Broadband
5 1 (0.24%) Firewall
5 1 (0.24%) HTTPS
5 1 (0.24%) Wireless
Database & Business Intelligence
1 106 (25.54%) Data Lake
2 102 (24.58%) Data Warehouse
3 75 (18.07%) Hadoop
4 47 (11.33%) Power BI
5 37 (8.92%) Amazon Athena
6 35 (8.43%) Amazon Redshift
7 32 (7.71%) Apache Hive
7 32 (7.71%) BigQuery
8 31 (7.47%) Tableau
9 25 (6.02%) SQL Server
10 22 (5.30%) NoSQL
11 19 (4.58%) Delta Lake
11 19 (4.58%) Relational Database
12 17 (4.10%) Impala
13 16 (3.86%) Apache Arrow
13 16 (3.86%) Dremio
14 15 (3.61%) Metadata
14 15 (3.61%) Spark SQL
15 12 (2.89%) OLTP
16 11 (2.65%) HBase
Development Applications
1 45 (10.84%) Git
2 22 (5.30%) JIRA
3 13 (3.13%) Jenkins
4 6 (1.45%) Cypress.io
4 6 (1.45%) Maven
4 6 (1.45%) Subversion
4 6 (1.45%) Visual Studio Team System
5 5 (1.20%) ERwin
5 5 (1.20%) TeamCity
6 4 (0.96%) Bitbucket
6 4 (0.96%) Team Foundation Server
7 3 (0.72%) GitLab
7 3 (0.72%) JMeter
7 3 (0.72%) LoadRunner
7 3 (0.72%) RStudio
7 3 (0.72%) Selenium
7 3 (0.72%) Visual Studio
8 2 (0.48%) CircleCI
8 2 (0.48%) kappa
8 2 (0.48%) Liquibase
General
1 101 (24.34%) Analytical Skills
2 100 (24.10%) Social Skills
3 93 (22.41%) Finance
4 34 (8.19%) Banking
5 30 (7.23%) Public Sector
6 12 (2.89%) Investment Banking
7 9 (2.17%) Marketing
7 9 (2.17%) Pharmaceutical
7 9 (2.17%) Presentation Skills
8 7 (1.69%) Financial Institution
8 7 (1.69%) Health Technology
8 7 (1.69%) Manufacturing
9 6 (1.45%) Retail
10 5 (1.20%) Legal
10 5 (1.20%) Telecoms
11 4 (0.96%) Publishing
12 3 (0.72%) Back Office
12 3 (0.72%) Documentation Skills
12 3 (0.72%) Police
13 2 (0.48%) German Language
Job Titles
1 104 (25.06%) Architect
2 89 (21.45%) Data Engineer
3 48 (11.57%) Developer
4 47 (11.33%) Data Architect
5 43 (10.36%) Solutions Architect
6 36 (8.67%) Senior
7 34 (8.19%) Analyst
8 26 (6.27%) Big Data Engineer
9 23 (5.54%) AWS Engineer
9 23 (5.54%) Lead
10 22 (5.30%) Cloud Architect
10 22 (5.30%) Data Analyst
11 18 (4.34%) Azure Architect
11 18 (4.34%) Cloud Solutions Architect
12 17 (4.10%) AWS Architect
12 17 (4.10%) Consultant
12 17 (4.10%) Data Scientist
12 17 (4.10%) Site Engineer
12 17 (4.10%) Site Reliability Engineer
13 15 (3.61%) Azure Engineer
Libraries, Frameworks & Software Standards
1 66 (15.90%) PySpark
2 49 (11.81%) Kafka
3 22 (5.30%) Apache NiFi
4 16 (3.86%) gRPC
4 16 (3.86%) JSON
4 16 (3.86%) Protocol Buffers
4 16 (3.86%) XML
5 12 (2.89%) .NET
5 12 (2.89%) Pandas
6 10 (2.41%) TensorFlow
6 10 (2.41%) Web Services
7 8 (1.93%) Apache Avro
7 8 (1.93%) SAML
8 7 (1.69%) React
9 6 (1.45%) ARM Templates
9 6 (1.45%) scikit-learn
10 5 (1.20%) Elastic Stack
10 5 (1.20%) NumPy
10 5 (1.20%) REST
10 5 (1.20%) Spring
Miscellaneous
1 30 (7.23%) Algorithms
2 25 (6.02%) Hedge funds
3 23 (5.54%) Management Information System
4 21 (5.06%) Clustering
5 15 (3.61%) Cyber Defence
5 15 (3.61%) Distributed Applications
6 14 (3.37%) Data Centre
7 13 (3.13%) Data Protection Act
7 13 (3.13%) Data Structures
7 13 (3.13%) Greenfield Project
8 11 (2.65%) Distributed Computing
9 10 (2.41%) Cloud Native
10 9 (2.17%) Freedom of Information
10 9 (2.17%) Freedom of Information Act
10 9 (2.17%) Virtual Team
11 7 (1.69%) Distributed Systems
11 7 (1.69%) Onboarding
11 7 (1.69%) Product Ownership
12 6 (1.45%) Analytical Mindset
13 5 (1.20%) Self-Motivation
Operating Systems
1 41 (9.88%) Linux
2 22 (5.30%) Unix
3 17 (4.10%) Windows
4 13 (3.13%) Android
4 13 (3.13%) Apple iOS
5 8 (1.93%) VMS
6 4 (0.96%) Windows Server
6 4 (0.96%) Windows Server 2016
6 4 (0.96%) Windows Server 2019
Processes & Methodologies
1 135 (32.53%) Analytics
2 134 (32.29%) Data Modelling
3 117 (28.19%) ETL
4 108 (26.02%) Data Pipeline
5 105 (25.30%) Agile
6 89 (21.45%) Business Intelligence
7 81 (19.52%) Data Engineering
8 78 (18.80%) DevOps
9 76 (18.31%) Machine Learning
10 70 (16.87%) Problem-Solving
11 65 (15.66%) CI/CD
12 64 (15.42%) Data Analysis
12 64 (15.42%) Data Science
13 50 (12.05%) Data Governance
14 49 (11.81%) Computer Science
15 48 (11.57%) Data Management
15 48 (11.57%) Migration
16 41 (9.88%) Data Integration
17 40 (9.64%) Visualisation
18 36 (8.67%) Data Architecture
Programming Languages
1 222 (53.49%) Python
2 180 (43.37%) SQL
3 85 (20.48%) Java
4 53 (12.77%) Scala
5 26 (6.27%) JavaScript
6 20 (4.82%) Go
6 20 (4.82%) R
7 18 (4.34%) PowerShell
8 17 (4.10%) C#
9 10 (2.41%) Shell Script
10 7 (1.69%) Perl
11 5 (1.20%) Bash
12 3 (0.72%) Data Analysis Expressions
12 3 (0.72%) PL/SQL
12 3 (0.72%) Rust
13 2 (0.48%) T-SQL
13 2 (0.48%) U-SQL
13 2 (0.48%) VBA
14 1 (0.24%) Gremlin
14 1 (0.24%) Kotlin
Qualifications
1 55 (13.25%) Degree
2 53 (12.77%) Security Cleared
3 31 (7.47%) DV Cleared
4 30 (7.23%) SC Cleared
5 23 (5.54%) Computer Science Degree
6 19 (4.58%) AWS Certification
7 10 (2.41%) Master's Degree
8 8 (1.93%) Azure Certification
9 5 (1.20%) AWS Certified Solutions Architect
9 5 (1.20%) Microsoft Certification
10 4 (0.96%) CISSP
11 3 (0.72%) AWS Certified Developer
11 3 (0.72%) AWS Certified DevOps Engineer
11 3 (0.72%) BPSS Clearance
12 2 (0.48%) Numerate Degree
Quality Assurance & Compliance
1 63 (15.18%) Data Quality
2 15 (3.61%) Actionable Recommendations
3 8 (1.93%) QA
4 5 (1.20%) Accessibility
5 4 (0.96%) ISO/IEC 27001
5 4 (0.96%) NIST
6 3 (0.72%) GDPR
7 2 (0.48%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
7 2 (0.48%) MiFID
7 2 (0.48%) NCSC
7 2 (0.48%) PCI DSS
7 2 (0.48%) PMO
7 2 (0.48%) SLA
8 1 (0.24%) EMIR
8 1 (0.24%) FATCA
System Software
1 17 (4.10%) Docker
2 14 (3.37%) HDFS
3 4 (0.96%) Active Directory
4 1 (0.24%) Apache Flume
4 1 (0.24%) Apache ZooKeeper
4 1 (0.24%) KVM
4 1 (0.24%) VMware ESXi
4 1 (0.24%) VMware Infrastructure
Systems Management
1 59 (14.22%) Terraform
2 44 (10.60%) Kubernetes
3 20 (4.82%) Ansible
4 17 (4.10%) Prometheus
5 14 (3.37%) Puppet
6 8 (1.93%) Hadoop YARN
7 4 (0.96%) Argo
8 3 (0.72%) Oozie
9 2 (0.48%) Ambari
9 2 (0.48%) Consul
9 2 (0.48%) Packer
9 2 (0.48%) Progress Chef
10 1 (0.24%) Ganglia
10 1 (0.24%) ITRS Geneos
10 1 (0.24%) Kibana
10 1 (0.24%) Nagios
10 1 (0.24%) vCenter Server
10 1 (0.24%) vRealize
Vendors
1 79 (19.04%) Databricks
2 52 (12.53%) Microsoft
3 32 (7.71%) Google
4 21 (5.06%) Oracle
4 21 (5.06%) Talend
5 19 (4.58%) Informatica
6 10 (2.41%) Red Hat
7 8 (1.93%) Teradata
8 7 (1.69%) Salesforce
9 5 (1.20%) Cloudera
9 5 (1.20%) SAP
10 4 (0.96%) Brio
10 4 (0.96%) Foundry
10 4 (0.96%) IBM
10 4 (0.96%) Okta
10 4 (0.96%) Palantir
10 4 (0.96%) Sage
10 4 (0.96%) Splunk
10 4 (0.96%) Symantec
10 4 (0.96%) Varonis