Apache Hadoop
UK

The following table provides summary statistics for contract job vacancies with a requirement for Hadoop skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Hadoop over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 448 420 333
Rank change year-on-year -28 -87 -134
Contract jobs citing Hadoop 126 299 721
As % of all contract jobs advertised in the UK 0.30% 0.52% 0.82%
As % of the Database & Business Intelligence category 1.73% 2.93% 4.12%
Number of daily rates quoted 93 214 449
10th Percentile £337 £464 £425
25th Percentile £388 £513 £506
Median daily rate (50th Percentile) £500 £575 £600
Median % change year-on-year -13.04% -4.17% +9.09%
75th Percentile £613 £697 £713
90th Percentile £748 £750 £813
UK excluding London median daily rate £478 £540 £540
% change year-on-year -11.57% - +8.00%
Number of hourly rates quoted 5 9 2
10th Percentile - £76.50 £57.68
25th Percentile £41.25 - £57.94
Median hourly rate £45.00 £78.00 £60.25
Median % change year-on-year -42.31% +29.46% +123.15%
75th Percentile £48.75 £90.00 £62.31
90th Percentile £60.75 - £62.43
UK excluding London median hourly rate £67.50 £78.00 -
% change year-on-year -13.46% - -

All Database and Business Intelligence Skills
UK

Hadoop is in the Databases and Business Intelligence category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for database or business intelligence skills.

Contract vacancies with a requirement for database or business intelligence skills 7,263 10,212 17,493
As % of all contract IT jobs advertised in the UK 17.07% 17.88% 20.00%
Number of daily rates quoted 5,202 7,271 12,451
10th Percentile £350 £375 £375
25th Percentile £425 £450 £450
Median daily rate (50th Percentile) £525 £540 £545
Median % change year-on-year -2.78% -0.92% +9.00%
75th Percentile £650 £663 £650
90th Percentile £775 £750 £750
UK excluding London median daily rate £475 £500 £495
% change year-on-year -5.00% +1.01% +10.92%
Number of hourly rates quoted 145 180 194
10th Percentile £14.00 £21.24 £15.37
25th Percentile £20.98 £32.30 £22.43
Median hourly rate £40.00 £60.00 £45.00
Median % change year-on-year -33.33% +33.33% +69.81%
75th Percentile £61.60 £73.75 £64.94
90th Percentile £74.00 £82.55 £75.00
UK excluding London median hourly rate £40.00 £56.95 £35.00
% change year-on-year -29.76% +62.71% +43.44%

Hadoop
Job Vacancy Trend

Job postings citing Hadoop as a proportion of all IT jobs advertised.

Job vacancy trend for Hadoop in the UK

Hadoop
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Hadoop.

Daily rate trend for Hadoop in the UK

Hadoop
Daily Rate Histogram

Daily rate distribution for jobs citing Hadoop over the 6 months to 15 May 2024.

Daily rate histogram for Hadoop in the UK

Hadoop
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Hadoop.

Hourly rate trend for Hadoop in the UK

Hadoop
Hourly Rate Histogram

Hourly rate distribution of jobs citing Hadoop over the 6 months to 15 May 2024.

Hourly rate histogram for Hadoop in the UK

Hadoop
Top 15 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Hadoop within the UK over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -56 107 £504 -12.43% 72
London -17 59 £550 -4.76% 37
UK excluding London +11 48 £478 -11.57% 44
Work from Home +38 44 £504 -12.81% 49
North of England +25 19 £507 +6.74% 13
Midlands +26 16 £413 -23.61% 6
East Midlands +26 13 £380 -5.00% 1
Yorkshire +27 10 £507 -3.43% 3
North West +16 9 £535 +12.63% 7
South East +9 6 £463 -19.57% 5
Scotland +50 4 £608 - 6
West Midlands +2 3 £550 +1.85% 5
East of England +6 1 £350 -36.36% 3
Northern Ireland +6 1 £425 - 2
South West -6 1 £533 -19.17% 7

Hadoop
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 66 (52.38%) Apache Spark
2 14 (11.11%) Apache
3 8 (6.35%) Apache Airflow
4 5 (3.97%) Confluence
5 3 (2.38%) SAS
6 2 (1.59%) Apache Solr
7 1 (0.79%) Apache Pulsar
7 1 (0.79%) Cloud Foundry
Business Applications
1 1 (0.79%) SAP Hybris
Cloud Services
1 38 (30.16%) AWS
2 30 (23.81%) Azure
3 24 (19.05%) GCP
4 17 (13.49%) PaaS
5 14 (11.11%) Amazon S3
6 12 (9.52%) Serverless
7 11 (8.73%) Cloud Computing
8 7 (5.56%) Azure Data Lake Analytics
9 6 (4.76%) Snowflake
10 5 (3.97%) Amazon EMR
10 5 (3.97%) AWS Lambda
10 5 (3.97%) Azure Synapse Analytics
11 3 (2.38%) Amazon EC2
11 3 (2.38%) Amazon EKS
11 3 (2.38%) Amazon Kinesis
11 3 (2.38%) Google Kubernetes Engine
11 3 (2.38%) OpenShift
11 3 (2.38%) Power Platform
11 3 (2.38%) Virtual Private Cloud
12 2 (1.59%) Akamai
Communications & Networking
1 16 (12.70%) FTP
2 4 (3.17%) Firewall
2 4 (3.17%) Intrusion Detection
2 4 (3.17%) TCP/IP
2 4 (3.17%) tcpdump
2 4 (3.17%) Wireshark
3 2 (1.59%) DHCP
3 2 (1.59%) DNS
3 2 (1.59%) Internet
Database & Business Intelligence
1 75 (59.52%) Big Data
2 31 (24.60%) Apache Hive
3 24 (19.05%) Data Warehouse
4 23 (18.25%) Tableau
5 21 (16.67%) Amazon Redshift
6 17 (13.49%) Impala
7 16 (12.70%) Data Lake
8 13 (10.32%) Amazon Athena
8 13 (10.32%) HBase
9 12 (9.52%) BigQuery
10 8 (6.35%) Amazon RDS
10 8 (6.35%) Apache Cassandra
10 8 (6.35%) MySQL
10 8 (6.35%) Sqoop
11 7 (5.56%) Presto
11 7 (5.56%) Relational Database
11 7 (5.56%) SQL Server
12 6 (4.76%) Elasticsearch
12 6 (4.76%) PostgreSQL
13 5 (3.97%) Oracle Reports
Development Applications
1 20 (15.87%) Git
2 16 (12.70%) Jenkins
3 12 (9.52%) JIRA
4 7 (5.56%) Maven
5 6 (4.76%) GitLab
5 6 (4.76%) Subversion
6 5 (3.97%) TeamCity
7 4 (3.17%) IDA Disassembler
8 3 (2.38%) Cypress.io
9 2 (1.59%) Bitbucket
9 2 (1.59%) Gradle
9 2 (1.59%) Liquibase
General
1 47 (37.30%) Analytical Skills
2 37 (29.37%) Social Skills
3 32 (25.40%) Finance
4 15 (11.90%) Banking
5 11 (8.73%) Public Sector
6 8 (6.35%) Manufacturing
7 6 (4.76%) Telecoms
8 5 (3.97%) Investment Banking
9 4 (3.17%) Electronics
9 4 (3.17%) Marketing
10 3 (2.38%) Presentation Skills
11 2 (1.59%) Legal
11 2 (1.59%) Organisational Skills
12 1 (0.79%) Corporate Banking
12 1 (0.79%) Inclusion and Diversity
12 1 (0.79%) Law
12 1 (0.79%) Retail
Job Titles
1 22 (17.46%) Architect
2 20 (15.87%) Developer
3 16 (12.70%) Implementation Specialist
4 14 (11.11%) Data Engineer
4 14 (11.11%) Senior
5 13 (10.32%) Data Scientist
6 12 (9.52%) Analyst
6 12 (9.52%) Data Analyst
7 11 (8.73%) Solutions Architect
8 8 (6.35%) Data Architect
9 5 (3.97%) Hadoop Developer
9 5 (3.97%) Senior Analyst
9 5 (3.97%) Senior Data Analyst
10 4 (3.17%) Business Data Analyst
11 3 (2.38%) Banking Analyst
11 3 (2.38%) Consultant
11 3 (2.38%) Scala Developer
11 3 (2.38%) Senior Data Engineer
11 3 (2.38%) Senior Developer
11 3 (2.38%) SQL Analyst
Libraries, Frameworks & Software Standards
1 40 (31.75%) Kafka
2 18 (14.29%) LDAP
3 8 (6.35%) PySpark
4 5 (3.97%) Elastic Stack
5 4 (3.17%) Apache NiFi
5 4 (3.17%) OLE
6 3 (2.38%) .NET
6 3 (2.38%) .NET Core
6 3 (2.38%) JSON
6 3 (2.38%) XML
7 2 (1.59%) Apache Avro
7 2 (1.59%) Java Concurrency
8 1 (0.79%) Anaconda
8 1 (0.79%) SAML
8 1 (0.79%) TensorFlow
Miscellaneous
1 19 (15.08%) Algorithms
2 16 (12.70%) Replication
3 8 (6.35%) Self-Motivation
4 7 (5.56%) Cloud Native
5 4 (3.17%) Cyber Kill Chain
5 4 (3.17%) Public Cloud
5 4 (3.17%) YARA
6 3 (2.38%) Data Protection Act
6 3 (2.38%) Data Structures
6 3 (2.38%) Distributed Systems
6 3 (2.38%) Management Information System
7 2 (1.59%) Cyber Threat
7 2 (1.59%) Data Centre
7 2 (1.59%) Derivative
7 2 (1.59%) Market Risk
7 2 (1.59%) Onboarding
7 2 (1.59%) Social Media
7 2 (1.59%) Virtual Team
8 1 (0.79%) Analytical Mindset
8 1 (0.79%) Legacy Systems
Operating Systems
1 25 (19.84%) Linux
2 22 (17.46%) Unix
3 20 (15.87%) Windows
Processes & Methodologies
1 40 (31.75%) Data Modelling
2 34 (26.98%) ETL
3 33 (26.19%) Analytics
4 30 (23.81%) Agile
4 30 (23.81%) Problem-Solving
5 25 (19.84%) CI/CD
5 25 (19.84%) Data Science
5 25 (19.84%) Machine Learning
6 24 (19.05%) Business Intelligence
6 24 (19.05%) Computer Science
6 24 (19.05%) Data Analysis
6 24 (19.05%) Disaster Recovery
7 23 (18.25%) DevOps
8 20 (15.87%) Mathematics
8 20 (15.87%) Visualisation
9 19 (15.08%) Migration
10 18 (14.29%) Data Integration
10 18 (14.29%) Data Visualisation
11 17 (13.49%) Capacity Management
11 17 (13.49%) Statistics
Programming Languages
1 70 (55.56%) Python
2 51 (40.48%) SQL
3 38 (30.16%) Java
4 22 (17.46%) Scala
5 16 (12.70%) R
6 9 (7.14%) Perl
7 6 (4.76%) Shell Script
8 5 (3.97%) JavaScript
9 4 (3.17%) Bash
9 4 (3.17%) PL/SQL
10 3 (2.38%) C#
10 3 (2.38%) Groovy
11 2 (1.59%) Go
11 2 (1.59%) Haskell
11 2 (1.59%) Ruby
11 2 (1.59%) TypeScript
11 2 (1.59%) U-SQL
12 1 (0.79%) HiveQL
12 1 (0.79%) PowerShell
Qualifications
1 18 (14.29%) Degree
2 12 (9.52%) Computer Science Degree
3 7 (5.56%) Security Cleared
4 4 (3.17%) Numerate Degree
5 3 (2.38%) AWS Certification
5 3 (2.38%) DV Cleared
5 3 (2.38%) SC Cleared
6 1 (0.79%) AWS Certified Solutions Architect
6 1 (0.79%) OCP
6 1 (0.79%) Oracle Certification
Quality Assurance & Compliance
1 16 (12.70%) Data Quality
2 6 (4.76%) GDPR
2 6 (4.76%) NIST
3 2 (1.59%) ISO/IEC 27001
3 2 (1.59%) ISO/IEC 27002 (supersedes ISO/IEC 17799)
3 2 (1.59%) PCI DSS
3 2 (1.59%) QA
4 1 (0.79%) Accessibility
4 1 (0.79%) EMIR
4 1 (0.79%) FATCA
4 1 (0.79%) MiFID
System Software
1 32 (25.40%) HDFS
2 16 (12.70%) Active Directory
2 16 (12.70%) NFS
3 7 (5.56%) Docker
4 4 (3.17%) Snort
5 1 (0.79%) Apache Flume
5 1 (0.79%) Apache ZooKeeper
Systems Management
1 11 (8.73%) Kubernetes
1 11 (8.73%) Terraform
2 8 (6.35%) Hadoop YARN
3 6 (4.76%) Ansible
4 5 (3.97%) Kibana
5 3 (2.38%) Oozie
6 2 (1.59%) Ambari
6 2 (1.59%) Grafana
6 2 (1.59%) Progress Chef
6 2 (1.59%) Puppet
7 1 (0.79%) ITRS Geneos
7 1 (0.79%) Prometheus
Vendors
1 16 (12.70%) Isilon
2 15 (11.90%) Google
3 14 (11.11%) Oracle
4 12 (9.52%) Databricks
5 11 (8.73%) Microsoft
5 11 (8.73%) SAP
6 8 (6.35%) Splunk
6 8 (6.35%) Teradata
7 7 (5.56%) Dell
7 7 (5.56%) Informatica
8 6 (4.76%) Talend
9 4 (3.17%) Foundry
9 4 (3.17%) Palantir
10 3 (2.38%) Ab Initio
10 3 (2.38%) Cloudera
11 2 (1.59%) Adobe
11 2 (1.59%) Confluent
11 2 (1.59%) IBM
11 2 (1.59%) Salesforce
11 2 (1.59%) StreamSets