Apache Spark Contracts

Apache Spark
UK

The following table provides summary statistics for contract job vacancies with a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 15 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
15 May 2024
Same period 2023 Same period 2022
Rank 362 353 235
Rank change year-on-year -9 -118 -54
Contract jobs citing Apache Spark 217 394 1,108
As % of all contract jobs advertised in the UK 0.51% 0.69% 1.27%
As % of the Application Platforms category 5.24% 6.32% 10.10%
Number of daily rates quoted 157 262 727
10th Percentile £387 £475 £448
25th Percentile £438 £513 £513
Median daily rate (50th Percentile) £520 £600 £600
Median % change year-on-year -13.33% - +8.11%
75th Percentile £638 £738 £700
90th Percentile £775 £800 £814
UK excluding London median daily rate £475 £550 £550
% change year-on-year -13.64% - +8.37%
Number of hourly rates quoted 3 7 3
10th Percentile £22.93 £70.50 £62.35
25th Percentile £24.74 £74.25 £68.50
Median hourly rate £30.50 £78.00 £78.75
Median % change year-on-year -60.90% -0.95% +191.67%
75th Percentile £51.00 £84.00 £84.83
90th Percentile £61.65 £90.00 £88.47
UK excluding London median hourly rate £30.50 £78.00 -
% change year-on-year -60.90% - -

All Application Platform Skills
UK

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 4,145 6,233 10,965
As % of all contract IT jobs advertised in the UK 9.74% 10.92% 12.54%
Number of daily rates quoted 2,859 4,369 7,516
10th Percentile £256 £263 £275
25th Percentile £363 £400 £406
Median daily rate (50th Percentile) £500 £513 £513
Median % change year-on-year -2.44% - +7.89%
75th Percentile £609 £638 £625
90th Percentile £750 £750 £711
UK excluding London median daily rate £450 £475 £450
% change year-on-year -5.26% +5.56% +5.88%
Number of hourly rates quoted 160 146 221
10th Percentile £13.00 £16.08 £14.00
25th Percentile £15.45 £19.63 £16.25
Median hourly rate £29.25 £45.00 £25.00
Median % change year-on-year -35.00% +80.00% +11.11%
75th Percentile £46.18 £66.00 £53.75
90th Percentile £70.00 £79.19 £75.00
UK excluding London median hourly rate £24.50 £27.50 £20.00
% change year-on-year -10.91% +37.50% +5.26%

Apache Spark
Job Vacancy Trend

Job postings citing Apache Spark as a proportion of all IT jobs advertised.

Job vacancy trend for Apache Spark in the UK

Apache Spark
Contractor Daily Rate Trend

3-month moving average daily rate quoted in jobs citing Apache Spark.

Daily rate trend for Apache Spark in the UK

Apache Spark
Daily Rate Histogram

Daily rate distribution for jobs citing Apache Spark over the 6 months to 15 May 2024.

Daily rate histogram for Apache Spark in the UK

Apache Spark
Contractor Hourly Rate Trend

3-month moving average hourly rates quoted in jobs citing Apache Spark.

Hourly rate trend for Apache Spark in the UK

Apache Spark
Hourly Rate Histogram

Hourly rate distribution of jobs citing Apache Spark over the 6 months to 15 May 2024.

Hourly rate histogram for Apache Spark in the UK

Apache Spark
Top 16 Contract Locations

The table below looks at the demand and provides a guide to the median contractor rates quoted in IT jobs citing Apache Spark within the UK over the 6 months to 15 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Contract
IT Job Ads
Median
Daily Rate
Past 6 Months
Median Daily Rate
% Change
on Same Period
Last Year
Live
Jobs
England -45 186 £525 -12.50% 120
London -26 133 £558 -7.08% 77
UK excluding London +58 67 £475 -13.64% 58
Work from Home +35 66 £512 -21.17% 85
North of England +44 30 £510 +7.37% 11
Scotland - 16 £400 - 8
North West +30 15 £510 +7.37% 4
Yorkshire +31 14 £507 -3.43% 5
Midlands +39 12 £438 -30.00% 8
East Midlands - 9 £438 - 2
South East +13 6 £375 -41.75% 6
West Midlands +17 3 £535 -14.40% 6
East of England +5 1 £410 -28.70% 4
Northern Ireland +2 1 £425 - 4
South West -4 1 £533 +2.90% 16
North East - 1 - - 2

Apache Spark
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 57 (26.27%) Apache
2 26 (11.98%) Apache Airflow
3 1 (0.46%) Apache Pulsar
3 1 (0.46%) SAS
3 1 (0.46%) SharePoint
Applications
1 5 (2.30%) Microsoft Excel
2 2 (0.92%) Microsoft Office
2 2 (0.92%) Microsoft PowerPoint
Business Applications
1 2 (0.92%) Dynamics CRM
2 1 (0.46%) SAP GRC
Cloud Services
1 110 (50.69%) Azure
2 95 (43.78%) AWS
3 44 (20.28%) GCP
4 31 (14.29%) Serverless
5 30 (13.82%) Azure Data Factory
6 27 (12.44%) Amazon EMR
6 27 (12.44%) Amazon S3
7 24 (11.06%) Azure Synapse Analytics
8 22 (10.14%) Power Platform
9 20 (9.22%) Snowflake
10 19 (8.76%) AWS Lambda
11 12 (5.53%) Amazon EC2
11 12 (5.53%) Amazon Kinesis
12 11 (5.07%) Cloud Computing
13 10 (4.61%) Azure Logic Apps
13 10 (4.61%) Entra ID
14 9 (4.15%) GitHub
15 8 (3.69%) Azure Monitor
16 7 (3.23%) Azure Data Lake Analytics
16 7 (3.23%) Azure DevOps
Communications & Networking
1 5 (2.30%) FTP
Database & Business Intelligence
1 118 (54.38%) Big Data
2 66 (30.41%) Hadoop
3 55 (25.35%) Data Lake
4 52 (23.96%) Data Warehouse
5 34 (15.67%) NoSQL
6 33 (15.21%) Apache Hive
7 31 (14.29%) Amazon Redshift
8 23 (10.60%) Relational Database
9 22 (10.14%) Power BI
10 19 (8.76%) Delta Lake
10 19 (8.76%) Impala
11 17 (7.83%) BigQuery
11 17 (7.83%) Spark SQL
11 17 (7.83%) SQL Server
12 14 (6.45%) Tableau
13 12 (5.53%) Amazon Athena
13 12 (5.53%) HBase
14 11 (5.07%) Azure SQL Database
14 11 (5.07%) Flink
15 9 (4.15%) Parquet
Development Applications
1 36 (16.59%) Git
2 20 (9.22%) Jenkins
3 18 (8.29%) JIRA
4 9 (4.15%) Maven
5 8 (3.69%) Subversion
6 6 (2.76%) GitLab
7 5 (2.30%) TeamCity
8 4 (1.84%) Deequ
8 4 (1.84%) Gradle
8 4 (1.84%) JUnit
9 3 (1.38%) Cypress.io
9 3 (1.38%) Mockito
10 2 (0.92%) Android Studio
10 2 (0.92%) Ant
10 2 (0.92%) Jaeger
10 2 (0.92%) Liquibase
10 2 (0.92%) ScalaTest
10 2 (0.92%) Visual Studio Code
11 1 (0.46%) CircleCI
11 1 (0.46%) GoCD
General
1 60 (27.65%) Social Skills
2 55 (25.35%) Finance
3 53 (24.42%) Analytical Skills
4 24 (11.06%) Banking
5 10 (4.61%) Investment Banking
5 10 (4.61%) Public Sector
6 8 (3.69%) Marketing
7 6 (2.76%) Pharmaceutical
7 6 (2.76%) Presentation Skills
8 5 (2.30%) Manufacturing
9 4 (1.84%) Inclusion and Diversity
10 3 (1.38%) Legal
11 2 (0.92%) Czech Language
11 2 (0.92%) Telecoms
12 1 (0.46%) Back Office
12 1 (0.46%) Corporate Banking
12 1 (0.46%) Games
12 1 (0.46%) Law
12 1 (0.46%) Publishing
12 1 (0.46%) Retail
Job Titles
1 78 (35.94%) Data Engineer
2 52 (23.96%) Developer
3 35 (16.13%) Architect
4 31 (14.29%) Senior
5 22 (10.14%) Solutions Architect
6 21 (9.68%) Azure Engineer
7 20 (9.22%) Java Developer
8 18 (8.29%) Azure Data Engineer
9 17 (7.83%) Senior Data Engineer
10 14 (6.45%) Scala Developer
11 13 (5.99%) Lead
12 11 (5.07%) Data Architect
13 9 (4.15%) Analyst
13 9 (4.15%) AWS Architect
13 9 (4.15%) Cloud Engineer
13 9 (4.15%) Data Analyst
14 8 (3.69%) AWS Solution Architect
14 8 (3.69%) Lead Data Engineer
15 7 (3.23%) AWS Engineer
16 6 (2.76%) Software Engineer
Libraries, Frameworks & Software Standards
1 85 (39.17%) Kafka
2 50 (23.04%) PySpark
3 13 (5.99%) JSON
4 12 (5.53%) Elastic Stack
4 12 (5.53%) Spring Boot
5 11 (5.07%) Spring
6 10 (4.61%) RESTful
6 10 (4.61%) Spark Streaming
7 9 (4.15%) Apache Avro
8 8 (3.69%) OpenTracing
8 8 (3.69%) SAML
8 8 (3.69%) XML
9 7 (3.23%) Apache NiFi
9 7 (3.23%) Pandas
10 5 (2.30%) JSON Schema
10 5 (2.30%) Web Services
11 4 (1.84%) .NET
11 4 (1.84%) ARM Templates
11 4 (1.84%) Great Expectations
11 4 (1.84%) TensorFlow
Miscellaneous
1 16 (7.37%) Algorithms
2 15 (6.91%) Data Structures
3 12 (5.53%) Distributed Systems
4 8 (3.69%) Hedge funds
5 7 (3.23%) Cloud Native
6 5 (2.30%) Multi-touch
7 3 (1.38%) Onboarding
7 3 (1.38%) Self-Motivation
8 2 (0.92%) Cyber Threat
8 2 (0.92%) Data Protection Act
8 2 (0.92%) Derivative
8 2 (0.92%) Distributed Computing
8 2 (0.92%) Life Science
8 2 (0.92%) Market Risk
8 2 (0.92%) Virtual Team
9 1 (0.46%) Enterprise Software
9 1 (0.46%) Low-Code
9 1 (0.46%) Mobile App
9 1 (0.46%) NHS
9 1 (0.46%) Public Cloud
Operating Systems
1 13 (5.99%) Linux
2 10 (4.61%) Unix
3 2 (0.92%) Android
3 2 (0.92%) Red Hat Enterprise Linux
Processes & Methodologies
1 93 (42.86%) ETL
2 79 (36.41%) Data Pipeline
3 69 (31.80%) Agile
3 69 (31.80%) CI/CD
4 63 (29.03%) Analytics
5 53 (24.42%) Data Engineering
6 52 (23.96%) Data Modelling
7 48 (22.12%) DevOps
8 42 (19.35%) Problem-Solving
9 39 (17.97%) Continuous Integration
10 36 (16.59%) Business Intelligence
11 31 (14.29%) Data Science
11 31 (14.29%) Machine Learning
12 30 (13.82%) Test Automation
13 28 (12.90%) Software Engineering
14 27 (12.44%) Data Integration
15 24 (11.06%) Microservices
16 23 (10.60%) Containerisation
16 23 (10.60%) SDLC
17 21 (9.68%) Computer Science
Programming Languages
1 138 (63.59%) Python
2 119 (54.84%) SQL
3 87 (40.09%) Java
4 77 (35.48%) Scala
5 14 (6.45%) C#
6 10 (4.61%) R
6 10 (4.61%) Shell Script
7 9 (4.15%) Kotlin
8 8 (3.69%) C++
8 8 (3.69%) Perl
9 7 (3.23%) T-SQL
10 6 (2.76%) Bash
11 5 (2.30%) JavaScript
12 3 (1.38%) C
12 3 (1.38%) PL/SQL
13 2 (0.92%) Groovy
13 2 (0.92%) Haskell
13 2 (0.92%) U-SQL
14 1 (0.46%) Gremlin
14 1 (0.46%) TypeScript
Qualifications
1 19 (8.76%) Degree
1 19 (8.76%) Security Cleared
2 13 (5.99%) SC Cleared
3 10 (4.61%) Computer Science Degree
4 4 (1.84%) AWS Certification
4 4 (1.84%) Azure Certification
4 4 (1.84%) BPSS Clearance
4 4 (1.84%) Numerate Degree
5 3 (1.38%) DV Cleared
6 2 (0.92%) AWS Certified Solutions Architect
6 2 (0.92%) Master's Degree
6 2 (0.92%) Microsoft Certification
6 2 (0.92%) PhD
7 1 (0.46%) OCP
7 1 (0.46%) Oracle Certification
Quality Assurance & Compliance
1 30 (13.82%) Data Quality
2 4 (1.84%) GDPR
3 3 (1.38%) QA
4 2 (0.92%) Accessibility
4 2 (0.92%) California Consumer Privacy Act
5 1 (0.46%) GRC
System Software
1 24 (11.06%) Docker
2 14 (6.45%) HDFS
3 1 (0.46%) Apache Flume
3 1 (0.46%) Ceph
3 1 (0.46%) NFS
Systems Management
1 31 (14.29%) Kubernetes
2 22 (10.14%) Terraform
3 10 (4.61%) Prometheus
4 8 (3.69%) Hadoop YARN
4 8 (3.69%) Zipkin
5 4 (1.84%) Ansible
5 4 (1.84%) Grafana
6 3 (1.38%) Oozie
7 2 (0.92%) Ambari
7 2 (0.92%) Puppet
8 1 (0.46%) Docker Swarm
8 1 (0.46%) Ganglia
8 1 (0.46%) Kibana
8 1 (0.46%) Mesos
8 1 (0.46%) Podman
8 1 (0.46%) Progress Chef
8 1 (0.46%) RSA Archer
Vendors
1 56 (25.81%) Databricks
2 36 (16.59%) Microsoft
3 20 (9.22%) Google
4 19 (8.76%) Talend
5 14 (6.45%) Informatica
6 12 (5.53%) Oracle
7 9 (4.15%) Cloudera
8 6 (2.76%) Teradata
9 5 (2.30%) Splunk
10 3 (1.38%) Ab Initio
11 2 (0.92%) AppDynamics
11 2 (0.92%) CyberArk
11 2 (0.92%) SAP
12 1 (0.46%) Bloomberg
12 1 (0.46%) Confluent
12 1 (0.46%) Okta
12 1 (0.46%) OneTrust
12 1 (0.46%) Sage
12 1 (0.46%) Symantec
12 1 (0.46%) Varonis