Apache Spark Contracts with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for contract job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the contractor rates offered in vacancies that have cited Apache Spark over the 6 months to 31 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
31 May 2024
Same period 2023 Same period 2022
Rank 279 306 182
Rank change year-on-year +27 -124 +15
Contract jobs citing Apache Spark 67 160 662
As % of all contract jobs with a WFH option 0.46% 0.66% 1.50%
As % of the Application Platforms category 4.18% 5.87% 12.05%
Number of daily rates quoted 46 114 490
10th Percentile £395 £488 £449
25th Percentile £453 £534 £513
Median daily rate (50th Percentile) £507 £650 £588
Median % change year-on-year -22.00% +10.64% +5.86%
75th Percentile £600 £750 £700
90th Percentile £729 £788 £800
UK median daily rate £525 £600 £600
% change year-on-year -12.50% - +6.67%
Number of hourly rates quoted 1 0 1
10th Percentile - - -
25th Percentile £66.25 - -
Median hourly rate £67.50 - £78.75
75th Percentile £68.75 - -
90th Percentile - - -
UK median hourly rate £44.62 £78.00 £78.75
% change year-on-year -42.80% -0.95% +205.83%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all contract job vacancies with a WFH option and a requirement for application platform skills.

Contract vacancies with a requirement for application platform skills 1,603 2,725 5,495
As % of all contract jobs with a WFH option 10.96% 11.28% 12.44%
Number of daily rates quoted 1,173 1,917 3,994
10th Percentile £300 £316 £315
25th Percentile £400 £413 £413
Median daily rate (50th Percentile) £500 £525 £515
Median % change year-on-year -4.76% +1.94% +8.42%
75th Percentile £625 £650 £625
90th Percentile £850 £750 £713
UK median daily rate £500 £513 £513
% change year-on-year -2.44% - +7.89%
Number of hourly rates quoted 37 72 89
10th Percentile £16.50 £20.00 £16.01
25th Percentile £22.61 £22.16 £20.24
Median hourly rate £32.12 £55.00 £47.50
Median % change year-on-year -41.61% +15.79% +79.25%
75th Percentile £53.00 £66.00 £68.75
90th Percentile £73.00 £74.88 £77.50
UK median hourly rate £30.08 £52.50 £22.50
% change year-on-year -42.70% +133.33% +7.14%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Daily Rate Trend for Jobs with a WFH Option

3-month moving average daily rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark daily rate for jobs with a WFH option

Apache Spark
Daily Rate Histogram for Jobs with a WFH Option

Daily rate distribution for jobs with a work from home option citing Apache Spark over the 6 months to 31 May 2024.

Apache Spark daily rate histogram for jobs with a WFH option

Apache Spark
Hourly Rate Trend for Jobs with a WFH Option

3-month moving average hourly rate quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark hourly rate for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 13 (19.40%) Apache
2 5 (7.46%) Apache Airflow
3 1 (1.49%) Confluence
Applications
1 1 (1.49%) Microsoft Excel
Business Applications
1 1 (1.49%) Dynamics CRM
1 1 (1.49%) Shopify
Cloud Services
1 40 (59.70%) Azure
2 23 (34.33%) AWS
3 14 (20.90%) GCP
4 11 (16.42%) Azure Data Factory
5 9 (13.43%) Azure Synapse Analytics
5 9 (13.43%) Serverless
6 7 (10.45%) Amazon Kinesis
6 7 (10.45%) Azure Logic Apps
7 6 (8.96%) Amazon S3
8 4 (5.97%) Azure Cosmos DB
9 3 (4.48%) Azure Data Lake Analytics
9 3 (4.48%) Azure DevOps
9 3 (4.48%) Azure Monitor
9 3 (4.48%) Cloud Computing
9 3 (4.48%) GitHub
10 2 (2.99%) Amazon EMR
10 2 (2.99%) AWS Lambda
10 2 (2.99%) AWS Step Functions
10 2 (2.99%) Azure Functions
10 2 (2.99%) PaaS
Database & Business Intelligence
1 30 (44.78%) Big Data
2 17 (25.37%) Data Lake
3 16 (23.88%) Data Warehouse
3 16 (23.88%) Hadoop
4 11 (16.42%) Delta Lake
5 8 (11.94%) Flink
5 8 (11.94%) NoSQL
6 7 (10.45%) Amazon Redshift
7 6 (8.96%) Azure SQL Database
7 6 (8.96%) BigQuery
8 5 (7.46%) Relational Database
8 5 (7.46%) Spark SQL
9 4 (5.97%) Amazon Athena
9 4 (5.97%) Tableau
10 3 (4.48%) Amazon RDS
10 3 (4.48%) PostgreSQL
10 3 (4.48%) Presto
10 3 (4.48%) SQL Server
11 2 (2.99%) Data Mining
11 2 (2.99%) MySQL
Development Applications
1 5 (7.46%) Git
2 4 (5.97%) Jenkins
3 2 (2.99%) JIRA
4 1 (1.49%) Deequ
4 1 (1.49%) GitLab
4 1 (1.49%) Gradle
4 1 (1.49%) RStudio
General
1 18 (26.87%) Finance
2 13 (19.40%) Social Skills
3 9 (13.43%) Analytical Skills
4 4 (5.97%) Banking
4 4 (5.97%) Marketing
4 4 (5.97%) Public Sector
5 2 (2.99%) Czech Language
6 1 (1.49%) Financial Institution
6 1 (1.49%) Inclusion and Diversity
6 1 (1.49%) Investment Banking
6 1 (1.49%) Legal
6 1 (1.49%) Presentation Skills
6 1 (1.49%) Publishing
6 1 (1.49%) Retail
Job Titles
1 32 (47.76%) Data Engineer
2 13 (19.40%) Developer
2 13 (19.40%) Senior
3 9 (13.43%) Java Developer
4 6 (8.96%) Architect
4 6 (8.96%) Azure Engineer
4 6 (8.96%) Senior Data Engineer
5 5 (7.46%) Azure Data Engineer
5 5 (7.46%) Full Stack Developer
5 5 (7.46%) Full Stack Java Developer
6 4 (5.97%) Analyst
6 4 (5.97%) AWS Engineer
6 4 (5.97%) Data Analyst
6 4 (5.97%) Lead
6 4 (5.97%) Lead Data Engineer
6 4 (5.97%) Software Engineer
6 4 (5.97%) Solutions Architect
7 3 (4.48%) AWS Data Engineer
7 3 (4.48%) Senior Analyst
7 3 (4.48%) Senior Data Analyst
Libraries, Frameworks & Software Standards
1 27 (40.30%) Kafka
2 17 (25.37%) PySpark
3 6 (8.96%) Spark Streaming
4 5 (7.46%) Spring Boot
5 4 (5.97%) RESTful
5 4 (5.97%) Spring
6 3 (4.48%) Elastic Stack
6 3 (4.48%) OpenTracing
6 3 (4.48%) Pandas
7 2 (2.99%) ADO
7 2 (2.99%) Apache Avro
7 2 (2.99%) JSON
7 2 (2.99%) JSON Schema
7 2 (2.99%) Web Services
8 1 (1.49%) Middleware
8 1 (1.49%) pytest
8 1 (1.49%) RabbitMQ
8 1 (1.49%) REST
8 1 (1.49%) TensorFlow
8 1 (1.49%) VML
Miscellaneous
1 4 (5.97%) Data Structures
1 4 (5.97%) Distributed Systems
2 3 (4.48%) Self-Motivation
3 2 (2.99%) Algorithms
3 2 (2.99%) Hedge funds
3 2 (2.99%) Multi-touch
4 1 (1.49%) Enterprise Software
4 1 (1.49%) Mobile App
4 1 (1.49%) NHS
Operating Systems
1 3 (4.48%) Linux
2 1 (1.49%) Unix
Processes & Methodologies
1 28 (41.79%) Analytics
2 27 (40.30%) ETL
3 25 (37.31%) Data Pipeline
4 24 (35.82%) Data Engineering
5 21 (31.34%) CI/CD
6 20 (29.85%) DevOps
7 19 (28.36%) Agile
8 16 (23.88%) Continuous Integration
8 16 (23.88%) Data Modelling
9 14 (20.90%) Data Science
10 13 (19.40%) Machine Learning
11 11 (16.42%) Software Engineering
12 10 (14.93%) Business Intelligence
13 9 (13.43%) Computer Science
13 9 (13.43%) Data Analysis
13 9 (13.43%) Visualisation
14 8 (11.94%) Data Integration
14 8 (11.94%) SDLC
15 7 (10.45%) Data Visualisation
15 7 (10.45%) Test Automation
Programming Languages
1 43 (64.18%) Python
2 42 (62.69%) SQL
3 29 (43.28%) Java
4 17 (25.37%) Scala
5 4 (5.97%) R
6 3 (4.48%) C++
6 3 (4.48%) Kotlin
7 2 (2.99%) C#
7 2 (2.99%) T-SQL
8 1 (1.49%) Bash
8 1 (1.49%) Bicep
8 1 (1.49%) Go
8 1 (1.49%) Perl
Qualifications
1 8 (11.94%) SC Cleared
1 8 (11.94%) Security Cleared
2 6 (8.96%) Degree
3 4 (5.97%) Azure Certification
4 3 (4.48%) Microsoft Certification
5 2 (2.99%) BPSS Clearance
5 2 (2.99%) Computer Science Degree
5 2 (2.99%) PhD
6 1 (1.49%) Numerate Degree
Quality Assurance & Compliance
1 10 (14.93%) Data Quality
2 1 (1.49%) Accessibility
2 1 (1.49%) QA
System Software
1 7 (10.45%) Docker
Systems Management
1 10 (14.93%) Kubernetes
2 8 (11.94%) Terraform
3 3 (4.48%) Prometheus
3 3 (4.48%) Zipkin
4 1 (1.49%) Ansible
4 1 (1.49%) Puppet
Vendors
1 23 (34.33%) Databricks
2 12 (17.91%) Microsoft
3 6 (8.96%) Google
4 3 (4.48%) Oracle
4 3 (4.48%) Splunk
4 3 (4.48%) Teradata
5 1 (1.49%) Adobe
5 1 (1.49%) Informatica
5 1 (1.49%) Sage
5 1 (1.49%) Salesforce
5 1 (1.49%) SAP
5 1 (1.49%) Sitecore