Apache Spark Jobs with Work from Home Options

Apache Spark
UK > Work from Home

The table below provides summary statistics for permanent job vacancies with an option to work from home (WFH) and a requirement for Apache Spark skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Apache Spark over the 6 months to 20 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
20 May 2024
Same period 2023 Same period 2022
Rank 397 204 306
Rank change year-on-year -193 +102 -16
Permanent jobs citing Apache Spark 184 705 862
As % of all permanent jobs with a WFH option 0.54% 1.74% 1.21%
As % of the Application Platforms category 4.60% 14.10% 8.84%
Number of salaries quoted 144 295 483
10th Percentile £50,172 £60,000 £50,000
25th Percentile £62,438 £65,000 £60,625
Median annual salary (50th Percentile) £80,000 £100,000 £80,000
Median % change year-on-year -20.00% +25.00% +3.23%
75th Percentile £110,000 £130,000 £95,000
90th Percentile £112,125 £160,000 £108,750
UK median annual salary £80,000 £87,500 £77,500
% change year-on-year -8.57% +12.90% +3.33%

All Application Platform Skills
Work from Home

Apache Spark is in the Application Platforms category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a WFH option and a requirement for application platform skills.

Permanent vacancies with a requirement for application platform skills 4,001 5,001 9,750
As % of all permanent jobs with a WFH option 11.83% 12.32% 13.68%
Number of salaries quoted 2,851 3,660 5,323
10th Percentile £31,250 £32,500 £31,250
25th Percentile £40,800 £44,750 £41,250
Median annual salary (50th Percentile) £55,000 £60,000 £55,000
Median % change year-on-year -8.33% +9.09% +4.76%
75th Percentile £77,500 £80,000 £75,000
90th Percentile £118,750 £100,000 £92,500
UK median annual salary £50,000 £55,667 £55,000
% change year-on-year -10.18% +1.21% +4.76%

Apache Spark
Trend for Jobs with a WFH Option

Job vacancies with a work from home option citing Apache Spark as a proportion of all IT jobs advertised.

Apache Spark trend for jobs with a WFH option

Apache Spark
Salary Trend for Jobs with a WFH Option

3-month moving average salary quoted in job vacancies with a work from home option citing Apache Spark.

Apache Spark salary trend for jobs with a WFH option

Apache Spark
Salary Histogram for Jobs with a WFH Option

Salary distribution for jobs with a work from home option citing Apache Spark over the 6 months to 20 May 2024.

Apache Spark salary histogram for jobs with a WFH option

Apache Spark
Co-occurring Skills and Capabilities with WFH Options by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 53 (28.80%) Apache
2 23 (12.50%) Apache Airflow
3 5 (2.72%) Confluence
4 3 (1.63%) SAS
5 2 (1.09%) Apache Solr
5 2 (1.09%) Jupyter
Applications
1 7 (3.80%) Microsoft Excel
Business Applications
1 4 (2.17%) Primavera
Cloud Services
1 89 (48.37%) AWS
2 70 (38.04%) Azure
3 56 (30.43%) GCP
4 36 (19.57%) Amazon S3
5 28 (15.22%) SaaS
6 23 (12.50%) Amazon SQS
6 23 (12.50%) Snowflake
7 22 (11.96%) Google Docs
7 22 (11.96%) Lucidchart
7 22 (11.96%) Miro
7 22 (11.96%) Slack
8 19 (10.33%) Power Platform
9 16 (8.70%) Azure Data Factory
9 16 (8.70%) dbt
10 12 (6.52%) Azure Synapse Analytics
11 11 (5.98%) GitHub
12 10 (5.43%) Serverless
13 9 (4.89%) Azure DevOps
14 8 (4.35%) Amazon EMR
15 7 (3.80%) Power Automate
Communications & Networking
1 18 (9.78%) Wireless
2 7 (3.80%) Firewall
3 2 (1.09%) HTTP
3 2 (1.09%) Network Security
Database & Business Intelligence
1 100 (54.35%) Big Data
2 60 (32.61%) Hadoop
3 46 (25.00%) Data Warehouse
4 45 (24.46%) Data Lake
5 27 (14.67%) Elasticsearch
6 26 (14.13%) NoSQL
7 22 (11.96%) Redis
7 22 (11.96%) Scylla
8 21 (11.41%) SQL Server
9 19 (10.33%) Power BI
10 15 (8.15%) Amazon Redshift
10 15 (8.15%) Flink
10 15 (8.15%) Relational Database
11 14 (7.61%) BigQuery
12 11 (5.98%) MySQL
13 10 (5.43%) Data Mining
13 10 (5.43%) PostgreSQL
14 8 (4.35%) Delta Lake
14 8 (4.35%) Spark SQL
15 7 (3.80%) Tableau
Development Applications
1 14 (7.61%) Jenkins
2 12 (6.52%) Git
3 9 (4.89%) Spinnaker
4 6 (3.26%) Oracle Forms
5 5 (2.72%) JIRA
6 4 (2.17%) Bitbucket
7 3 (1.63%) Deequ
7 3 (1.63%) Octopus Deploy
8 2 (1.09%) MLflow
General
1 55 (29.89%) Social Skills
2 37 (20.11%) Finance
3 28 (15.22%) Analytical Skills
4 23 (12.50%) Inclusion and Diversity
5 19 (10.33%) Games
6 18 (9.78%) Banking
7 6 (3.26%) Retail
8 4 (2.17%) Influencing Skills
8 4 (2.17%) Music Industry
8 4 (2.17%) Presentation Skills
9 3 (1.63%) Legal
9 3 (1.63%) Manufacturing
10 2 (1.09%) Advertising
10 2 (1.09%) French Language
10 2 (1.09%) Marketing
10 2 (1.09%) Spanish Language
11 1 (0.54%) Automotive
11 1 (0.54%) Telecoms
Job Titles
1 60 (32.61%) Data Engineer
2 55 (29.89%) Senior
3 44 (23.91%) Software Engineer
4 27 (14.67%) Principal Engineer
5 24 (13.04%) Principal Software Engineer
5 24 (13.04%) Senior Data Engineer
6 19 (10.33%) Data Manager
7 17 (9.24%) Lead
8 16 (8.70%) Cloud Engineer
9 15 (8.15%) Architect
9 15 (8.15%) Python Data Engineer
9 15 (8.15%) Python Engineer
10 13 (7.07%) Data Architect
11 12 (6.52%) Developer
11 12 (6.52%) Senior Software Engineer
12 10 (5.43%) Big Data Manager
12 10 (5.43%) Engineering Manager
13 9 (4.89%) Big Data Architect
13 9 (4.89%) Lead Data Engineer
14 7 (3.80%) GCP Engineer
Libraries, Frameworks & Software Standards
1 81 (44.02%) Kafka
2 22 (11.96%) GraphQL
3 19 (10.33%) PySpark
4 15 (8.15%) Apache Beam
5 10 (5.43%) React
6 6 (3.26%) Pandas
7 5 (2.72%) Spring
7 5 (2.72%) Spring Boot
8 3 (1.63%) .NET
8 3 (1.63%) Apache NiFi
8 3 (1.63%) Great Expectations
8 3 (1.63%) JSON
9 2 (1.09%) ActiveMQ
9 2 (1.09%) FastAPI
9 2 (1.09%) Lucene
9 2 (1.09%) NumPy
9 2 (1.09%) Regular Expression
9 2 (1.09%) REST
9 2 (1.09%) Spark Streaming
9 2 (1.09%) XML
Miscellaneous
1 43 (23.37%) Data Structures
2 36 (19.57%) Algorithms
3 13 (7.07%) Cloud Native
4 9 (4.89%) Product Ownership
5 8 (4.35%) Greenfield Project
6 5 (2.72%) Mainframe
7 4 (2.17%) Distributed Systems
7 4 (2.17%) Renewable Energy
8 3 (1.63%) Credit Risk
9 2 (1.09%) Cyberattack
9 2 (1.09%) Data Centre
9 2 (1.09%) Distributed Computing
9 2 (1.09%) Social Media
9 2 (1.09%) Taxonomies
9 2 (1.09%) Virtual Team
10 1 (0.54%) IoT
10 1 (0.54%) Mobile Payment
10 1 (0.54%) Virtual Reality
Operating Systems
1 4 (2.17%) Linux
Processes & Methodologies
1 68 (36.96%) Data Pipeline
2 60 (32.61%) Data Engineering
3 56 (30.43%) Software Engineering
4 52 (28.26%) Data Science
5 48 (26.09%) Agile
6 46 (25.00%) Data Modelling
7 42 (22.83%) Problem-Solving
8 39 (21.20%) Analytics
8 39 (21.20%) CI/CD
9 34 (18.48%) ETL
10 33 (17.93%) Machine Learning
11 31 (16.85%) High Availability
12 29 (15.76%) Stakeholder Management
13 27 (14.67%) Business Intelligence
14 25 (13.59%) Data Management
15 24 (13.04%) Cybersecurity
15 24 (13.04%) Technical Leadership
15 24 (13.04%) User Experience
16 23 (12.50%) DevOps
17 22 (11.96%) Computer Security
Programming Languages
1 119 (64.67%) Python
2 85 (46.20%) SQL
3 67 (36.41%) Java
4 56 (30.43%) Scala
5 35 (19.02%) Go
6 22 (11.96%) Bash
7 13 (7.07%) Kotlin
8 12 (6.52%) TypeScript
9 9 (4.89%) C#
9 9 (4.89%) R
10 8 (4.35%) Clojure
11 7 (3.80%) Data Analysis Expressions
12 5 (2.72%) C
13 2 (1.09%) JavaScript
13 2 (1.09%) PHP
13 2 (1.09%) XPath
14 1 (0.54%) PL/SQL
Qualifications
1 22 (11.96%) Degree
2 7 (3.80%) Security Cleared
3 5 (2.72%) DV Cleared
4 4 (2.17%) CIMA
4 4 (2.17%) DBS Check
4 4 (2.17%) SC Cleared
5 3 (1.63%) ISTQB
6 2 (1.09%) Master's Degree
6 2 (1.09%) Microsoft Certification
7 1 (0.54%) Computer Science Degree
Quality Assurance & Compliance
1 17 (9.24%) Data Quality
2 4 (2.17%) QA
2 4 (2.17%) Solvency II
3 3 (1.63%) CRD IV
3 3 (1.63%) IFRS
3 3 (1.63%) IFRS 9
4 2 (1.09%) GDPR
5 1 (0.54%) Accessibility
System Software
1 15 (8.15%) Docker
2 1 (0.54%) Apache Flume
2 1 (0.54%) HDFS
Systems Management
1 66 (35.87%) Kubernetes
2 17 (9.24%) Terraform
3 3 (1.63%) Kibana
4 2 (1.09%) Ansible
4 2 (1.09%) Argo
4 2 (1.09%) Progress Chef
Vendors
1 64 (34.78%) Databricks
2 37 (20.11%) Google
3 22 (11.96%) Dell
4 17 (9.24%) Microsoft
5 13 (7.07%) Teradata
6 10 (5.43%) Oracle
7 8 (4.35%) YouTube
8 7 (3.80%) Confluent
9 4 (2.17%) SAP
10 3 (1.63%) Cloudera
10 3 (1.63%) SnapLogic
11 2 (1.09%) Apple
11 2 (1.09%) CrowdStrike
11 2 (1.09%) Hootsuite
11 2 (1.09%) Hortonworks
11 2 (1.09%) Informatica
11 2 (1.09%) Talend