cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management … or equivalent IT related experience. Skills Deep experience of AWS solutions incl. Step Functions, Glue, Lambda, RDS, (e.g. DynamoDB, Aurora Postgres), SQS, API Gateway, Athena Experience of Python Experience of the delivery and optimization of high-performance data pipelines from ingestion to storage to distribution Comfortable with data analysis more »
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Creditsafe
the Creditsafe platform into the cloud space. You will be expected to work with technologies such as Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, lambda, API Gateway, Terraform, CI/CD. KEY DUTIES AND RESPONSIBILITIES You will actively contribute to the codebase and participate in peer reviews. more »
with both streaming data sets and more traditional data sets Experience with AWS data stack, would consider other cloud platforms (such as S3, Glue, Athena,) Experience with infrastructure as code Terraform Have working SQL knowledge and experience working with several relational databases Experience in Python Women in Tech: Cirium more »
Greater London, England, United Kingdom Hybrid / WFH Options
Annalect
i.e. GA) Familiar with digital tracking technologies (ad servers, DSPs, DMPs) Experience with big data (e.g. cookie logs) and cloud technologies - AWS, Redshift, S3, Athena, GCP, BigQuery Experience of using git for version control (e.g. BitBucket) Experience with Jupyter Notebooks Competencies Enquiring/questioning mind Ability to pick up more »
AWS cloud services Developer for Machine Learning Software Development company. Key Skills Big data; import, manipulation, storage and management. Redshift; (Athena and Glue, security process and Infrastructure on Cloud/IoC). Python DevOps; Automation Testing, CI, implementation and environment provisioning. This is a senior role that will mix more »
cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Essential Skills and Experience: * AWS (e.g., Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience on Data Related Projects * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL more »
a Data Architect or similar role, with a focus on AWS cloud environments. Strong knowledge of AWS services relevant to data architecture, such as Amazon Redshift, AmazonAthena, Amazon S3, AWS Glue, and AWS Lambda. Experience designing and implementing data lakes, data warehouses, and analytics solutions more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.),Experience on RDBMS like PostgreSQL would be a plus.Experience building modern enterprise more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This more »
Lincoln, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Sheffield, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
South East London, England, United Kingdom Hybrid / WFH Options
Maclean Moore
using Apache AirflowProficiency in Git based version control toolsProficiency with Linux commands and Bash ScriptingWorking experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLIExperience with CI/CD tools such as JenkinsExperience working with relational and/or MPP databasesKnowledge of Data more »
desirable Strong skills and knowledge of Public cloud technologies to enable Cloud First delivery - AWS Elastic Kubernetes Service (EKS)/Cluster, EC2, S3 Buckets, Athena, Lambda, Glue and other services Docker – Container and Package Registry, AWS PostGres (database), Grafana dashboards to visualise test results Strong experience of setting up more »
Preston, England, United Kingdom Hybrid / WFH Options
Uneek Global
in Python or Go Lang. • AWS Services: Significant hands-on experience with AWS services such as EKS, EC2, S3, IAM, Networks, serverless, Lambda, DynamoDB, Athena, CloudWatch. • CI/CD: Experience with CI/CD platforms and creating CI/CD pipelines. Such as Jenkins, ArgoCD, GitOps • Containerization and Microservice more »
product thinkingTechnical SkillsArchitecture & DesignEnterprise Architecture and good knowledge of object-oriented programming and design patternsAWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic BeanstalkREST API Design and specification using Swagger/OpenAPIProgrammingExperience of both functional programming and object-orientated programmingExcellent programming skills in R and PythonExperience more »
event store and stream-processing platform. Experience (1+ year) working with Redis or equivalent in-memory storage. Experience (1+ year) working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience (1+ year) with concurrent development source control (GIT). Systems integration experience (1+ year) with networking, data migrations more »
startup environmentNice to Have•\tExperience solving problems using Digital Signal Processing•\tExperience with the properties of fresh concrete•\tUse of AWS Lambda functions and Athena•\tExperience working with time series data generated by IoT platformsPackageSalary for this role is in the range of £60-80k plus an equity more »
