21 Apache Airflow Jobs in the South East

like Lambdas, step functions and ECS services.Strong understanding of AWS ecosystems like Lambdas, step functions and ECS services.Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation more »

really value their employees. As a testament to this, you’ll also receive an unrivalled benefits package.🛠Tech: Snowflake, AWS (or Azure/GCP), Airflow, dbt🌳Environment: Agile✍️Process: 3 stagesNo CV? No problem. Email me at athomas@trg-uk.com, and let’s arrange a call more »

data lake or warehouse.Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed.Modern tech stack - Python, AWS, Airflow and DBT Must haves:A team player, happy to work with several teams, this is key as you will be reporting directly to the more »

FAST APIs for building APIs & SQLAlchmy for database interactions.Strong experience in cloud-based development (AWS).Proficiency with both Docker & Kubernetes for containerisation & orchestration.Understanding or Airflow & DAGs.Experience in building applications using Kafka.Solid OOP principles & design patterns.Permanent/Full-Time Employment.Hybrid working environment (2/3 days' in the office).If more »

project delivery.A commitment to mentoring and developing junior team members, coupled with a dedication to high standards in your work.Tech Stack: dbt, SQL, Snowflake, Airflow, AWS, Tableau.DE&I is also at the heart of the business and they strongly believe that ensuring diversity of background and experience will lead more »

record of taking data science products from conception through to deployment in production. You've had experience deploying data science workflows with tools like Airflow or Databricks. Proven experience of leading a data science team Proven experience of working with customer data You've a strong commitment to accuracy more »

range of databases. Snowflake is widely used, as are Docker and Kubernetes for containerisation. ETL and ELT tech are also used every day, primarily Airflow, Spark, Hive and a lot more.You’ll need to come from a strong academic background with some commercial experience in a data heavy software more »

mandatory, familiarity with the following technologies and tools would be advantageous: Dagster (or similar Orchestration Tools) : Experience with Dagster or other orchestration tools like Airflow for managing complex data workflows and pipelines. Qlik Sense Cloud (or similar Reporting Tools) : Knowledge of Qlik Sense Cloud or similar reporting tools such more »

have strong AWS experienceMust have Terraform experienceSQL & NoSQL experienceHave built out Data Warehouses & built Data PipelinesStrong Databricks & Snowflake experienceDocker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to haveContracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be more »

who really value their employees. As a testament to this, you’ll also receive an unrivalled benefits package.Tech: Snowflake, AWS (or Azure/GCP), Airflow, dbtTC: £85,000 + bonus + up to 22% pensionProcess: 2 stagesNo CV? No problem. Email me at athomas@trg-uk.com, and let’s more »

degree in Computer Science, or similar, and have 4-5 years minimum exposure to back end development in Python, and Kubernetes automation. Skills in Airflow are of extra interest.In this role, you will:Executes elite software solutions, help design, development, and technical troubleshootingCreate secure and high-quality software code more »

TMS (Tealium IQ, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pippingand modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development more »

within the EU Fusion programme and connections to international HPC communities, showcasing contributions made to the field. - Experience in workflow management systems such as Apache Airflow. - Familiarity with Research Data Management methodologies, modern database technologies including SQL, NoSQL and Graph Databases, and parallel file access technologies such as MPI more »

diverse environments, leveraging Azure and other modern technologies. Proven ability to orchestrate complex data workflows and manage Kubernetes clusters on AKS , utilizing tools like Airflow, Kubeflow, Argo, and Dagster. Familiarity with data ingestion tools such as Airbyte and Fivetran, accommodating a wide array of data sources. Mastery of large more »

Langchain, Semantic Kernel, and tools like MS tooling, Co-Pilot Studio, ML Studio, Prompt flow, Kedro, etc. Proficiency in pipeline orchestration with tools like Airflow, Kubeflow, and Argo . Exceptional communication skills, with the ability to articulate complex statistical concepts clearly. Personal Competencies: A results-oriented professional with a more »

for advanced content analysis and indexing & developing RAG services . Experience in managing data workflows and Kubernetes clusters on AKS, utilizing tools such as Airflow, Kubeflow, Argo, and Dagster. Familiarity using scripting languages and tools such as Bash, PowerShell, Azure CLI, Terraform, and Helm Charts. Additional Information Location : This more »

Design, build, and maintain scalable data architectures, including pipelines andcloud-based data warehouses.Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake, Airflow, BigQuery, PowerBI/TableauIndustry: Fintech, Maritime tradingImmersum are supporting the growth of a specialist consultancy who solely specialise in the Maritime trading industry. You … expertise in developing and optimising ETL pipelines.Version Control: Experience with Git for code collaboration and change tracking.Data Pipeline Tools: Proficiency with tools such as Apache Airflow.Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP.Visualisation: Tableau or PowerBIDelivery Tools: Familiarity with agile backlogs, code repositories, automated builds, testing, and releases. more »

cloud-hosted data platform that would be used by the entire firm.Tech Stack: Python/Java, Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster.Cloud: AWS, Lambdas, ECS servicesThis role would focus on various areas of Data Engineering including:End to End ETL pipeline development and deployment … processes and toolsImplementing Data Curation, metadata management and data quality tooling.Requirements:Strong Python/Java Software Engineering skillsExcellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and SnowflakePrevious experience with Dremio, dbt, EMR or DagsterGood Computer Science fundamentals knowledge with strong knowledge of software and data architecture.If you more »

and you’ll build the solution. They work in a mix of SQL, Python programming but also operate with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a … to be a SQL Server expert with strong architecture skills and also strong skills with Python, and DBT. The more experience with things like Airflow, cubeJS and Snowflake, plus other data viz tools would be a huge plus.Total compensation for this role is up to £250,000, split between more »

Data Engineer will have:Worked in a Software Engineering setting.Strong Python coding skills including testing principles (unit testing, TDD/BDD)Experience working with Airflow, DBT, and TerraformAn understanding of cloud architectureRECRUITMENT PROCESS:A Technical Test1 Hour online chat.HOW TO APPLY: Please register your interest by sending your CV … Data Engineer will have:Worked in a Software Engineering setting.Strong Python coding skills including testing principles (unit testing, TDD/BDD)Experience working with Airflow, DBT, and TerraformAn understanding of cloud architectureRECRUITMENT PROCESS:A Technical Test1 Hour online chat.HOW TO APPLY:Please register your interest by sending your CV more »

Job DescriptionJoin a leader in generative AI technologies, who have recently secured Series A funding to advance our work in digital avatars and human clones. Role: MLOps EngineerLocation: LondonSalary: Up to £100,000Responsibilities:Develop ML Pipelines: Build and maintain scalable more »