1 to 25 of 107 Permanent Big Data Jobs with Hybrid or WFH Options

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

GCP Data Engineer - Insight & Data Services - Permanent Salary guideline: £85,000 - £95,000 pa (D.O.E) + 5-10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: Closest office to your home location/Hybrid working/Part Remote/UK wide The Client … Our client is a global leader in Systems Integration and IT Consultancy. They have built out a super advanced and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and … deliver GCP data engineering solutions as part of a larger project: Use Google Data Products tools (e.g. BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. more »

We offer world class learning and career development opportunities, while we celebrate an inclusive culture. The role We have an incredible opportunity for a Data Architectto influence the future of data management and data analytics at Allianz. We are looking for a self-motivated individual who is … looking to take our data capabilities to the next level. At Allianz there is a growing focus on data and data-driven decision-making. To enable this we are seeking a highly skilled and experienced Data Architect to design and govern end to end data solutions that support our organisation's needs. The successful candidate will work closely with our business, Allianz Group and other data teams and you will be part of the Data Architecture team based at our Head Office in Guildford. Allianz offers a hybrid working model, which means more »

Senior Data Architect Opportunity - Scotland - Hybrid/Remote The Bridge IT have partnered with a leading energy supplier who are due to undertake a large data transformation spanning across the organisation. As a Senior Data Architect, you will play a pivotal role in designing, creating, and managing … our clients data architecture. Reporting to the Lead Data Architect, you will be instrumental in establishing a solid foundation for data analytics and data management, ensuring data is organised, accessible, secure, and aligned with business objectives. Key Responsibilities: Design, create, and manage comprehensive data architecture to support data analytics and management. Understand and address business issues, events, and activities, considering their wider implications and long-term impact. Ensure that detailed designs and solutions align with the solution data architecture. Manage and resolve design issues, working closely with the applications/integration more »

is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for a Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python and AWS is a must. Role and Responsibilities Data Collection … Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies and anomalies. more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. We are looking for experienced … Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces … Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be more »

of new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … and other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise their … digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the data engineering more »

We are currently seeking a talented Senior Full Stack Developer/Data Engineer to join the Human Genomics Team at the EMBL European Bioinformatics Institute (EMBL-EBI). The team provides genome variation and regulation resources as part of the Ensembl project, human variation interpretation services including the DECIPHER … platform, and data portals for partners around the world. With underlying infrastructure for these services based on EMBLs large and long-standing data resources this is an opportunity to rise to the challenges of big data and make contributions that advance the reach and utility of … e.g. Perturb-seq) data. This project is funded through the Open Targets consortium, an innovative public-private partnership that uses human genetics and genomics data for systematic drug target identification and prioritisation. The new resource will help to address a fundamental need in the scientific and drug discovery community more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

DevOps Engineer -Big Data We are looking for a fully remote DevOps Engineer to join a blockchain intelligence team helping regulators and law-enforcement fight crypto criminals with real-time analysis. This team is a spin off from a Blockchain as a service giant. They aim to aid … in the fight against crypto money laundering at scale, by helping both financial institutions, and government organizations solve investigations in this space through a data-driven approach. A big focus for the tech team (~40 people) this year is to modernize their stack, with the DevOps team focusing … on migrating legacy infrastructure towards AWS, IaC, and containerized architecture. As the team analyses 30TB of Data daily, previous DevOps experience with Big Data is essential. We are seeking a DevOps Engineer with the following: Experience maintaining and scaling AWS services Big data experience with more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

is a well-known provider of iGaming services and products. Their team is expanding, which is why we are looking for an experienced Python Data Developer , based in the UK. They have adopted remote working mode. ................... As a Python Data Engineer at an international team, you will … design, implement, and maintain data pipelines, databases, and proprietary real-time player interaction software. Collaborating with cross-functional teams, you will ensure seamless data integration, support data-driven decision-making, and contribute to the success of our gaming platforms. Key Responsibilities: -Data Pipeline Development: Design, build … and maintain robust and scalable data pipelines for extracting, transforming, and loading (ETL) data from various sources. -Database Management: Manage and optimize databases, ensuring data integrity, security, and performance. Implement best practices for database design, indexing, and maintenance. -Data Integration: Collaborate with game providers, analysts, and more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … and maintain the solution up to date and compatible with a variety of supported runtimes. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. What you will do: Optimize code generation for executing JIT-compiled code … execution in CPUs targets. Improve the existing compiler design and toolchain. Collaborate with team members to drive new innovations lying at the intersection of Big Data and compilers. What you will bring: 3+ years of experience working with large applications written in Scala. Strong Scala and Java programming more »

exposure to challenging technical work, let Leidos show how to accelerate your career path. Job Description: Are you a TS/SCI cleared Senior Data Scientist that likes to perform cutting edge data analytics? Would you like to support a major program advancing the state of the art … in mission-focused big data analytics and predictive analytics? If so, you will be delivering advanced data science capabilities to push forward national security objectives, swiftly produce and analyze results, disseminate findings, and contribute to presentations with actionable intelligence insights. The successful candidate will work on projects … to design, develop, and deploy data science and machine learning capabilities and products. Our team supports both research and development projects as well as mission critical applications and the work includes applying machine learning libraries such as SciKit Learn, Keras, TensorFlow, or PyTorch to develop and train ML models. more »

exposure to challenging technical work, let Leidos show how to accelerate your career path. Job Description: Are you a TS/SCI cleared Senior Data Scientist that likes to perform cutting edge data analytics? Would you like to support a major program advancing the state of the art … in mission-focused big data analytics and predictive analytics? If so, you will be delivering advanced data science capabilities to push forward national security objectives, swiftly produce and analyze results, disseminate findings, and contribute to presentations with actionable intelligence insights. The successful candidate will work on projects … to design, develop, and deploy data science and machine learning capabilities and products. Our team supports both research and development projects as well as mission critical applications and the work includes applying machine learning libraries such as SciKit Learn, Keras, TensorFlow, or PyTorch to develop and train ML models. more »

exposure to challenging technical work, let Leidos show how to accelerate your career path. Job Description: Are you a TS/SCI cleared Senior Data Scientist that likes to perform cutting edge data analytics? Would you like to support a major program advancing the state of the art … in mission-focused big data analytics and predictive analytics? If so, you will be delivering advanced data science capabilities to push forward national security objectives, swiftly produce and analyze results, disseminate findings, and contribute to presentations with actionable intelligence insights. The successful candidate will work on projects … to design, develop, and deploy data science and machine learning capabilities and products. Our team supports both research and development projects as well as mission critical applications and the work includes applying machine learning libraries such as SciKit Learn, Keras, TensorFlow, or PyTorch to develop and train ML models. more »

exposure to challenging technical work, let Leidos show how to accelerate your career path. Job Description: Are you a TS/SCI cleared Senior Data Scientist that likes to perform cutting edge data analytics? Would you like to support a major program advancing the state of the art … in mission-focused big data analytics and predictive analytics? If so, you will be delivering advanced data science capabilities to push forward national security objectives, swiftly produce and analyze results, disseminate findings, and contribute to presentations with actionable intelligence insights. The successful candidate will work on projects … to design, develop, and deploy data science and machine learning capabilities and products. Our team supports both research and development projects as well as mission critical applications and the work includes applying machine learning libraries such as SciKit Learn, Keras, TensorFlow, or PyTorch to develop and train ML models. more »