22 Big Data Jobs in Scotland

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good" space. This … is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are ideally looking … for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate data to provide real more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data … ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design and implement more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

Exciting Opportunity: Python/Spark Big Data Software Engineer - Financial Services Sector Location: Glasgow Contract: 6 Months (Inside IR35) Rate: Up to £600 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the … financial services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods … to tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to more »

Exciting Opportunity: Python/Spark Big Data Software Engineer – Financial Services Sector 📍 Location: Glasgow 💼 Contract: 6 Months PAYE 💷 Rate: Up to £500 per Day Are you ready to take your software engineering career to the next level? We invite you to join a leading team in the financial … services industry where innovation meets top-tier excellence. We are on the lookout for a seasoned Python/Spark Big Data Software Engineer to play a key role in our agile team. What You Will Do: Devise and implement cutting-edge software solutions, venturing beyond traditional methods to … tackle complex challenges. Develop robust architecture and design artefacts that adhere to strict design requirements. Detect patterns and underlying issues in data to refine system architecture and coding practices. Enhance our team culture by promoting diversity, equity, inclusion, and respect. Participate in software engineering communities, staying up-to-date more »

The AI Labs team works collaboratively; and is a multi-disciplinary team with the following skills and capabilities: optimization, machine learning, statistical modeling, exploratory data analysis, natural language processing, data visualization, network/graph modeling, ETL, data pipelines, data architecture, communication, project/product management and … strategy. We work with data from a wide variety of sources including text, news feeds, financial reports, time series transactions, user behavior logs, imagery, and real-time data. AI Labs has offices in New York, Palo Alto, and Edinburgh. The team has several Stanford professors as senior advisors with … to enable the rapid delivery of machine learning products to production environments Continuously improve existing products, tools, and services, by maintaining close relationships with data scientists, researchers, and other BlackRock users Write quality maintainable code that is comprehensively tested and fit for the intended objective Provide ongoing maintenance and more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the company grows … and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data quality, governance, integration, and transformation. About … overview of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles and more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description Here at Version 1, we are currently looking for an experienced Big Data Java Solutions Architect to join our growing Digital, Data & Cloud Practice. You will have the opportunity to work with the latest technology and worked on projects across … with clients and internal teams to understand business requirements and translate them into HLD and LLD solutions. Defining the architecture and technical design. Designing data flows and integrations using Hadoop. Working with the product team and testers to implement throughout testing. Creating and developing comprehensive documentation, including solution architecture more »

eligible for Visa Sponsorship. POSITION SUMMARY As an Expert IT Solutions Architect, you will be responsible for ensuring the architecture of Nestlé's Azure data warehouse that complies with global IT strategy and system architecture best practices. You will be supporting the Advanced Analytics use cases in business areas … including sales, trade, customer service, finance, supply chain and logistics. You will need to ensure security of data by maintaining the integrity and performance of Nestlé's databases and guaranteeing that data is stored securely and optimally. You will play a key role between the reporting teams, business … design the architecture for the future. Build and train Machine Learning models using Azure and Databricks technologies Ability to work with ambiguity (e.g., imperfect data, loosely defined concepts, ideas, or goals) and translating these into more tangible outputs Keep up-to-date with evolving technologies and help Nestlé adopt more »

eligible for Visa Sponsorship. POSITION SUMMARY As an Expert IT Solutions Architect, you will be responsible for ensuring the architecture of Nestlé's Azure data warehouse that complies with global IT strategy and system architecture best practices. You will be supporting the Advanced Analytics use cases in business areas … including sales, trade, customer service, finance, supply chain and logistics. You will need to ensure security of data by maintaining the integrity and performance of Nestlé's databases and guaranteeing that data is stored securely and optimally. You will play a key role between the reporting teams, business … design the architecture for the future. Build and train Machine Learning models using Azure and Databricks technologies Ability to work with ambiguity (e.g., imperfect data, loosely defined concepts, ideas, or goals) and translating these into more tangible outputs Keep up-to-date with evolving technologies and help Nestlé adopt more »

Python Developer Location: Glasgow Duration: 6 months Job description: As a Python/Spark Big Data Software Engineer you will serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible … artifacts for complex applications while being accountable for ensuring design constraints are met by software code development · Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture · Contributes to software engineering communities of practice and events that explore … and Security Preferred qualifications, capabilities, and skills: · Skilled with Python or PySpark · Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka) · Experience with Big Data solutions or Relational DB. · Experience in Financial Service Industry is a bonus. more »

and business areas supporting the Customer Relationship Growth strategy to deepen relationships with our customers across both the retail & commercial bank. This includes the data, analytics, and technology to unlock the value of differentiating our branded channel experiences, proposition, price and communication; as well as paper-free sustainable ambitions. … experience: Strong knowledge of cloud architecture, hosting patterns & services (especially GCP), cloud security, resilience, and operational excellence Strong understanding of microservices, containerisation, cloud native, data architectures and event-driven design concepts Strong understanding of API standards, security, networking, ingress/egress patterns & FinOps Strong understanding of data technologies … SQL/NoSQL, Big Data Experience working with enterprise-wide cloud patterns - networks, security, ingress/egress Knowledge of ML/AI and data capabilities in GCP Strong experience & knowledge of some key LBG development technologies (e.g. JavaScript, Java Spring Boot, Python) Knowledge of the SDLC & SRE more »

and business areas supporting the Customer Relationship Growth strategy to deepen relationships with our customers across both the retail & commercial bank. This includes the data, analytics, and technology to unlock the value of differentiating our branded channel experiences, proposition, price and communication as well as paper-free sustainable ambitions. … experience: Strong knowledge of cloud architecture, hosting patterns & services (especially GCP), cloud security, resilience, and operational excellence Strong understanding of microservices, containerisation, cloud native, data architectures and event-driven design concepts Strong understanding of API standards, security, networking, ingress/egress patterns & FinOps Strong understanding of data technologies … SQL/NoSQL, Big Data Experience working with enterprise-wide cloud patterns - networks, security, ingress/egress Knowledge of ML/AI and data capabilities in GCP Strong experience & knowledge of some key LBG development technologies (e.g. JavaScript, Java Spring Boot, Python) Knowledge of the SDLC & SRE more »

Solid Understanding of Data Engineering Concepts and experience of Building and maintaining reliable and scalable big data platform. Experience of Integrating Azure hosted platforms within Enterprise capabilities including ServiceNow, CyberArc, Azure DevOps in an Enterprise Environment. Experience of Implementing Development lifecycle Including dependency management and DevOps and more »

Job Description This is an exceptional new position for a talented Java Sofware engineer with a global Data Analytics company who have developed an independent platform which provides both management and measurement of converged TV campaigns. This is a key position with impressive potential for growth and impact, where …/design through to delivery. The person in this role will work daily with the most advanced technologies in software development, high scalability, and big data and will need exceptional Software Engineering skills. You’ll be asked to: • Set the technical standard for your team. • Be a part … and own the full development lifecycle from initial idea/design through to delivery • Work with a team of extremely talented software engineers and data scientists in a fast-paced and engaging environment • Interact with all areas of the business, from sales to client services, to ensure the highest more »

as the ability to manage several tasks/projects concurrently and prioritize work effectively. • Experience in Risk and Finance or Regulatory reporting. • Understanding of Big Data Technologies, Cloudera, Spark • Experience in CI/CD pipeline implementation • Good exposure in Python Scripting more »

This is an exceptional new position for a talented Python Developer with a global Data Analytics company who have developed an independent platform which provides both management and measurement of converged TV campaigns. This is a key position with impressive potential for growth and impact, where you will own …/design through to delivery. The person in this role will work daily with the most advanced technologies in software development, high scalability, and big data and will need exceptional Software Engineering skills. You’ll be asked to: • Set the technical standard for your team. • Be a part … and own the full development lifecycle from initial idea/design through to delivery • Work with a team of extremely talented software engineers and data scientists in a fast-paced and engaging environment • Interact with all areas of the business, from sales to client services, to ensure the highest more »

measurement and outcomes across linear, CTV and digital for the world’s largest brands. Through a global infrastructure that enables cross-platform ad serving, data-driven creative, and currency-grade measurement, Innovid offers its clients always-on intelligence to optimize advertising investment across channels, platforms, screens, and devices. Innovid … culture, practice continuous deployment and no code ownership, and deal daily with the most advanced technologies and methodologies in software development, high scalability, and big data. The Impact You'll Make: Participate in designing and developing Innovid’s products in a multiple technologies, no code ownership environment Design and … science or a related discipline Experience with development of online, cloud based SaaS products – an advantage Good knowledge of SQL – an advantage Experience with Big Data development – an advantage Experience with web server or client side development – an advantage Experience with Linux in a production environment – an advantage more »

Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in Big Data Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »

fast-paced industry Exposure to skills development on a complex and varied technology stack Potential to work in exciting domain areas including cloud services, big data, machine learning, audio, graphics, UI, hardware integration, eCommerce Exciting extra-curricular activities and great social gatherings If this sounds like an exciting more »

apply. Python App Developer Requirements: Proficiency with Python or PySpark. Exposure to cloud technologies such as Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka. Experience with Big Data solutions or Relational DB. Demonstrated knowledge of software applications and technical processes within a cloud or microservice architecture. Hands On practical experience more »