Meltwater Blog

Inside Meltwater Engineering.

We build the platforms that help comms teams see around corners. Expect practical engineering lessons, data pipelines at scale, and product thinking from the people behind Meltwater.

Browse all posts

Featured story

Improving Record Linking for our Knowledge Graph (Part 2)

data science machine learning clustering entity resolution knowledge graph KG record linking

Meltwater recently released a new product feature called Signals, which helps our customers to identify business-critical events. In a previous post we introduced the concept of record linking, and presented our first approach for merging information from multiple sources for our Knowledge Graph. In this second post, we share how we improved those initial models based on user feedback and... Read the story

Improving Record Linking for our Knowledge Graph (Part 2)
The Record Linking Pipeline for our Knowledge Graph (Part 1)

The Record Linking Pipeline for our Knowledge Graph (Part 1)

data science machine learning clustering entity resolution knowledge graph KG record linking

Meltwater recently released a new product feature called Signals, which helps our customers to identify business-critical events. One of the technical systems powering these Signals is a custom-built Knowledge Graph. In this post we explain how we created a record linking service that utilizes machine learning and big data tactics to cluster...

Let's Talk about Feelings!

Let's Talk about Feelings!

Agile collaboration remote work team building

The Meltwater Engineering teams have always been doing a lot of remote collaboration, due to the distributed nature of our company. Still, we have to get used to the work-from-home situation where we cannot even meet the colleagues in our own offices. In this post Niall Burkley from our middleware team shares...

Tech Talk: Scalability Testing of a Production Kubernetes Cluster

Tech Talk: Scalability Testing of a Production Kubernetes Cluster

Foundation kubernetes Cloud Native Nordics meetup tech talk

In early spring 2018 Kubernetes went into Production at Meltwater and has seen great adoption from a lot of our engineering teams. Our Kubernetes cluster went from hosting 150 services at the end of 2018 to more than 800 services 9 months later. As part of our involvement in the Cloud Native...

The Journey To Front-End Performance  —  Assessing Current Performance

The Journey To Front-End Performance  —  Assessing Current Performance

front-end performance Application Framework SPA single page application monitoring

Our Application Framework team was tasked with assessing and improving application performance. Analyzing performance across the globe is challenging. The architectural layout of Meltwater’s application, as well as the way we organize our teams, lead to various challenges. This is the first post in a series about front-end performance. We will share...

Cheaper Logging from AWS Lambdas

Cheaper Logging from AWS Lambdas

aws devops cloudwatch lambdas cost-savings

To provide structured data from the Web to our customers, our team maintains a web crawler. The system downloads and processes 600K URLs per hour, resulting in huge amounts of logs. That costs a lot! In this blog post, Róbert from our Crawler team explains how we modified our architecture to save...

First Commits at Meltwater Engineering

First Commits at Meltwater Engineering

onboarding hiring team culture Berlin Gothenburg

When you start at a new company, the first weeks are a turmoil of new things. The Meltwater Product & Engineering team is no different. When new colleagues join us, they go through an onboarding phase with parts that are standardized across the company, and other elements custom to their team. Still...

Dynamic Route53 records for AWS Auto Scaling Groups with Terraform

Dynamic Route53 records for AWS Auto Scaling Groups with Terraform

aws asg terraform foundation open source

AWS Auto Scaling Groups may seem outdated in a world dominated by Serverless and Kubernetes, but they still have their place in Meltwater’s AWS infrastructure. One thing we felt was missing in Auto Scaling Groups are unique instance names. EC2 instances launched in the ASG are given the same Name tag, with...

Introduction to the AWS Cloud Development Kit (CDK)

Introduction to the AWS Cloud Development Kit (CDK)

AWS CDK Deployment DevOps

Meltwater takes pride in having autonomous devops-enabled teams. This includes decisions on how to deploy their infrastructure. In this post Andy Desmarais is sharing an introduction to the newest deployment method that his team is experimenting with, the AWS Cloud Development Kit. You also find more articles like these on Andy’s blog...