Meltwater Blog

Inside Meltwater Engineering.

We build the platforms that help comms teams see around corners. Expect practical engineering lessons, data pipelines at scale, and product thinking from the people behind Meltwater.

Load-driven Shard Distribution in Elasticsearch - Story of an Internship

Load-driven Shard Distribution in Elasticsearch - Story of an Internship

Elasticsearch Logging Foundation Internship Budapest

Since July 2019 I have been an intern at Meltwater in Budapest, working in the Foundation team that is focused on developer productivity. It has been a truly valuable experience to solve challenging real-life problems, that have an impact on the everyday lives of our developers. In this blogpost, I will share...

Zalando & Meltwater kickoff Knowledge Sharing Around Managing Internal Software Delivery Platforms

Zalando & Meltwater kickoff Knowledge Sharing Around Managing Internal Software Delivery Platforms

Internal Software Delivery Platforms Zalando Knowledge Sharing Foundation

In late August 2019 Meltwater had the pleasure of hosting Zalando in our Berlin office for a knowledge sharing session about applying product management for internal platforms that improve software delivery performance. In this post we will explain how this meeting came to be, provide a sneak peak into the topics we...

Enriching 450M Docs Daily With a Boring Stream Processor

Enriching 450M Docs Daily With a Boring Stream Processor

benthos enrichments stream processing stream processor data science

For our fairhair.ai platform we enrich over 450 million documents such as news articles and social posts per day, with a dependency tree of more than 20 NLP syntactic and semantic enrichment tasks. We ingest these documents as a continuous stream of data and guarantee delivery of enriched documents within 5 minutes...

Deep Learning Models for Sentiment Analysis

Deep Learning Models for Sentiment Analysis

Sentiment Analysis Machine Learning AI Data Science NLP Deep Learning

Meltwater has been providing sentiment analysis powered by machine-learning for more than 10 years. In 2009 we deployed our first models for English and German. Today, we support in-house models for 16 languages. In this blog post we discuss how we use deep learning and feedback loops to deliver sentiment analysis at...

Jeff Campbell talking Agile on the Scrum Master Toolbox Podcast

Jeff Campbell talking Agile on the Scrum Master Toolbox Podcast

agile podcast actionable-agile-tools

You certainly like podcasts, don’t you? Jeff Campbell, an experienced Agile Coach working with Meltwater, recently joined forces with Vasco Duarte to record a series of podcasts for the Scrum Master Toolbox. In the podcast series they chose a Q&A format, where the audience submits questions that Jeff and Vasco then discussed...

Micro Pipelines: Analyzing Big Data with Tiny Apps

Micro Pipelines: Analyzing Big Data with Tiny Apps

micro pipelines microservice

One of our teams at Meltwater was recently faced with a problem that required relatively simple tasks applied to a large volume of data. To solve this we experimented with a pattern we call micro-pipelines, which are a sequence of microservices that work together to create efficient, fault tolerant systems. This post...

Benthos Lab: A Case Study of Hackathon Innovation

Benthos Lab: A Case Study of Hackathon Innovation

benthos lab hackathon innovation benthos stream processing

Benthos Lab is a website where users of the Benthos stream processor can write, format, execute and share their pipeline configurations. This app is now a critical part of our Benthos workflow, but it would never have existed were it not for Meltwater Hackathons. This post explains how we built Benthos Lab...

Meltwater speaking at Cloud Native Rejekts Barcelona

Meltwater speaking at Cloud Native Rejekts Barcelona

conference kubernetes

Meltwater’s Foundation team has invested heavily in Kubernetes to provide this platform as a service to other development teams. Many of those teams have migrated to Kubernetes already. Naturally our Foundation team learned a lot about what can, and will, go wrong when running a big enough Kubernetes cluster. Recently they attended...

Hosting the CloudNativeGbg meetup in Gothenburg

Hosting the CloudNativeGbg meetup in Gothenburg

meetup kubernetes gothenburg

Meltwater has been using Kubernetes in production for over a year. The theme for this meetup was “difficulties and pitfalls” so we wanted to share our lessons learned from offering Kubernetes as an internal service to our engineering teams all around the globe. It was the second edition of the CloudNativeGbg meetup...