Inside Meltwater Engineering.

Benthos Lab is a website where users of the Benthos stream processor can write, format, execute and share their pipeline configurations. This app is now a critical part of our Benthos workflow, but it would never have existed were it not for Meltwater Hackathons. This post explains how we built Benthos Lab...

Meltwater’s Foundation team has invested heavily in Kubernetes to provide this platform as a service to other development teams. Many of those teams have migrated to Kubernetes already. Naturally our Foundation team learned a lot about what can, and will, go wrong when running a big enough Kubernetes cluster. Recently they attended...

Meltwater has been using Kubernetes in production for over a year. The theme for this meetup was “difficulties and pitfalls” so we wanted to share our lessons learned from offering Kubernetes as an internal service to our engineering teams all around the globe. It was the second edition of the CloudNativeGbg meetup...

We open sourced drone-cache, a plugin for the popular Continuous Delivery platform Drone. It allows you to cache dependencies and interim files between builds to reduce your build times. This post explains why we are using Drone, why we needed a cache plugin, and what I learned while trying to release drone-cache...

We Germans are known for our love of renewable energy, energy saving lamps, and recycling. I am allowed to say that, as I am one of “them” :) Our office in Berlin had another idea to reduce waste: Lunch boxes (“Brotdose” being one possible translation of that). Most of us like to...

At Meltwater, we have been running a quarterly employee survey with 350+ people in the Product & Engineering group for three years. This post explains our journey, our approach and what we have learnt. Read on if you are wondering how an employee survey can help you understand your organization better and...

Our team was challenged with a project that involved performing actions based on plain-text requests. Having little experience in Data Science, Machine Learning (ML) and Natural Language Processing (NLP), our initial approach amounted to nothing more than “AI based on if-else statements”. To improve our approach, we invited our Data Science team...

My team and I have built a solution that mines a stream of online articles for real-time insights for our customers. This component’s logic could be dramatically simplified if we could assume that it never receives near-duplicates of articles. While deduplication of identical documents is simple, detection of near-duplicates (i.e. “same thing,...

Have you implemented a system that is supposed to perform tasks at regular intervals? Does the repeated failure of such a system pose a threat to your quality of service? If so, I am sure you would want to be alerted, if your system suddenly stops performing these tasks. We at Meltwater’s...