bakdata

20/02/2020

No more MessageSizeTooLargeException with
in : We developed a SerDe that transparently stores large messages on Amazon S3. No changes to your existing processing logic required.

Kafka Streams is a DSL that allows easy processing of stream data stored in Apache Kafka. It abstracts from the low-level producer and…

01/10/2019

Building and querying customer profiles in real-time with

In this blog post, we introduce how Kafka Streams can be used to process real time data and expose queryable user profiles.

19/06/2019

Using the Cloud for data warehousing and BI is easy! Learn how we build and deploy data pipelines and data warehouses with Google Cloud Platform.

In this blog post, we share how we take on BI, ELT, and DWH projects using BigQuery and Apache Airflow on Google Cloud Platform (GCP).

25/02/2019

Mocking schema registry in tests, the easy way

Painlessly test Kafka Streams with Avro

22/02/2019

Processing your data with ? Now it's easier than ever to test your topologies!

A Java test DSL for Kafka Streams

05/12/2018

Going cloud native? You can now run on

R is still one of the most popular programming languages for data scientists. However, it is fairly hard to integrate R with modern micro…

30/11/2018

Query your topic interactively - just like a key-value store. Lightweight via a REST API.

In today’s data processing architectures, Apache Kafka is often used at the ingress stage. Usually, this step is used to enrich and filter…

17/10/2018

Getting started with ? Read more about our first insights on our new blog.

In many real-world use cases that we as bakdata see at our customer’s sites, relevant information is hidden in the connections between…

05/10/2016

- after lunch Alexander Albrecht will talk about how we use , and for Engineering (Saal Baden)