Providing quality software engineering content in the form of tutorials, applications, services, and commentary suited for developers.

Posts about Data Engineering

Serverless Event Driven Systems with Confluent Cloud and AWS Lambda

Here I present an end-to-end example of a Serverless event driven architecture using Confluent Cloud for stream processing paired with AWS Lambda for event responsive logic using the Serverless Application Model (SAM) framework. Together this architecture will compose a system for fictitious financial stock quote email alerting.

JSON Schema Evolution with Spring Kafka and Confluent Schema Registry

Schemas and schema registries are the governance tools that ensure vitality of data communications through configurable compatibility guardrails as patterns and rules to evolve schemas in a controlled fashion. In this article I will demonstrate how Confluent Schema Registry can be used in conjunction with JSON Schema to govern and enforce rules for schema evolution in the default backwards compatibility mode.