Event Driven Microservice Spring Boot with Apache Kafka

-
Apache kafka logo

Apache Kafka in simple terms is a collection of logs of events when some data in a database changes, divided into topics. This is why it is called event driven architecture, when some service saves data in a database, you use Kafka to produce an event so that other services (wherever it is located) can listen on that event and do some computation whatever they want based on the event that is firing.

Kafka is usually used for microservices architecture, so instead of reading data from a database, each microservices communicate with Kafka events, which we call produce and consume.

Produce is Kafka term to emit a message to a specific topic, meanwhile consume is to listen to an event that contains data that is produced by some other microservices.

Monolithic application

Microservice architecture application

What is Event-driven Microservices

Microservice design is a way to develop an application and split it into small independently deployable services, each microservice has specific business capabilities that are separated to other microservice. Microservices make the development of some specific logic separated and be independent from each other. In a monolithic application if one fails it can impact the whole application, but with microservice if one microservice failed, it doesn’t affect other services. So, it prevents large-scale failure.

In request driven architectural style, communication between different microservices is not efficient. The request-driven style if you want some data, it then makes a single request to some service, and the client would wait until the service responds with the result.  

Event driven instead of waiting for an infinite period of time waiting for service response, the event driven messaging system will inform the other service when the response is ready via subscription to some specific topic.  Event-driven microservices code architecture provides real-time communication between microservices, so each microservice consumes the data in the form of events whenever other services produce the data somewhere out there.

Event Driven Microservice with Apache Kafka

Follow these steps to install Kafka on your local computer, so you can get a better understanding of how Kafka works. Using a simple spring boot microservices ping and pong example.

You need to have:

- Docker

- Java

- Git, to clone the example source code

1. Create docker-compose.yml to run Kafka server from docker

2. To run your Kafka server

docker-compose up -d

3. If you want to stop your Kafka server run this command, but don’t do this for now

docker-compose rm -fsv

4. Clone this full code

This is the full event driven microservice example using spring boot codes with Apache Kafka as messaging broker. You can clone this full code and test it yourself, understand better what microservice event driven software design.

Git repo: https://github.com/mudiadamz/event-driven-microservice-example.

Follow the Readme instruction on that repository to run and debug the application.

If you want to know what Apache Kafka is, there's a good explanation of what Apache Kafka is, and how it works for beginners from Confluent YouTube channel from here https://www.youtube.com/watch?v=06iRM1Ghr1k.

And what is event driven architecture is here the video explanation to help you understand better. Here from Coding tech watch the video here https://youtu.be/sSm2dRarhPo.


Popular posts from this blog

ERROR 1348 Column Password Is Not Updatable When Updating MySQL Root Password

-
Image
MySQL and MariaDB password As already mentioned in the title of this blog, this error message sometimes occurred when we are trying to update our root password database, either MySQL or MariaDB, The error says: ERROR 1348 (HY000): Column 'Password' is not updatable This is because if we use this SQL command to update our database root password, and it turn out to be Restricted by MySQL to use update on mysql database. UPDATE mysql.user SET Password=PASSWORD('1234') WHERE User='root'; The solutions for MySQL Error1348 So you can not update a user password using Update commands, to update the password, use ALTER commands instead. like the following. ALTER USER 'root'@'localhost' IDENTIFIED BY '1234'; And then you need to do the flush privileges to commit previous queries (that alter command above) into the system, simply do like this. flush privileges; So now you have your root with password 1234. Although it is recommended to
Read more

How To Create Spring Boot Project Using Netbeans

-
Image
Spring Boot is a handy tool that simplifies the development of Spring Framework applications by reducing the need for cumbersome configuration. In this tutorial, I'll guide you through creating a Spring Boot application using the Netbeans IDE. While you can certainly create a Spring Boot application in Netbeans manually, it's much easier with a plugin designed for Spring development. Here's a step-by-step guide to get you started: 1. Install the Spring Boot Plugin: Open Netbeans and navigate to the Tools menu. Click on "Plugins." Once the Plugins window opens, select the "Available Plugins" tab. Look for the "Nb SpringBoot" plugin, then install and activate it. 2. Create a New Spring Boot Project: After restarting Netbeans IDE, you can create a new project with Spring Boot. Go to File > New Project. Under Categories, select Maven, then choose "Spring Boot Basic." 3. Add Dependencies: With your new project created, open the po
Read more

Spring Kafka - How to use ReplyingKafkaTemplate send and reply synchronously

-
Image
Microservice Spring with Apache Kafka Today, I want to share how to use Kafka. It's quite interesting once you get the hang of it, and I hope my explanation will make it a bit easier for you. So, Kafka is primarily known as an asynchronous messaging queuing system. This means it allows different parts of your application to communicate with each other without waiting for immediate responses. However, there are times when you might need a more immediate reply from another service in your project. Luckily, Kafka can handle this too. Here’s how it works: The client side sends a message to the server side via Kafka. This message includes a special identifier in the Kafka header request, known as KafkaHeaders.CORRELATION_ID, along with a topic where the server should respond. The server, after processing the request, sends a message back to the same topic with the same correlation ID. This way, the client knows that the message is a response to its initial request and can act accordingl
Read more