Data Technology Trend #8: Data Next — part 6

LAKSHMI VENKATESH
2 min readJun 21, 2021

--

This article is a part of a multi-part series Data Technology Trends (parent article). Previous article — Link: Data Technology Trend #7: Monetized. Previous part of this trend — Data Technology Trend #8: Data Next — part 5.

Kafka use cases:

1. Machine Learning

Kafka drives cutting-edge Machine Learning technology. Apache Kafka and Machine Learning is a great combination to use Data and Analytics pipeline.

Refer: Confluent Source.

2. Microservices

Kafka Microservices enables Event-driven systems using Kafka and Ksqldb.

Refer Confluent Source Kafka.

Second ref.

Kafka streams API enables to chain a collection of asynchronous services together, connected via events. Using Kafka streaming for the event-based microservices design enables efficient workflow for the design pattern.

3. Internet of Things

Real-time IoT data solutions with Confluent enable to pass the data between IoT and analytics systems. Confluent simplifies IoT Event stream processing. Source.

4. Cloud

Kafka is much as a managed service for AWS / Azure and GCP.

5. Data in Motion

Kafka enables the movement of the massive amount of data with Kafka and combined with Data at Rest.

6. Containers — Kubernetes

Confluent for Kubernetes provides a complete, declarative API to build your own private cloud Kafka service. It automates the deployment of Confluent Platform and leverages Kubernetes to enhance the platform’s elasticity, ease of operations, and resiliency for enterprises operating at any scale. Mobile-based applications can leverage the scalability and performance of Apache Kafka and enabling client-server communication.

Other Modern Data Streaming platforms including Kafka, SQS, Data Streaming solutions & Event hubs with Azure, Real-time streaming Data Pipeline & pub/sub using GCP.

Conclusion

Data and Analytics trends 2021.

Refer: Gartner source.

With data being upended and with Modern Cloud Data platforms in place, not only that better, simple, faster, smarter, and efficient data platforms can be built at the organization level. The main idea of this article is to see the trends and for any size of organization to see the opportunities that are available to build better and exceptional data platforms.

Simplicity is the ultimate sophistication — Leonardo da Vinci.

For other articles refer to luxananda.medium.com.

--

--

LAKSHMI VENKATESH
LAKSHMI VENKATESH

Written by LAKSHMI VENKATESH

I learn by Writing; Data, AI, Cloud and Technology. All the views expressed here are my own views and does not represent views of my firm that I work for.

No responses yet