Streaming Architectures

Streaming, events and batch processing are popular technologies and often misused as a better "RPC".

In this workshop we will focus on killer use cases, as well as planning, architecting and designing streaming, messaging, batch / microbatch systems.

Prerequisites

Java EE / MicroProfile knowledge (I will use Java EE concepts to explain streaming and messaging).

Topics

• What is Streaming?
• Messaging vs. Streaming / JMS vs. Kafka
• Why streaming will significantly impact your architecture
• Killer streaming, batch processing and event store use cases
• Streams vs. Tables
• Thinking in event streams
• MicroProfile Reactive Stream Operators
• MicroProfile Reactive Messaging
• CQRS architectures
• Topics, Queues, Consistency, Transactions and Persistence
• Change Data Capture (CDC)
• Java 8+ streams vs. streaming
• From batches, microbatches to streaming
• Stream processing and integrations
• Possible Machine Learning integrations
• Kafka Consumers / Producers, Streaming and KSQL
• Apache Kafka, Apache Pulsar and Co.
• Apache Spark, Apache Flink
• Apache Kafka scalability, consistency and load balancing
• Under the hood of kafka, pulsar, flink and spark
• Kafka load balancing, HA and MicroProfile / Jakarta EE integration
• Apache Kafka Monitoring
• relational DBs and NoSQL vs. persistent event stores
• Debezium and DB integration
• Reactive programming and stream integration
• Scalability and consistency challenges
• Clustering and replication techniques
• Integration with traditional application servers and MicroProfile runtimes
• ...and most popular questions, topics and technologies from airhacks.tv
• (... additional topics are in the queue)

In this advanced workshop I would like to explain the most significant features with working code and prepared examples. As a reference, you will get a GIT repository with all snippets and solutions, as well as prepared sample applications.

Environment requirements / prerequisites.

I/we will spend 90% of the time in code.

Feel free to contact me / register via email: workshops[-AT-] adam-bien.com

Registration