Spring Cloud Data Flow for Kubernetes

Spring Cloud Data Flow for Kubernetes is a cloud-native orchestration service for composable data microservices on Kubernetes. With Spring Cloud Data Flow, developers can create and orchestrate data pipelines for common use cases such as data ingest, real-time analytics, and data import/export.

Quick Start
Fork me on GitHub

Spring Cloud Data Flow for Kubernetes offers a collection of patterns and best practices for data microservices running as streaming and batch data pipelines in Kubernetes.

Features

  • Consume streaming and batch data microservices as docker artifacts
  • Create, unit-test, troubleshoot and manage data microservices in isolation
  • Develop using: DSL, Shell, REST-APIs, Dashboard, and Flo
  • Take advantage of Kubernetes value-adds such as metrics, security, logging, health checks, and remote management at each data microservice level
  • Scale stream and batch pipelines through kubectl cli

Quick Start

Step 1 - Download, Configure and Deploy Spring Cloud Data Flow's Kubernetes Server and Shell Applications

Step 2 - Create ‘ticktock’ Stream dataflow:>stream create --name ticktock --definition "time | log" --deploy

Step 3 - Verify ‘ticktock’ Results using kubectl logs command

Step 4 - Launch Dashboard at: http://{SERVER-EXTERNAL-IP}:9393/dashboard