Name: ksql
Owner: Confluent Inc.
Description: KSQL - the Streaming SQL Engine for Apache Kafka
Created: 2016-09-27 21:30:15.0
Updated: 2018-05-24 08:11:49.0
Pushed: 2018-05-24 09:04:44.0
Size: 7413
Language: Java
GitHub Committers
User | Most Recent Commit | # Commits |
---|
Other Committers
User | Most Recent Commit | # Commits |
---|
KSQL is now GA and officially supported by Confluent Inc. Get started with KSQL today.
KSQL is the streaming SQL engine for Apache Kafka.
KSQL is an open source streaming SQL engine for Apache Kafka. It provides a simple and completely interactive SQL interface for stream processing on Kafka; no need to write code in a programming language such as Java or Python. KSQL is open-source (Apache 2.0 licensed), distributed, scalable, reliable, and real-time. It supports a wide range of powerful stream processing operations including aggregations, joins, windowing, sessionization, and much more.
Click here to watch a screencast of the KSQL demo on YouTube.
Stable releases are published every four months and are officially supported by Confluent.
In addition to supported stable KSQL releases, we also provide monthly preview releases. We encourage you to try them in development and testing environments and to take advantage of Confluent Community resources to get help and share feedback.
See KSQL documentation for the latest stable release.
Apache Kafka is a popular choice for powering data pipelines. KSQL makes it simple to transform data within the pipeline, readying messages to cleanly land in another system.
TE STREAM vip_actions AS
LECT userid, page, action
OM clickstream c
FT JOIN users u ON c.userid = u.user_id
ERE u.level = 'Platinum';
KSQL is a good fit for identifying patterns or anomalies on real-time data. By processing the stream as data arrives you can identify and properly surface out of the ordinary events with millisecond latency.
TE TABLE possible_fraud AS
LECT card_number, count(*)
OM authorization_attempts
NDOW TUMBLING (SIZE 5 SECONDS)
OUP BY card_number
VING count(*) > 3;
Kafka's ability to provide scalable ordered messages with stream processing make it a common solution for log data monitoring and alerting. KSQL lends a familiar syntax for tracking, understanding, and managing alerts.
TE TABLE error_counts AS
LECT error_code, count(*)
OM monitoring_stream
NDOW TUMBLING (SIZE 1 MINUTE)
ERE type = 'ERROR'
OUP BY error_code;
PRINT TOPIC
, SHOW TOPICS
; improved analytics with TOPK
, TOPKDISTINCT
aggregations; operational improvements (command line tooling for metrics); distributed failure testing in placeDESCRIBE EXTENDED
, EXPLAIN
, and new metrics); optimizations (faster server startup and recovery
times, better resource utilization)You can get help, learn how to contribute to KSQL, and find the latest news by connecting with the Confluent community.
Contributions to the code, examples, documentation, etc. are very much appreciated.
The project is licensed under the Apache License, version 2.0.
Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation.