LOGO
eKuiper is an edge lightweight IoT data analytics / streaming software implemented by Golang, and it can be run at all kinds of resource constrained edge devices. One goal of eKuiper is to migrate the cloud streaming software frameworks (such as Apache Spark,Apache Storm and Apache Flink) to edge side. eKuiper references these cloud streaming frameworks, and also considered special requirement of edge analytics, and introduced rule engine, which is based on Source
, SQL (business logic)
and Sink
, rule engine is used for developing streaming applications at edge side.
It can be run at various IoT edge use scenarios, such as real-time processing of production line data in the IIoT; Gateway of Connected Vehicle analyze the data from data-bus in real time; Real-time analysis of urban facility data in smart city scenarios. eKuiper processing at the edge can reduce system response latency, save network bandwidth and storage costs, and improve system security.
Lightweight
Cross-platform
Data analysis support
Highly extensibile
Plugin system is provided, and it supports to extend at Source
, SQL functions
and Sink
.
Management
Integration with EMQ X Edge
Seamless integration with EMQ X Neuron & EMQ X Edge, and provided an end to end solution from messaging to analytics.
{"temperature": 10, "humidity" : 90}
, the value of temperature and humidity are random integer between 0 - 100.SELECT * FROM demo WHERE temperature > 50
Devices | Message # per second | CPU usage | Memory usage |
---|---|---|---|
Raspberry Pi 3B+ | 12k | sys+user: 70% | 20M |
AWS t2.micro( 1 Core * 1 GB) Ubuntu18.04 | 10k | sys+user: 25% | 20M |
EdgeX throughput test
A Go application is wrote to send data to ZeroMQ message bus, the data is as following.
{
"Device": "demo", "Created": 000, …
"readings":
[
{"Name": "Temperature", value: "30", "Created":123 …},
{"Name": "Humidity", value: "20", "Created":456 …}
]
}
eKuiper subscribe from EdgeX ZeroMQ message bus, and analyze data with SQL: SELECT * FROM demo WHERE temperature > 50
. 90% of data will be filtered by the rule.
The analysis result are sent to nop sink, all of the result data will be ignored.
Message # per second | CPU usage | Memory usage | |
---|---|---|---|
AWS t2.micro( 1 Core * 1 GB) Ubuntu18.04 | 11.4 k | sys+user: 75% | 32M |
This Wiki is owned by the Secure Device Onboard Community. Contributions are always welcomed to help make it better! In upper right, select Log In. You will need a Linux Foundation Account (can be created at http://myprofile.linuxfoundation.org/) to log-in. For a Wiki tutorial, please see Confluence Overview. Thank you! |