- Status: Design
- Author: Jiyong Huang
- Discussion: https://github.com/lf-edge/ekuiper/issues/1289
Motivation
Running on the edge side, it is common to encounter network connection failure. For rules which sink to external system, especially remote external system, it is important to cache the data during failures such as network disconnection and resend once reconnected.
...
- enableCache: whether to enable sink cache.
- memorySizememoryCacheSize: the maximum number of messages to be cached in one page. The maximum cache size in memory . It can be considered as a "page".is two pages. The memory will keep two section of pages: the first page of messages to be resent and the last messages which cannot fill a page yet. Once the page is full, it will be dumped to the disk.
- diskCacheSizediskSize: the maximum number of messages to be cached in the disk. The disk cache is FIFO. If the disk cache is full, the earliest page of messages will be dropped.
- resendInterval: the interval for resending the messages after failure recovered.
...