Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • If the disk storage is sqlite, all the caches will be save to `data/cache.db` file. Each sink will have an unique sqlite table to save the cache.
  • Add cached count to the sink metrics
  • Integrate into the checkpoint mechanism
  • Limitation: implement sync mode firstly

...

功能 1289 数据缓存机制

...

  • 如果磁盘存储是sqlite,所有的缓存将被保存到`data/cache.db`文件。每个sink将有一个唯一的sqlite表来保存缓存。
  • 将缓存的计数添加到sink 的 metric 中
  • 融入 checkpoint 系统做故障恢复
  • 限制:第一版仅实现 sync 模式,若 sink 配置为 async 模式,缓存不起作用