Kitten is a distributed file system optimized for small files storage,inspired by Facebook‘s Haystack。
- High throughput & Low latency for millions of files
- Fault-tolerant, store replicates files on different racks
- Cost-effective
- Simple
Find more detail design in docs folder.
Name | Issue | Description |
---|---|---|
Kitten's basic component | #1 | Implement basic component including Store Proxy , Directory (WIP), Cache |
Introduce Etcd | #2 | |
Expose easy APIs | #3 | Find an elegantly way to expose APIs. |
Support S3 API | #4 | As S3 APIs are the de facto standards for OSS, support S3 style APIs. |
Implement erasure code | #5 | Split data into two groups(hot/warm), use erasure code to store warm data. |
Inspired by:
bfs distributed file system(small file storage) writen in golang.
seaweedfs SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files!
Thanks again for JetBrains' Sponsorship!