Databend is an open-source Elastic and Workload-Aware modern cloud data warehouse focusing on Low-Cost and Low-Complexity for your massive-scale analytics needs.
Databend uses the latest techniques in vectorized query processing to allow you to do blazing-fast data analytics on object storage: (S3, Azure Blob, Google Cloud Storage, Alibaba Cloud OSS, Tencent Cloud COS, Huawei Cloud OBS, Cloudflare R2, Wasabi or MinIO).
-
Feature-Rich
Support for atomic operations including
SELECT/INSERT/DELETE/UPDATE/REPLACE/COPY/ALTERand advanced features like Time Travel, Multi Catalog(Apache Hive/Apache Iceberg). -
Instant Elasticity
Databend completely separates storage from compute, which allows you easily scale up or scale down based on your application's needs.
-
Blazing Performance
Databend leverages data-level parallelism(Vectorized Query Execution) and instruction-level parallelism(SIMD) technology, offering blazing performance data analytics.
-
Git-like MVCC Storage
Databend stores data with snapshots, enabling users to effortlessly query, clone, or restore data from any history timepoint.
-
Support for Semi-Structured Data
Databend supports ingestion of semi-structured data in various formats like CSV, JSON, and Parquet, which are located in the cloud or your local file system; Databend also supports semi-structured data types: ARRAY, TUPLE, MAP, JSON, which is easy to import and operate on semi-structured.
-
MySQL/ClickHouse Compatible
Databend is ANSI SQL compliant and MySQL/ClickHouse wire protocol compatible, making it easy to connect with existing tools(MySQL Client, ClickHouse HTTP Handler, Vector, DBeaver, Jupyter, JDBC, etc.).
-
Easy to Use
Databend has no indexes to build, no manual tuning required, no manual figuring out partitions or shard data, it’s all done for you as data is loaded into the table.
The fastest way to try Databend, Databend Cloud
Prepare the image (once) from Docker Hub (this will download about 170 MB data):
docker pull datafuselabs/databendTo run Databend quickly:
docker run --net=host datafuselabs/databend- Understanding Deployment Modes
- Deploying a Standalone Databend
- Expanding a Standalone Databend
- Databend Cloud (Beta)
- How to Connect Databend with MySQL Client
- How to Connect Databend with ClickHouse HTTP Handler
- How to Connect Databend with DBeaver SQL IDE
- How to Execute Queries in Python
- How to Query Databend in Jupyter Notebooks
- How to Execute Queries in Golang
- How to Work with Databend in Node.js
- How to Load Data from Local File System
- How to Load Data from Remote Files
- How to Load Data from Amazon S3
- How to Load Data from Databend Stages
- Querying Data in Staged Files
- Transforming Data During a Load
- How to Create a User
- How to Grant Privileges to a User
- How to Revoke Privileges from a User
- How to Create a Role
- How to Grant Privileges to a Role
- How to Grant Role to a User
- How to Revoke Role from a User
- How to Create a Table
- How to Drop a Table
- How to Rename a Table
- How to Truncate a Table
- How to Add/Drop Table Column
- How to Create a User-Defined Function
- How to Drop a User-Defined Function
- How to Alter a User-Defined Function
- Analyzing Nginx Access Logs With Databend
- User Retention Analysis With Databend
- Conversion Funnel Analysis With Databend
Databend is an open source project, you can help with ideas, code, or documentation, we appreciate any efforts that help us to make the project better! Once the code is merged, your name will be stored in the system.contributors table forever.
To get started with contributing:
For general help in using Databend, please refer to the official documentation. For additional help, you can use one of these channels to ask a question:
- Slack (For live discussion with the Community)
- GitHub (Feature/Bug reports, Contributions)
- Twitter (Get the news fast)
- I'm feeling lucky (Pick up a good first issue now!)
Databend is licensed under Apache 2.0.
- Databend is inspired by ClickHouse and Snowflake.
- Databend's computing model is based on Arrow2, Arrow2 is a faster and safer implementation of the Apache Arrow Columnar Format.
- The documentation website is hosted by Vercel.
- Thanks to Mergify for sponsoring advanced features like Batch Merge.