[EPIC] Redesign DataFusion main page

[comphead]

Is your feature request related to a problem or challenge?

Users currently fell a little bit lost when dealing with Datafusion main page https://github.com/apache/datafusion

Imho the page is overloaded with too technical information, navigations to examples, quick start are not very intuitive.

Describe the solution you'd like

Would be nice to redesign the main page and let it be the face of Datafusion. It should contain intuitive steps to get familiar with Datafusion, quick start, contribution, diagram in short what exactly makes DataFusion a DataFusion, supported features.

For the naive design we can refer to https://github.com/StarRocks/starrocks which is way more user friendly

Describe alternatives you've considered

No response

Additional context

No response

[comphead]

Query Engine

🚀 Introduction

Query Engine is a powerful and efficient engine for querying structured and unstructured data. It provides a fast and flexible way to analyze data across multiple sources.

✨ Features

• 🔍 Fast Query Execution – Optimized for speed and efficiency.
• 📡 Multi-Source Support – Works with databases, APIs, and file storage.
• ⚡ Flexible Query Language – SQL-like syntax with additional capabilities.
• 🚀 Scalable – Works on small and large datasets seamlessly.

📌 Use Cases

✔ Data Analytics – Run complex queries on large datasets.
✔ ETL Pipelines – Extract, transform, and load data efficiently.
✔ Log Analysis – Parse logs for insights in real time.

🏗️ Quickstart Guide

Install Query Engine via pip:

pip install query-engine  

Run the help command to get started:

query-engine --help  

💡 Example Queries

SQL Query:

SELECT name, age FROM users WHERE age > 25 ORDER BY age DESC;

Python Usage:

from query_engine import QueryEngine

engine = QueryEngine(data_source="database_url")
results = engine.run("SELECT * FROM logs WHERE error = 'critical'")

🔧 Installation & Setup

For a local setup, clone the repository and install dependencies:

git clone https://github.com/your-repo/query-engine.git
cd query-engine
pip install -r requirements.txt

🤝 Contributing

We welcome contributions! To get started:

• Open issues for bugs and features.
• Follow the contribution guide (CONTRIBUTING.md).
• Use the dev branch for feature work.

🛣️ Roadmap

• Support for NoSQL databases
• Web UI for query visualization
• Performance benchmarking tools

📢 Community & Support

• Join our Discord/Slack community.
• Report issues via GitHub Issues.
• Follow updates on Twitter/GitHub Discussions.

📜 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙌 Acknowledgments

Special thanks to all contributors and the open-source community for making this project possible.

[comphead]

The structure above is just an example how to make the main page more user friendly

[alamb]

I think it already looks a lot better.

@andygrove or @ozankabak perhaps you have some other ideas

[edmondop]

I also was very confused to find the Rust Version Compatibility Policy in the README.md

[alamb]

I also was very confused to find the Rust Version Compatibility Policy in the README.md

As long as this thing exists somewhere (maybe the contributor guide) this makes sense to me)

I think it would be useful / valuable to think about keeping the readme and the main site in sync

• https://datafusion.apache.org/

We could go so far as to remove everything from the README.md except for a link to https://datafusion.apache.org/ 🤔

[sreshu]

Are you thinking of more modifications @alamb ?

[comphead]

Hi @sreshu yeah we thinking of redesigning it a little bit