QuESt 2.0: Open-source Platform for Energy Storage Analytics

Release date: Feb, 2024

Contact

For issues and feedback we would appreciate it if you could use the "Issues" feature of this repository. This helps others join the discussion and helps us keep track of and document issues.

Email

Project maintainer (Tu Nguyen) @sandia.gov: tunguy

Table of contents

• QuESt 2.0: Open-source Platform for Energy Storage Analytics
  • Contact
    • Email
  • Table of contents
    • What is it?
    • The App Hub
    • The Workspace
    • QuESt GPT
    • What are the key innovations of QuESt 2.0?
    • How is QuESt 2.0 different from the other tools in Energy Storage Analytics?
    • Key Competitive Advantages of QuESt 2.0:
    • How to download QuESt?
  • Installation Instructions for QuESt
    • Prerequisites
    • Installing Python
    • Installing Git
    • Setting Up a Virtual Environment
    • Installing QuESt
  • Running QuESt
  • Deactivating the Virtual Environment
  • Usage Analytics
    • References

What is it?

QuESt 2.0 is an evolved version of the original QuESt, an open-source Python software designed for energy storage (ES) analytics. It transforms into a platform providing centralized access to multiple tools and improved data analytics, aiming to simplify ES analysis and democratize access to these tools.

Currently, QuESt 2.0 includes three main components:

The App Hub

The QuESt App Hub operates similarly to an app store, offering access points to a multitude of applications. Currently, various energy storage analytics tools have been available on QuESt App hub. For example:

• QuESt Data Manager manages the acquisition of data.

• QuESt Valuation estimates the potential revenue generated by energy storage systems when providing ancillary services in the electricity markets.

• QuESt BTM (Behind-The-Meter) calculates the cost savings for time-of-use and net energy metering customers utilizing behind-the-meter energy storage systems.

• QuESt Technology Selection supports in selecting the appropriate energy storage technology based on specific applications and requirements.

• QuESt Performance evaluates the performance of energy storage systems in different climatic conditions.

• QuESt Microgrid supports microgrid design and simulation considering energy storage as a key component.

It has been designed with key features to improve user experience and application management:

• User-Friendly Access: Users can easily find and install applications that suit their specific needs.

• Isolated Environments: Upon installation, each application creates an isolated environment. This ensures that applications run independently, preventing conflicts, and enhancing stability.

• Simultaneous Operation: Multiple applications can be installed and operated simultaneously, allowing users to leverage different tools without interference.

The Workspace

The QuESt Workspace provides an integrated environment where users can create workflows by assembling multiple applications into a coherent process. It enhances the platform's usability and efficiency through several mechanisms:

• Integration of Applications: Users can create work processes that integrate multiple apps by assembling pipelines using plugin extensions. This modular approach allows for the flexible composition of analytics workflows tailored to specific needs.

• Workflow Management: The workspace supports the selection, assembly, connection, and post-processing of data and tools. This structured approach streamlines the analytics process, from data preparation to visualization, making it easier to manage and understand.

QuESt GPT

QuESt GPT represents a leap forward in data analytics within the platform, utilizing generative AI (specifically Large Language Models, or LLM) for data characterization and visualization:

• Data Insights: Users can select datasets and ask questions about the data, with QuESt GPT providing insights based on the data's characteristics. This interaction model simplifies complex data analysis, making it accessible to users without deep technical expertise.

• Utilization of LLMs: By leveraging advanced open-source LLMs such as OpenAi’sGPT4 and Meta’s Llama2, QuESt GPT can perform sophisticated data analytics tasks, such as characterizing and visualizing large datasets. This enables users to gain deeper insights from their data, supporting more informed decision-making at no costs.

What are the key innovations of QuESt 2.0?

QuESt 2.0 facilitates the advancement of energy storage technology by making powerful analytics tools accessible to all energy storage stake holders, aligning with DOE’s energy storage program goals. The platform standardizes data and program structures, integrates applications seamlessly, and utilizes generative AI for advanced analytics, simplifying user interaction and enabling deeper insights from diverse data sources. This positions QuESt 2.0 as a pioneering platform in the energy storage domain, with the potential to significantly impact both the field and the broader energy landscape. Specifically, the key innovations of QuESt 2.0 include:

1. Integration and Usability: At its core, QuESt 2.0 revolutionizes how energy storage analytics are performed by providing a seamless, user-friendly platform that integrates multiple applications developed by independent developers. This allows for a more cohesive and efficient user experience, significantly lowering the learning curve for users at various levels of expertise.
2. AI-powered Data Analytics: The incorporation of QuESt GPT, utilizing Large Language Models (LLM), represents a significant technological leap forward. This feature enables users to perform more sophisticated data analytics, providing deeper insights from diverse data sources. It allows users to interact with data in an intuitive way, asking questions and receiving insights, which democratizes access to complex data analysis.
3. Complex Workflows: The QuESt Workspace and the QuESt App Hub enhance the platform's capability to support complex analytical workflows. Users can integrate multiple applications into a single process, creating efficient pipelines for data analysis. The users can run their work flows locally or schedule them to run on cloud services (e.g., AWS, Azure..)

How is QuESt 2.0 different from the other tools in Energy Storage Analytics?

QuESt 2.0 distinguishes itself in the crowded space of energy storage analytics tools by offering a unified platform rather than a collection of individual tools. While there are numerous tools available, these tend to focus on specific aspects of energy storage analysis and lack the integration and broad applicability that QuESt 2.0 provides.

Key Competitive Advantages of QuESt 2.0:

• Unified Platform: Unlike individual tools that offer limited capabilities in specific topics, QuESt 2.0 serves as a comprehensive platform that integrates multiple applications for energy storage analytics. This integration allows users to access a wide range of tools and functionalities within a single environment, streamlining the workflow and enhancing productivity.

• Advanced Data Analytics: With the inclusion of QuESt GPT for advanced data analytics, QuESt 2.0 utilizes generative AI to provide deeper insights from diverse data sources. This capability is not commonly found in other tools, giving QuESt 2.0 a significant technological edge.

• Flexibility and Scalability: QuESt 2.0's modular design allows for the easy integration of new tools and applications, ensuring that the platform remains relevant and adaptable to future developments in energy storage analytics.

• Collaborative Development: As an open-source platform, QuESt 2.0 benefits from contributions by a wide community of developers, enhancing its capabilities and ensuring continuous improvement.

How to download QuESt?

QuESt is currently available on Github at: https://github.com/sandialabs/snl-quest.

Installation Instructions for QuESt

Prerequisites

• Python (3.9.x recommended) installed on your system
• Git installed on your system
• Currently QuESt is only compatible with Windows

Installing Python

1. Python 3.9.13 is recommended.
2. Installers can be found at: https://www.python.org/downloads/release/python-3913/
3. Make sure to check the box "Add Python to PATH" at the bottom of the installer prompt.

Installing Git

• Visit git-scm.com to download Git for your operating system.
• Follow the installation instructions provided on the website.

Setting Up a Virtual Environment

1. Open Command Prompt.
2. Install virtualenv (if not already installed):

   python -m pip install virtualenv

3. Create a virtual environment:

   cd <your_path>
   python -m virtualenv <env_name>

   Replace <your_path> with the path to the folder where you want to create the virtual environment.
4. Activate the virtual environment:
   • On Windows:

     cd <your_path>
     .\<env_name>\Scripts\activate

Installing QuESt

1. Clone the Repository:

   git clone https://github.com/sandialabs/snl-quest.git

2. Navigate to the QuESt Directory:

   cd <path_to_quest>

   Replace <path_to_quest> with the path to the directory where QuESt was cloned.

3. Install Dependencies:

   python - m pip install -r requirements.txt

Running QuESt

1. Run QuESt:
   • Once the dependencies are installed, ensure you have navigated to the directory where QuESt is installed and the Virtual environment is activated. You can run QuESt using the following command:

     python main.py

Deactivating the Virtual Environment

1. Deactivate the Virtual Environment:

   deactivate

   This will return you to your system's default Python environment.

Usage Analytics

Asset Name	Download Count
quest_apps_prebuilt_win64.zip	12
quest_installer_win64.exe	30
quest_prebuilt_win64.zip	26
QuESt.1.6-beta.zip	394
snl-quest-1.2.f-win10.zip	742
snl-quest-1.2.e-win10.zip	197
snl-quest-1.2.d-win10.zip	111
snl-quest-1.2.c-win10.zip	86
Total	1598

Most Visited Path	Times Visited	Unique Visits
/sandialabs/snl-quest	898	488
/sandialabs/snl-quest/tree/master/snl_libraries/data_manager/es_gui/apps/data_manager	51	3
//issues/30	69	56
/sandialabs/snl-quest/blob/master/main.py	12	4
/sandialabs/snl-quest/tree/master/pycache	41	8
/sandialabs/snl-quest/tree/master/docs	76	22
//issues/48	9	5
/sandialabs/snl-quest/tree/master/snl_libraries/data_manager/es_gui/apps/data_manager/_static	9	1
/sandialabs/snl-quest/tree/master	104	37
/sandialabs/snl-quest/blob/master/README.md	42	10
/sandialabs/snl-quest/tree/master/snl_libraries	103	24
/sandialabs/snl-quest/blob/master/resources_rc.py	22	6
/sandialabs/snl-quest/blob/master/setup.py	9	3
/sandialabs/snl-quest/tree/master/data	130	32
/sandialabs/snl-quest/tree/master/app	103	27
/sandialabs/snl-quest/blob/master/images/read/home_page.png	45	18
/sandialabs/snl-quest/tree/master/app/data_vis	20	4
/sandialabs/snl-quest/tree/master/app/tools	9	3
/sandialabs/snl-quest/tree/master/images	12	3
/sandialabs/snl-quest/issues	46	7
/sandialabs/snl-quest/tree/master/snl_libraries/data_manager	45	7
/sandialabs/snl-quest/tree/master/data/SPP	30	8
/sandialabs/snl-quest/tree/master/plots	13	5
Total	1898	781

Referrer	Number of Referrals	Unique Referrals
sandia.gov	445	98
Google	586	200
github.com	427	95
u-cursos.cl	94	7
linkedin.com	3	3
yandex.ru	3	3
opensustain.tech	4	4
Bing	430	17
energy.gov	4	4
statics.teams.cdn.office.net	8	6
yandex.by	4	2
DuckDuckGo	47	4
puspalhazra.com	2	2
puspalhazra.info	1	1
link.zhihu.com	15	1
gbc-excel.officeapps.live.com	6	5
search.brave.com	1	1
Total	2080	453

References

Nguyen, Tu A., David A. Copp, and Raymond H. Byrne. "Stacking Revenue of Energy Storage System from Resilience, T&D Deferral and Arbitrage." 2019 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 2019.

Byrne, Raymond H., Tu A. Nguyen, and Ricky J. Concepcion. "Opportunities for Energy Storage in CAISO." 2018 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 2018. Available online.

Byrne, Raymond H., Tu Anh Nguyen, and Ricky James Concepcion. Opportunities for Energy Storage in CAISO. No. SAND2018-5272C. Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2018. Available online.

Concepcion, Ricky J., Felipe Wilches-Bernal, and Raymond H. Byrne. "Revenue Opportunities for Electric Storage Resources in the Southwest Power Pool Integrated Marketplace." 2018 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 2018. Available online.

Wilches-Bernal, Felipe, Ricky J. Concepcion, and Raymond H. Byrne. "Electrical Energy Storage Participation in the NYISO Electricity and Frequency Regulation Markets." 2018 IEEE Power & Energy Society General Meeting (PESGM). IEEE, 2018.

Nguyen, Tu A., and Raymond H. Byrne. "Maximizing the cost-savings for time-of-use and net-metering customers using behind-the-meter energy storage systems." 2017 North American Power Symposium (NAPS). IEEE, 2017. Available online.

Nguyen, Tu A., et al. "Maximizing revenue from electrical energy storage in MISO energy & frequency regulation markets." 2017 IEEE Power & Energy Society General Meeting. IEEE, 2017. Available online.

Byrne, Raymond H., Ricky J. Concepcion, and César A. Silva-Monroy. "Estimating potential revenue from electrical energy storage in PJM." 2016 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 2016. Available online.

Byrne, Raymond H., et al. "The value proposition for energy storage at the Sterling Municipal Light Department." 2017 IEEE Power & Energy Society General Meeting. IEEE, 2017. Available online.

Byrne, Raymond H., et al. "Energy management and optimization methods for grid energy storage systems." IEEE Access 6 (2017): 13231-13260. Available online.

Byrne, Raymond H., and César A. Silva-Monroy. "Potential revenue from electrical energy storage in ERCOT: The impact of location and recent trends." 2015 IEEE Power & Energy Society General Meeting. IEEE, 2015. Available online.