Enhance Neo4j Integration with Batch Operations, Vector Indexing, and Example Notebook

[Cyb3rWard0g]

Summary

This pull request significantly enhances the Neo4j integration within the Floki framework by introducing robust support for batch operations, vector property indexing, and a detailed example notebook. These changes streamline data ingestion, querying, and schema management while providing a concrete demonstration for users.

Key Changes

Neo4jGraphStore Enhancements

• Batch Node and Relationship Handling:
  • Introduced add_nodes and add_relationships methods with support for batch processing.
  • Grouped nodes and relationships by label and type, respectively, to optimize queries.
  • Enabled dynamic addition of vector properties where supported.
• Dynamic Query Support:
  • Updated query method to include pagination and optional sanitization.
  • Enhanced error handling for better debugging during Cypher query execution.
• Schema Management:
  • Added methods for refreshing and validating the schema.
  • Improved indexing support with create_vector_index for vector-based similarity search.
• Reset Functionality:
  • Included reset method to delete all nodes and relationships in the database, leveraging APOC procedures for efficient cleanup.

Utility Updates

• Sanitization Enhancements:
  • Improved value_sanitize function to handle tuples (e.g., relationships) and maintain data integrity while reducing noise.
  • Added truncation for large lists to ensure compatibility with Neo4j context limits.

Impact

Improved Developer Experience

• Simplifies the process of interacting with Neo4j, particularly for batch operations.
• Centralizes logic for schema management, node/relationship creation, and querying.

Enhanced Functionality

• Supports advanced use cases like vector property indexing for similarity searches.
• Ensures compatibility with both vector-enabled and standard Neo4j installations.

Demonstration and Documentation

• The example notebook provides a clear, user-friendly demonstration of the enhanced capabilities.