DataTable: Slow filter and sort performance with large datasets

[andrewguy]

Describe the bug

Filter and sort performance is slow when dealing with large numbers of filters and/or large datasets with the DataTable component.

This seems to be due to a couple of things:

• Large numbers of calls to ObjectUtils.resolveFieldData within the compareFn function passed to sort. ObjectUtils.resolveFieldData is relatively slow. Doing an expensive function call within the compareFn means that sort performance scales poorly with dataset size.
• Executing filters even when the filter value is null, which is performed for each item in the data array. If a filter value is null, this filter is still assessed, which also involves a call to ObjectUtils.resolveFieldData. This means that filters on many columns leads to poor performance when filtering or sorting, even if those filters aren't active.

I'm raising this issue as part of a PR that aims to improve performance for both sort and filter routines in the DataTable component.

Reproducer

https://codesandbox.io/s/priceless-sound-jwo4kl

PrimeVue version

3.29.1

Vue version

3.x

Language

ES6

Build / Runtime

Vite

Browser(s)

No response

Steps to reproduce the behavior

No response

Expected behavior

No response

[NeluQi]

+1

[NeluQi]

I am having a memory overflow in ObjectUtils.resolveFieldData. Lines 30000.

There can be many more lines in my project.

Please improve performance.

Lazy loading doesn't suit my case

[tugcekucukoglu]

013b126