Skip to content

Add extra information on memory pool leaks#11331

Merged
losipiuk merged 1 commit intotrinodb:masterfrom
losipiuk:lo./memory-pool-debug
Mar 7, 2022
Merged

Add extra information on memory pool leaks#11331
losipiuk merged 1 commit intotrinodb:masterfrom
losipiuk:lo./memory-pool-debug

Conversation

@losipiuk
Copy link
Copy Markdown
Member

@losipiuk losipiuk commented Mar 4, 2022

When we notice that at the there is memory leak from
DistributedQueryRunner after finishing up tests we print extra
information regarding memory pool and queries from the cluster, so it
is easier to pinpoint the problem in code.

Example output:

java.lang.AssertionError: Expected memory reservation on server_0(worker)to be 0 but was 5663866; detailed memory usage:
 20220304_183721_00001_2dtqj:
   SQL: SELECT count(*) FROM tpch.tiny.customer
   memoryReservation: 7428
   taggedMemoryReservaton: {AggregationOperator=408, ExchangeOperator=5184, LazyOutputBuffer=1836}
 20220304_183726_00029_2dtqj:
   SQL: SELECT TIMESTAMP '2017-01-02 09:12:34.123456789 Europe/Paris'
   memoryReservation: 113
   taggedMemoryReservaton: {LazyOutputBuffer=113}

When we notice that at the there is memory leak from
DistributedQueryRunner after finishing up tests we print extra
information regarding memory pool and queries from the cluster, so it
is easier to pinpoint the problem in code.

Example output:
```
java.lang.AssertionError: Expected memory reservation on server_0(worker)to be 0 but was 5663866; detailed memory usage:
 20220304_183721_00001_2dtqj:
   SQL: SELECT count(*) FROM tpch.tiny.customer
   memoryReservation: 7428
   taggedMemoryReservaton: {AggregationOperator=408, ExchangeOperator=5184, LazyOutputBuffer=1836}
 20220304_183726_00029_2dtqj:
   SQL: SELECT TIMESTAMP '2017-01-02 09:12:34.123456789 Europe/Paris'
   memoryReservation: 113
   taggedMemoryReservaton: {LazyOutputBuffer=113}
```
@cla-bot cla-bot bot added the cla-signed label Mar 4, 2022
@losipiuk
Copy link
Copy Markdown
Member Author

losipiuk commented Mar 4, 2022

This is for help on: #11275

@losipiuk losipiuk requested review from arhimondr and findepi March 4, 2022 18:43
@losipiuk losipiuk merged commit 4e13342 into trinodb:master Mar 7, 2022
@github-actions github-actions bot added this to the 373 milestone Mar 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

2 participants