Memory leaks when idle

[and3rson]

Describe the bug

When opening a lua file with neovim, lua-language-server starts slowly eating RAM until it takes all 16 GB of my RAM and freezes my machine. It takes around 20-30 minutes. During this time, ~/.cache/nvim/lsp.log and /tmp/lua-language-server.XXX/log/* stay silent. This happens even when I don't interact with my neovim instance at all. Reproducible both with and without --preview.

Another strange thing is that lua-language-server is constantly taking 100% of one of my CPU cores.

This does NOT happen when running lua-language-server outside of neovim with the same command as lspconfig does.

To Reproduce
Steps to reproduce the behavior:

1. Open lua file
2. Observe 100% CPU usage for one of the cores.
3. Wait for 15 minutes
4. Machine is out of RAM

Expected behavior
RAM should not be exhausted like that. Also, CPU usage should not max out at all times.

Environment (please complete the following information):

• Arch Linux
• Client: neovim

Provide logs

service.log

[01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:65]: Lua Lsp startup, root: /usr/lib/lua-language-server [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:66]: ROOT: /usr/lib/lua-language-server [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:67]: LOGPATH: /tmp/lua-language-server.eKB6/log [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:68]: METAPATH: /tmp/lua-language-server.eKB6/meta [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:69]: VERSION: [01:15:33.199][info] [#0:script/service/service.lua:141]: ========= Medical Examination Report ========= --------------- Memory --------------- Total: 1.432 MB # 00 : 1.432 MB # 01 : 0.000 MB # 02 : 0.000 MB # 03 : 0.000 MB # 04 : 0.000 MB --------------- Coroutine --------------- Total: 0 Running: 0 Suspended: 0 Normal: 0 Dead: 0 --------------- Cache --------------- Total: 1 Dead: 0 --------------- RPC --------------- Holdon: 0 Waiting: 0 ============================================== [01:15:33.307][info] [#0:script/language.lua:137]: VSC language: nil [01:15:33.307][info] [#0:script/language.lua:138]: LS language: en-us [01:15:33.307][info] [#0:script/workspace/workspace.lua:38]: Workspace init root: file:///home/anderson [01:15:33.308][info] [#0:script/workspace/workspace.lua:42]: Log path: /tmp/lua-language-server.eKB6/log/file_home_anderson.log

file_home_anderson.log

[01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:65]: Lua Lsp startup, root: /usr/lib/lua-language-server [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:66]: ROOT: /usr/lib/lua-language-server [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:67]: LOGPATH: /tmp/lua-language-server.eKB6/log [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:68]: METAPATH: /tmp/lua-language-server.eKB6/meta [01:15:33.157][info] [#0:/usr/lib/lua-language-server/main.lua:69]: VERSION: [01:15:33.199][info] [#0:script/service/service.lua:141]: ========= Medical Examination Report ========= --------------- Memory --------------- Total: 1.432 MB # 00 : 1.432 MB # 01 : 0.000 MB # 02 : 0.000 MB # 03 : 0.000 MB # 04 : 0.000 MB --------------- Coroutine --------------- Total: 0 Running: 0 Suspended: 0 Normal: 0 Dead: 0 --------------- Cache --------------- Total: 1 Dead: 0 --------------- RPC --------------- Holdon: 0 Waiting: 0 ============================================== [01:15:33.307][info] [#0:script/language.lua:137]: VSC language: nil [01:15:33.307][info] [#0:script/language.lua:138]: LS language: en-us [01:15:33.307][info] [#0:script/workspace/workspace.lua:38]: Workspace init root: file:///home/anderson [01:15:33.308][info] [#0:script/workspace/workspace.lua:42]: Log path: /tmp/lua-language-server.eKB6/log/file_home_anderson.log [01:15:33.308][info] [#0:script/workspace/workspace.lua:48]: Workspace create: file:///home/anderson [01:15:33.416][info] [#0:script/provider/provider.lua:40]: Load config from client file:///home/anderson [01:15:33.416][info] [#0:script/provider/provider.lua:47]: Load config from .luarc.json/.luarc.jsonc file:///home/anderson [01:15:33.416][info] [#0:script/provider/provider.lua:40]: Load config from client file:///home/anderson [01:15:33.416][info] [#0:script/provider/provider.lua:47]: Load config from .luarc.json/.luarc.jsonc file:///home/anderson [01:15:33.417][info] [#0:script/provider/provider.lua:55]: Load config from client fallback [01:15:33.417][info] [#0:script/library.lua:207]: Init builtin library at: nil [01:15:33.422][info] [#0:script/library.lua:207]: Init builtin library at: file:///home/anderson [01:15:33.430][info] [#0:script/plugin.lua:80]: plugin path: nil [01:15:33.430][info] [#0:script/plugin.lua:80]: plugin path: nil [01:15:33.430][info] [#0:script/provider/provider.lua:55]: Load config from client fallback [01:15:33.430][info] [#0:script/workspace/workspace.lua:279]: Preload start: file:///home/anderson [01:15:33.431][info] [#0:script/workspace/workspace.lua:285]: Scan files at: file:///home/anderson [01:15:33.431][info] [#0:script/workspace/workspace.lua:295]: Scan library at: file:///tmp/lua-language-server.eKB6/meta/LuaJIT%20en-us%20utf8 [01:15:33.431][info] [#0:script/workspace/workspace.lua:279]: Preload start: [01:15:33.431][info] [#0:script/workspace/workspace.lua:295]: Scan library at: file:///tmp/lua-language-server.eKB6/meta/LuaJIT%20en-us%20utf8 [01:15:35.228][info] [#0:script/workspace/workspace.lua:309]: Found 13 files at: file:///home/anderson [01:15:35.228][info] [#0:script/workspace/loading.lua:152]: Load files from disk: file:///home/anderson [01:15:35.228][info] [#0:script/workspace/workspace.lua:309]: Found 13 files at: [01:15:35.228][info] [#0:script/workspace/loading.lua:152]: Load files from disk: [01:15:35.273][info] [#0:script/workspace/loading.lua:164]: Loaded files takes [0.089] sec: file:///home/anderson [01:15:35.273][info] [#0:script/workspace/loading.lua:173]: Compile files takes [0.000] sec: file:///home/anderson [01:15:35.273][info] [#0:script/workspace/loading.lua:174]: Loaded finish: file:///home/anderson [01:15:35.273][info] [#0:script/workspace/workspace.lua:311]: Preload finish at: file:///home/anderson [01:15:35.273][info] [#0:script/workspace/loading.lua:164]: Loaded files takes [0.089] sec: [01:15:35.273][info] [#0:script/workspace/loading.lua:173]: Compile files takes [0.003] sec: [01:15:35.273][info] [#0:script/workspace/loading.lua:174]: Loaded finish: [01:15:35.273][info] [#0:script/workspace/workspace.lua:311]: Preload finish at: [01:15:35.273][info] [#0:script/provider/diagnostic.lua:387]: Diagnostics scope [], files count:[14] [01:15:35.288][info] [#0:script/provider/diagnostic.lua:404]: Diagnostics scope [] finished, takes [0.028] sec. [01:15:37.228][info] [#0:script/provider/diagnostic.lua:387]: Diagnostics scope [file:///home/anderson], files count:[14] [01:15:37.235][info] [#0:script/provider/diagnostic.lua:404]: Diagnostics scope [file:///home/anderson] finished, takes [0.013] sec.

[and3rson]

Update: it's weird, but the issue reproduces based on which folder the edited file is in. E. g.:

vim ~/.bashrc.d/scripts/new_file.lua -> CPU 100%, memory leaks, even though ~/.bashrc.d/scripts has only 1 file without any imports at all.
vim ~/.config/nvim/lua/new_file.lua -> everything works normally, no leaks or high CPU usage, even though ~/.config/nvim/lua/ has a lot of files with many imports!
cd ~ && mkdir foo && vim foo/1.lua - high CPU, memory leaks.
cd /tmp && mkdir foo && vim foo/1.lua - no leaks.

I'd love to help with debugging but I'm really lost at this point - there are no logs and no clear evidence of how the parent folder influences the bug...

[sumneko]

Could you please check out the latest master, check if it has been fixed?

[and3rson]

@sumneko I've tested this with the latest master (4f74c75c). Anything else I can do to help debug this?

Edit: I've checked /proc/.../fd for lua-language server and it seems like it's crawling my entire filesystem when idle - the file descriptors are constantly changing.

$ $ ll /proc/40026/fd
lr-x------  64 anderson anderson  5 тра 11:21 5 -> /home/anderson
lr-x------  64 anderson anderson  5 тра 11:21 6 -> /home/anderson/.local
lr-x------  64 anderson anderson  5 тра 11:21 7 -> /home/anderson/.local/share
lr-x------  64 anderson anderson  5 тра 11:21 8 -> /home/anderson/.local/share/Steam
lr-x------  64 anderson anderson  5 тра 11:21 9 -> /home/anderson/.local/share/Steam/steamapps
lr-x------  64 anderson anderson  5 тра 11:21 10 -> /home/anderson/.local/share/Steam/steamapps/common
lr-x------  64 anderson anderson  5 тра 11:21 11 -> /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16
lr-x------  64 anderson anderson  5 тра 11:21 12 -> /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16/dist
lr-x------  64 anderson anderson  5 тра 11:21 13 -> /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16/dist/share
lr-x------  64 anderson anderson  5 тра 11:21 14 -> /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16/dist/share/default_pfx
lr-x------  64 anderson anderson  5 тра 11:21 15 -> /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16/dist/share/default_pfx/dosdevices
lr-x------  64 anderson anderson  5 тра 11:21 16 -> /
lr-x------  64 anderson anderson  5 тра 11:21 17 -> /sys
lr-x------  64 anderson anderson  5 тра 11:21 18 -> /sys/kernel
lr-x------  64 anderson anderson  5 тра 11:21 19 -> /sys/kernel/software_nodes
lr-x------  64 anderson anderson  5 тра 11:21 20 -> /sys/kernel/software_nodes/node0
lr-x------  64 anderson anderson  5 тра 11:21 21 -> /sys/devices/pci0000:00/0000:00:15.1/i2c_designware.1
lr-x------  64 anderson anderson  5 тра 11:21 22 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:7d
lr-x------  64 anderson anderson  5 тра 11:21 23 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:7d/LNXPOWER:08
lr-x------  64 anderson anderson  5 тра 11:21 24 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 25 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 26 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 27 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 29 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 30 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 31 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 32 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 33 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 34 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 35 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 36 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 37 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 38 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 39 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 40 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 41 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 42 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 43 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 44 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 45 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 46 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 47 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 48 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 49 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 50 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 51 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 52 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 53 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 54 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 55 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 56 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 57 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 58 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 59 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 60 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 61 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 62 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 63 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 64 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 65 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 66 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 67 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 68 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 69 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 70 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 71 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 72 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:63/PRP00001:00/device:6b
lr-x------  64 anderson anderson  5 тра 11:21 73 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 74 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 75 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:2d
lr-x------  64 anderson anderson  5 тра 11:21 76 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:2d/device:2e
lr-x------  64 anderson anderson  5 тра 11:21 77 -> /sys/bus/acpi
lr-x------  64 anderson anderson  5 тра 11:21 78 -> /sys/bus/acpi/devices
lr-x------  64 anderson anderson  5 тра 11:21 79 -> /sys/devices/LNXSYSTM:00
lr-x------  64 anderson anderson  5 тра 11:21 80 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00
lr-x------  64 anderson anderson  5 тра 11:22 81 -> /sys/devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00
lr-x------  64 anderson anderson  5 тра 11:22 82 -> /sys/devices/pci0000:00
lr-x------  64 anderson anderson  5 тра 11:22 83 -> /sys/devices/pci0000:00/0000:00:1f.3
lr-x------  64 anderson anderson  5 тра 11:23 84 -> /sys/devices/pci0000:00/0000:00:1f.3/sound
lr-x------  64 anderson anderson  5 тра 11:23 85 -> /sys/devices/pci0000:00/0000:00:1f.3/sound/card0
lr-x------  64 anderson anderson  5 тра 11:23 86 -> /sys/devices/pci0000:00/0000:00:1f.3/sound/card0/pcmC0D7p

Seems like lua-language-server recurses into root due to /home/anderson/.local/share/Steam/steamapps/common/Proton 3.16/dist/share/default_pfx/dosdevices containing a symlink to root:

ls -l /home/anderson/.local/share/Steam/steamapps/common/Proton\ 3.16/dist/share/default_pfx/dosdevices/
lrwxrwxrwx 10 anderson anderson 22 лис  2020 -I c: -> ../drive_c
lrwxrwxrwx 10 anderson anderson 22 лис  2020 -- com1 -> /dev/ttyS0
lrwxrwxrwx 10 anderson anderson 22 лис  2020 -- com2 -> /dev/ttyS1
lrwxrwxrwx 10 anderson anderson 22 лис  2020 -- com3 -> /dev/ttyS2
lrwxrwxrwx 10 anderson anderson 22 лис  2020 -- com4 -> /dev/ttyS3
lrwxrwxrwx  1 anderson anderson 22 лис  2020 -- z: -> /

But why does it start scanning ~/.local when I'm in a different folder (cd ~/.bashrc.d/scripts && vim prompt.lua)? And why does it happen when in ~/.bashrc.d/scripts but not when in ~/.config/nvim?

[sumneko]

Please check out 727c3a0

[and3rson]

Please check out 727c3a0

Just tried this commit specifically - the issue still persists

[sumneko]

Could you please help me do some tests, I cannot reproduce it in my computer:

diff --git a/script/workspace/workspace.lua b/script/workspace/workspace.lua
index 33f8784d..e45be3a4 100644
--- a/script/workspace/workspace.lua
+++ b/script/workspace/workspace.lua
@@ -69,6 +69,7 @@ local globInteferFace = {
         local result
         pcall(function ()
             local status = fs.symlink_status(path):type()
+            log.info('fs type', path, status)
             if status == 'directory' then
                 result = 'directory'
             elseif status == 'regular' then

Please use this patch and check the log, thank you!

[and3rson]

Could you please help me do some tests, I cannot reproduce it in my computer:

diff --git a/script/workspace/workspace.lua b/script/workspace/workspace.lua
index 33f8784d..e45be3a4 100644
--- a/script/workspace/workspace.lua
+++ b/script/workspace/workspace.lua
@@ -69,6 +69,7 @@ local globInteferFace = {
         local result
         pcall(function ()
             local status = fs.symlink_status(path):type()
+            log.info('fs type', path, status)
             if status == 'directory' then
                 result = 'directory'
             elseif status == 'regular' then

Please use this patch and check the log, thank you!

Sure! Here's the output:

[11:58:53.700][info] [#0:script/language.lua:137]: VSC language: nil
[11:58:53.700][info] [#0:script/language.lua:138]: LS  language: en-us
[11:58:53.700][info] [#0:script/workspace/workspace.lua:38]: Workspace init root:        file:///home/anderson
[11:58:53.700][info] [#0:script/workspace/workspace.lua:42]: Log path:   /tmp/lua-language-server/file_home_anderson.log
[11:58:53.700][info] [#0:script/workspace/workspace.lua:48]: Workspace create:   file:///home/anderson
[11:58:53.806][info] [#0:script/provider/provider.lua:40]: Load config from client       file:///home/anderson
[11:58:53.806][info] [#0:script/provider/provider.lua:47]: Load config from .luarc.json/.luarc.jsonc     file:///home/anderson
[11:58:53.807][info] [#0:script/provider/provider.lua:40]: Load config from client       file:///home/anderson
[11:58:53.807][info] [#0:script/provider/provider.lua:47]: Load config from .luarc.json/.luarc.jsonc     file:///home/anderson
[11:58:53.807][info] [#0:script/provider/provider.lua:55]: Load config from client       fallback
[11:58:53.807][info] [#0:script/library.lua:207]: Init builtin library at:       nil
[11:58:53.824][info] [#0:script/library.lua:207]: Init builtin library at:       file:///home/anderson
[11:58:53.832][info] [#0:script/plugin.lua:80]: plugin path:     nil
[11:58:53.832][info] [#0:script/plugin.lua:80]: plugin path:     nil
[11:58:53.832][info] [#0:script/provider/provider.lua:55]: Load config from client       fallback
[11:58:53.833][info] [#0:script/workspace/workspace.lua:280]: Preload start:     file:///home/anderson
[11:58:53.834][info] [#0:script/workspace/workspace.lua:286]: Scan files at:     file:///home/anderson
[11:58:53.834][info] [#0:script/workspace/workspace.lua:296]: Scan library at:   file:///home/anderson/src/lua-language-server/meta/LuaJIT%20en-us%20utf8
[11:58:53.834][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8    directory
[11:58:53.834][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/package.lua        regular
[11:58:53.834][info] [#0:script/workspace/workspace.lua:280]: Preload start:     <fallback>
[11:58:53.834][info] [#0:script/workspace/workspace.lua:296]: Scan library at:   file:///home/anderson/src/lua-language-server/meta/LuaJIT%20en-us%20utf8
[11:58:53.834][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8    directory
[11:58:53.834][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/package.lua        regular
[11:58:53.834][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/ffi.lua    regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/ffi.lua    regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/coroutine.lua      regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/coroutine.lua      regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/table.lua  regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/table.lua  regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/os.lua     regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/os.lua     regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/bit.lua    regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/bit.lua    regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/builtin.lua        regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/builtin.lua        regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/math.lua   regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/math.lua   regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/string.lua regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/string.lua regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/io.lua     regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/io.lua     regular
[11:58:53.835][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/basic.lua  regular
[11:58:53.836][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/basic.lua  regular
[11:58:53.836][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/debug.lua  regular
[11:58:53.836][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/debug.lua  regular
[11:58:53.836][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/jit.lua    regular
[11:58:53.836][info] [#0:script/workspace/workspace.lua:72]: fs type     /home/anderson/src/lua-language-server/meta/LuaJIT en-us utf8/jit.lua    regular
[11:58:55.631][info] [#0:script/workspace/workspace.lua:310]: Found 13 files at:        file:///home/anderson
[11:58:55.631][info] [#0:script/workspace/loading.lua:152]: Load files from disk:       file:///home/anderson
[11:58:55.631][info] [#0:script/workspace/workspace.lua:310]: Found 13 files at:        <fallback>
[11:58:55.631][info] [#0:script/workspace/loading.lua:152]: Load files from disk:       <fallback>
[11:58:55.683][info] [#0:script/workspace/loading.lua:164]: Loaded files takes [0.105] sec: file:///home/anderson
[11:58:55.683][info] [#0:script/workspace/loading.lua:173]: Compile files takes [0.000] sec: file:///home/anderson
[11:58:55.683][info] [#0:script/workspace/loading.lua:174]: Loaded finish:      file:///home/anderson
[11:58:55.683][info] [#0:script/workspace/workspace.lua:312]: Preload finish at:        file:///home/anderson
[11:58:55.683][info] [#0:script/workspace/loading.lua:164]: Loaded files takes [0.106] sec: <fallback>
[11:58:55.683][info] [#0:script/workspace/loading.lua:173]: Compile files takes [0.000] sec: <fallback>
[11:58:55.683][info] [#0:script/workspace/loading.lua:174]: Loaded finish:      <fallback>
[11:58:55.683][info] [#0:script/workspace/workspace.lua:312]: Preload finish at:        <fallback>
[11:58:55.683][info] [#0:script/provider/diagnostic.lua:387]: Diagnostics scope [<fallback>], files count:[14]
[11:58:55.707][info] [#0:script/provider/diagnostic.lua:404]: Diagnostics scope [<fallback>] finished, takes [0.046] sec.
[11:58:57.631][info] [#0:script/provider/diagnostic.lua:387]: Diagnostics scope [file:///home/anderson], files count:[14]
[11:58:57.639][info] [#0:script/provider/diagnostic.lua:404]: Diagnostics scope [file:///home/anderson] finished, takes [0.018] sec.

Logs stop after this, but I can still see the file descriptors changing. So symlink check in 727c3a0 seems to work properly. Possibly there's some indexing in another place

Edit: it's also strange that this bug is reproducible only in certain directories.

[sumneko]

diff --git a/script/fs-utility.lua b/script/fs-utility.lua
index c845c769..08aae98a 100644
--- a/script/fs-utility.lua
+++ b/script/fs-utility.lua
@@ -281,12 +281,8 @@ local function fsIsDirectory(path, option)
     if path.type == 'dummy' then
         return path:isDirectory()
     end
-    local suc, res = pcall(fs.is_directory, path)
-    if not suc then
-        option.err[#option.err+1] = res
-        return false
-    end
-    return res
+    local status = fs.symlink_status(path):type()
+    return status == 'directory'
 end

 local function fsPairs(path, option)
@@ -616,9 +612,10 @@ end

 function m.scanDirectory(dir, callback)
     for fullpath in fs.pairs(dir) do
-        if fs.is_directory(fullpath) then
+        local status = fs.symlink_status(fullpath):type()
+        if status == 'directory' then
             m.scanDirectory(fullpath, callback)
-        else
+        elseif status == 'regular' then
             callback(fullpath)
         end
     end

Please try this patch

[and3rson]

diff --git a/script/fs-utility.lua b/script/fs-utility.lua
index c845c769..08aae98a 100644
--- a/script/fs-utility.lua
+++ b/script/fs-utility.lua
@@ -281,12 +281,8 @@ local function fsIsDirectory(path, option)
     if path.type == 'dummy' then
         return path:isDirectory()
     end
-    local suc, res = pcall(fs.is_directory, path)
-    if not suc then
-        option.err[#option.err+1] = res
-        return false
-    end
-    return res
+    local status = fs.symlink_status(path):type()
+    return status == 'directory'
 end

 local function fsPairs(path, option)
@@ -616,9 +612,10 @@ end

 function m.scanDirectory(dir, callback)
     for fullpath in fs.pairs(dir) do
-        if fs.is_directory(fullpath) then
+        local status = fs.symlink_status(fullpath):type()
+        if status == 'directory' then
             m.scanDirectory(fullpath, callback)
-        else
+        elseif status == 'regular' then
             callback(fullpath)
         end
     end

Please try this patch

Applied this patch, nothing changed unfortunately :(

EDIT: Still the same after I've replaced fs.is_directory with fs.symlink(...):type() == 'directory' everywhere

[sumneko]

diff --git a/script/filewatch.lua b/script/filewatch.lua
index 5e3a0322..c6958eaa 100644
--- a/script/filewatch.lua
+++ b/script/filewatch.lua
@@ -25,6 +25,7 @@ m._eventList = {}
 m._watchings = {}

 function m.watch(path)
+    do return end
     if m._watchings[path] then
         m._watchings[path].count = m._watchings[path].count + 1
     else

Maybe filewatch?

[and3rson]

diff --git a/script/filewatch.lua b/script/filewatch.lua
index 5e3a0322..c6958eaa 100644
--- a/script/filewatch.lua
+++ b/script/filewatch.lua
@@ -25,6 +25,7 @@ m._eventList = {}
 m._watchings = {}

 function m.watch(path)
+    do return end
     if m._watchings[path] then
         m._watchings[path].count = m._watchings[path].count + 1
     else

Maybe filewatch?

That fixed it! No more FDs appearing/disappearing, and the CPU use has normalized

[sumneko]

@actboy168 filewatch will fall into symbol links

[and3rson]

@actboy168 filewatch will fall into symbol links

I've also just found out that the issue does not occur when having a .luarc.json with .workspace.library defined:

// /home/anderson/.bashrc.d/scripts/.luarc.json
{
    "workspace": {
        "library": [
            "/home/anderson/.bashrc.d/scripts"
        ],
        "maxPreload": 1600,
        "preloadFileSize": 1000
    }
}

Now vim ~/.bashrc.d/scripts/prompt.lua works without any problems

EDIT: It works fine even if .luarc.json is empty