neovim/treesitter and html with long lines causes runaway memory alloc #5387

cskeeters · 2025-01-27T02:49:33Z

cskeeters
Jan 27, 2025

I was trying out embedded base64-encoded image data in html and ghostty became really slow. I noticed in Activity Monitor that ghostty will run up to 4GB of allocated memory when this occurs so I think there is some sort of run away memory allocation going on.

iTerm2, no problem. nvim --clean in ghostty, no problem, so I disabled everything and then started enabling stuff until it broke. Turns out it only needs Tree-sitter with the html parser downloaded and highlight{enable = true}. It also only occurs when vim opens an html file with a line longer than around 2100 characters. If the file has more than around 1053 characters, vim doesn't display the text correctly, but there is no memory run.

I think these two files are all you need to reproduce the error.

NOTE: I deleted a bunch of the image data to see where the problem would start so it's likely not valid base64 or SVG.

Neovim config (init.lua):

local lazypath = vim.fn.stdpath("data") .. "/lazy/lazy.nvim"
if not vim.loop.fs_stat(lazypath) then
    vim.fn.system({
        "git",
        "clone",
        "--filter=blob:none",
        "https://github.com/folke/lazy.nvim.git",
        "--branch=stable", -- latest stable release
        lazypath,
    })
end
vim.opt.rtp:prepend(lazypath)

require("lazy").setup({
    spec = {
        {
            enabled = true,
            'nvim-treesitter/nvim-treesitter',
            build = ":TSUpdate",
            keys = {
            },
            init = function()
                require'nvim-treesitter.configs'.setup {
                    modules = {},

                    -- Install parsers synchronously (only applied to `ensure_installed`)
                    sync_install = false,

                    -- A list of parser names, or "all" (the four listed parsers should always be installed)
                    -- Fenced code blocks in markdown documentation will be highlighted if the language is in this list
                    ensure_installed = {
                        "html",
                    },

                    -- Automatically install missing parsers when entering buffer
                    -- Recommendation: set to false if you don't have `tree-sitter` CLI installed locally
                    auto_install = false,

                    ignore_install = {},

                    highlight = {
                        enable = true,
                    },
                }
            end,
        }
    },
    change_detection = {
        enabled = false,
        notify = false
    },
})

memory-alloc-run.html

<!DOCTYPE html>
<html xmlns="http://www.w3.org/1999/xhtml" lang xml:lang>
<body>
<img role="img" aria-label="Every Process a Nike" src="data:image/svg+xml;base64,xnIGNsYXNzPSJlZGdlTGFiZWwiPjxnIHRyYW5zZm9ybT0idHJhbnNsYXRlKDAsIDApIiBjbGFzcz0ibGFiZWwiPjxyZWN0IGhlaWdodD0iMCIgd2lkdGg9IjAiIHJ5PSIwIiByeD0iMCIvPjx0ZXh0IHN0eWxlPSIiPjx0c3BhbiBjbGFzcz0icm93IiB4PSIwIiBkeT0iMWVtIiB4bWw6c3BhY2U9InByZXNlcnZlIi8+PC90ZXh0PjwvZz48L2c+PC9nPjxnIGNsYXNzPSJub2RlcyI+PGcgdHJhbnNmb3JtPSJ0cmFuc2xhdGUoMjUuMDAzOTA2MjUsIDE2Ljc1KSIgZGF0YS1pZD0iU1RBUlQiIGRhdGEtbm9kZT0idHJ1ZSIgaWQ9ImZsb3djaGFydC1TVEFSVC0wIiBjbGFzcz0ibm9kZSBkZWZhdWx0IGRlZmF1bHQgZmxvd2NoYXJ0LWxhYmVsIj48cmVjdCBoZWlnaHQ9IjMzLjUiIHdpZHRoPSI1MC4wMDc4MTI1IiB5PSItMTYuNzUiIHg9Ii0yNS4wMDM5MDYyNSIgcnk9IjUiIHJ4PSI1IiBzdHlsZT0iIiBjbGFzcz0iYmFzaWMgbGFiZWwtY29udGFpbmVyIi8+PGcgdHJhbnNmb3JtPSJ0cmFuc2xhdGUoMCwgLTkuMjUpIiBzdHlsZT0iIiBjbGFzcz0ibGFiZWwiPjxyZWN0Lz48dGV4dCBzdHlsZT0iIj48dHNwYW4gY2xhc3M9InJvdyIgeD0iMCIgZHk9IjFlbSIgeG1sOnNwYWNlPSJwcmVzZXJ2ZSI+U3RhcnQ8L3RzcGFuPjwvdGV4dD48L2c+PC9nPjxnIHRyYW5zZm9ybT0idHJhbnNsYXRlKDE0MS41MTk1MzEyNSwgMTYuNzUpIiBkYXRhLWlkPSJET0lUIiBkYXRhLW5vZGU9InRydWUiIGlkPSJmbG93Y2hhcnQtRE9JVC0xIiBjbGFzcz0ibm9kZSBkZWZhdWx0IGRlZmF1bHQgZmxvd2NoYXJ0LWxhYmVsIj48cmVjdCBoZWlnaHQ9IjMzLjUiIHdpZHRoPSI4My4wMjM0Mzc1IiB5PSItMTYuNzUiIHg9Ii00MS41MTE3MTg3NSIgcnk9IjAiIHJ4PSIwIiBzdHlsZT0iIiBjbGFzcz0iYmFzaWMgbGFiZWwtY29udGFpbmVyIi8+PGcgdHJhbnNmb3JtPSJ0cmFuc2xhdGUoMCwgLTkuMjUpIiBzdHlsZT0iIiBjbGFzcz0ibGFiZWwiPjxyZWN0Lz48dGV4dCBzdHlsZT0iIj48dHNwYW4gY2xhc3M9InJvdyIgeD0iMCIgZHk9IjFlbSIgeG1sOnNwYWNlPSJwcmVzZXJ2ZSI+SnVzdCBEbyBJdDwvdHNwYW4+PC90ZXh0PjwvZz48L2c+PGcgdHJhbnNmb3JtPSJ0cmFuc2xhdGUoMjYxLjUwNzgxMjUsIDE2Ljc1KSIgZGF0YS1pZD0iRU5EIiBkYXRhLW5vZGU9InRydWUiIGlkPSJmbG93Y2hhcnQtRU5ELTIiIGNsYXNzPSJub2RlIGRlZmF1bHQgZGVmYXVsdCBmbG93Y2hhcnQtbGFiZWwiPjxyZWN0IGhlaWdodD0iMzMuNSIgd2lkdGg9IjU2Ljk1MzEyNSIgeT0iLTE2Ljc1IiB4PSItMjguNDc2NTYyNSIgcnk9IjUiIHJ4PSI1IiBzdHlsZT0iIiBjbGFzcz0iYmFzaWMgbGFiZWwtY29udGFpbmVyIi8+PGcgdHJhbnNmb3JtPSJ0cmFuc2xhdGUoMCwgLTkuMjUpIiBzdHlsZT0iIiBjbGFzcz0ibGFiZWwiPjxyZWN0Lz48dGV4dCBzdHlsZT0iIj48dHNwYW4gY2xhc3M9InJvdyIgeD0iMCIgZHk9IjFlbSIgeG1sOnNwYWNlPSJwcmVzZXJ2ZSI+RW5kIGl0PC90c3Bhbj48L3RleHQ+PC9nPjwvZz48L2c+PC9nPjwvZz8L3N2Zz4=" />
</body>
</html>

qgates · 2025-01-27T03:21:16Z

qgates
Jan 27, 2025

Can't confirm this. I have neovim 10.3 with lazy, treesitter/html and a few other plugins. Loading neovim with no files at idle ghostty used 225M with VSIZE of 2.2G, perfectly normal. Loading up your file, the figures hardly change, whether wrap is set or not.

1 reply

cskeeters Jan 27, 2025
Author

This bug happens every time I try it on my system. If there are any memory analysis tools I can run to illuminate/log what is happening, I'm happy to run them.

cskeeters · 2025-01-27T04:23:11Z

cskeeters
Jan 27, 2025
Author

I'm using neovim 0.10.3 also.

NVIM v0.10.3
Build type: Release
LuaJIT 2.1.1736781742

lazy-lock.json just has.

{
  "lazy.nvim": { "branch": "main", "commit": "7e6c863bc7563efbdd757a310d17ebc95166cef3" },
  "nvim-treesitter": { "branch": "master", "commit": "d34e62afd3e483fe0fa2f24b6323f3bb1d35ddcc" }
}

1 reply

cskeeters Jan 27, 2025
Author

Ghostty 1.0.1 Build 8696

cskeeters · 2025-01-31T14:59:39Z

cskeeters
Jan 31, 2025
Author

Just tested ghostty 1.1.0 (9283) and it failed too with the same symptoms.

0 replies

qgates · 2025-01-31T23:05:06Z

qgates
Jan 31, 2025

I'm afraid I still can't reproduce this issue @cskeeters. Sounds like this might be something tied to your setup. I've tried a few Linux distros, and my daily driver is Arch. Maybe this is specific to the Mac version of Ghostty, can someone else with a Mac chime in?

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

neovim/treesitter and html with long lines causes runaway memory alloc #5387

{{title}}

Replies: 4 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

neovim/treesitter and html with long lines causes runaway memory alloc #5387

cskeeters Jan 27, 2025

Replies: 4 comments · 2 replies

qgates Jan 27, 2025

cskeeters Jan 27, 2025 Author

cskeeters Jan 27, 2025 Author

cskeeters Jan 27, 2025 Author

cskeeters Jan 31, 2025 Author

qgates Jan 31, 2025

cskeeters
Jan 27, 2025

Replies: 4 comments 2 replies

qgates
Jan 27, 2025

cskeeters Jan 27, 2025
Author

cskeeters
Jan 27, 2025
Author

cskeeters Jan 27, 2025
Author

cskeeters
Jan 31, 2025
Author

qgates
Jan 31, 2025