I am dynamically unloading commands and it seems that the help page thing is keeping a reference to my commands. I have no idea where the class is and can't do anything about it till I find it.
I think I found a solution: https://bukkit.org/threads/0-references-still-not-being-garbage-collected.203502/