All servers crashing to left and right

Discussion in 'Spigot Help' started by namke, Jun 6, 2017.

  1. Hey! Recently, since 2-3 days back, my servers has started to crash randomly. The weird thing is, that all servers crash at the same time - server instances on both of my physical servers.

    Here's one server I have the logs of, my Survival server. It just stopped responding while all other servers litterly crashed.
    https://pastebin.com/rZf9z3qd

    While this happens, all my servers pops out from their screens and this happens in my logs folder on each server.
    [​IMG]

    There are NO crash reports what so ever, the servers just stops responding, pops out of their screen and builds thousands of log files while trying to restart the server.

    I have a variety of plugins on the servers, this is the plugin list of one of my servers and most of them looks simliar to this.
    [​IMG]

    Here's a summary of my server over the past 3 days, it goes up and down all the time. :/
    [​IMG]

    What can I do to prevent these issues? They are ruining my server. :/
    Thanks in advance!
     
  2. I suggest removing your plugins one by one to see which one is causing it.
     
  3. The issue is still very strange that, my Survival server on server 1 crashes at the same time as my Parkour server on server 2 crashes. I have 1-3 worlds on most of the servers.

    I doubt it's any of the plugins causing it, because I have different plugins on each servers.
     
  4. 90GQ-Survival v3.4 makes many errors.
     
  5. Yeah but it's not the issue of the crash right? Cause I don't have this plugin on all servers.
     
  6. I wouldn't use it if it makes so many errors
     
  7. Gaxan

    Supporter

    How much RAM does the system have and how much do you have set to each server?
    Show us the startup flags you use for one of your servers as well.
    I think you are running out of RAM and crashing JVM.
     
  8. Hey, I am by no means an expert... but does this happen everytime Maxikitten tries to log in?
     
  9. The physical servers have 48 GB and 64 GB of RAM.

    Code (Text):
    while true ; do

    echo ""
    echo "            ##########################################"
    echo "            ##              90gQopen                ##";
    echo "            ##             Startar om...            ##"
    echo "            ##                                      ##"
    echo "            ##    Ange Ctrl + C medan detta med-    ##"
    echo "            ## delande visas för att stoppa loopen. ##"
    echo "            ##########################################"

    echo "Startar om tre sekunder..."
    sleep 1
    echo "Startar om två sekunder..."
    sleep 1
    echo "Startar om en sekund..."
    sleep 1

    rm -rf plugins/CommandSync/data.txt
    java -Xmx12G -Xms2G -XX:+AlwaysPreTouch -XX:+DisableExplicitGC -XX:+UseG1GC -XX:+UnlockExperimentalVMOptions -XX:MaxGCPauseMillis=45 -XX:TargetSurvivorRatio=90 -XX:G1NewSizePercent=50 -XX:G1MaxNewSizePercent=80 -XX:InitiatingHeapOccupancyPercent=10 -XX:G1MixedGCLiveThresholdPercent=50 -XX:+AggressiveOpts -jar survival_spigot.jar
    done
    Doesn't seem so.
     
  10. Gaxan

    Supporter

    Compare all of your Xmx total to the server physical RAM total. You should have a minimum of 2GB for the OS and JVM.
     
  11. The server performance is definitely not the problem though. They have been doing 250 players well, 100 players shouldn't make it all crash. As well as this started happening 2 days ago. :/

    Someone in the IRC suggested that it might be a network issue since both of the servers are on the same network. That might be it, not sure what to do about it though.
     
  12. I just got a crash with a crash error.

    Code (Text):
    [18:42:15] [LoginProcessingThread/INFO]: UUID of player tusse2004 is 3e6703cb-7460-4a43-a33e-8346077feaee
    [18:42:15] [LoginProcessingThread/INFO]: UUID of player lazy92 is 57c6463d-0ba3-421b-8e11-af97aa31ff1a
    [18:42:16] [Server thread/INFO]: Hugo_Kirby lost connection: Internal Exception: java.io.IOException: Error while write(...): Brutet rör
    [18:42:16] [Server thread/INFO]: samsite28 lost connection: Internal Exception: java.io.IOException: Error while write(...): Brutet rör
    [18:42:16] [Server thread/INFO]: tobban2002 lost connection: Internal Exception: java.io.IOException: Error while write(...): Förbindelse borttagen av partnern
    [18:42:16] [Server thread/INFO]: [BungeePerms] Login by tusse2004 (3e6703cb-7460-4a43-a33e-8346077feaee)
    ------------
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Current Thread: Snooper Timer
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     PID: 14 | Suspended: false | Native: false | State: WAITING
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     Stack:
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Object.wait(Native Method)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Object.wait(Object.java:502)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.TimerThread.mainLoop(Timer.java:526)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.TimerThread.run(Timer.java:505)
    [18:41:15] [Spigot Watchdog Thread/ERROR]: ------------------------------
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Current Thread: process reaper
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     PID: 11 | Suspended: false | Native: false | State: TIMED_WAITING
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     Stack:
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         sun.misc.Unsafe.park(Native Method)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Thread.run(Thread.java:745)
    [18:41:15] [Spigot Watchdog Thread/ERROR]: ------------------------------
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Current Thread: Signal Dispatcher
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     PID: 5 | Suspended: false | Native: false | State: RUNNABLE
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     Stack:
    [18:41:15] [Spigot Watchdog Thread/ERROR]: ------------------------------
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Current Thread: Finalizer
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     PID: 3 | Suspended: false | Native: false | State: WAITING
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     Stack:
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Object.wait(Native Method)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
    [18:41:15] [Spigot Watchdog Thread/ERROR]: ------------------------------
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Current Thread: Reference Handler
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     PID: 2 | Suspended: false | Native: false | State: WAITING
    [18:41:15] [Spigot Watchdog Thread/ERROR]:     Stack:
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Object.wait(Native Method)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.Object.wait(Object.java:502)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.ref.Reference.tryHandlePending(Reference.java:191)
    [18:41:15] [Spigot Watchdog Thread/ERROR]:         java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
    [18:41:15] [Spigot Watchdog Thread/ERROR]: ------------------------------
    [18:41:15] [Spigot Watchdog Thread/INFO]: Attempting to restart with ./start.sh
    [18:41:15] [Spigot Watchdog Thread/INFO]: Kimson03 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: LucasHC2005 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: samsite28 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: Guldvargen lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: lazy92 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: tusse2004 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: rallycats lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: Sara_Johanna lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: maol3 lost connection: Server is restarting
    [18:41:15] [Spigot Watchdog Thread/INFO]: Stopping server
    [18:41:15] [Spigot Watchdog Thread/INFO]: [DisguiseAPI] Disabling DisguiseAPI v1.0
    [18:41:15] [Spigot Watchdog Thread/INFO]: [90gQopen] Disabling 90gQopen v1.0
    [18:41:15] [Spigot Watchdog Thread/INFO]: [ProtocolLib] Disabling ProtocolLib v4.2.1-SNAPSHOT-b347
    [18:41:15] [Spigot Watchdog Thread/INFO]: [ProtocolSupport] Disabling ProtocolSupport v4.25.dev
    [18:41:15] [Spigot Watchdog Thread/INFO]: [FloatingPets] Disabling FloatingPets v1.0.2
    [18:41:15] [Spigot Watchdog Thread/INFO]: [0;34;1m[FloatingPets] [0;37;22mThe plugin has been disabled, even floating pets get tired sometimes and need to take breaks.[m
    [18:41:15] [Spigot Watchdog Thread/ERROR]: Error occurred while disabling FloatingPets v1.0.2 (Is it up to date?)
    java.lang.ClassCastException: cf.proxenusdev.floatingpets.FloatingPetsPlugin cannot be cast to org.bukkit.event.Listener
        at cf.proxenusdev.floatingpets.FloatingPetsPlugin.onDisable(FloatingPetsPlugin.java:378) ~[?:?]
        at org.bukkit.plugin.java.JavaPlugin.setEnabled(JavaPlugin.java:273) ~[hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.bukkit.plugin.java.JavaPluginLoader.disablePlugin(JavaPluginLoader.java:361) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.bukkit.plugin.SimplePluginManager.disablePlugin(SimplePluginManager.java:424) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.bukkit.plugin.SimplePluginManager.disablePlugins(SimplePluginManager.java:417) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.bukkit.craftbukkit.v1_11_R1.CraftServer.disablePlugins(CraftServer.java:345) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at net.minecraft.server.v1_11_R1.MinecraftServer.stop(MinecraftServer.java:464) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.spigotmc.RestartCommand.restart(RestartCommand.java:81) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.spigotmc.RestartCommand.restart(RestartCommand.java:40) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
        at org.spigotmc.WatchdogThread.run(WatchdogThread.java:85) [hub_spigot.jar:git-Spigot-3fb9445-2b6c9f4]
    [18:41:15] [Spigot Watchdog Thread/INFO]: [BungeePerms] Disabling BungeePerms v3.0 dev #52
    [18:41:15] [Spigot Watchdog Thread/INFO]: [BungeePerms] Uninjection of Bungeeperms into WorldEdit
    [18:41:15] [Spigot Watchdog Thread/INFO]: WEPIF: Using the Bukkit Permissions API.
    [18:41:15] [Spigot Watchdog Thread/INFO]: [BungeePerms] Deactivating BungeePerms ...
    [18:41:15] [Spigot Watchdog Thread/INFO]: [Citizens] Disabling Citizens v2.0.21-SNAPSHOT (build 1465)
    [18:41:16] [Spigot Watchdog Thread/INFO]: [WorldEdit] Disabling WorldEdit v6.1.5-SNAPSHOT;3645-b0bfa4a
    [18:41:16] [Spigot Watchdog Thread/INFO]: Saving players
    [18:41:16] [Spigot Watchdog Thread/INFO]: Saving worlds
    [18:41:16] [Spigot Watchdog Thread/INFO]: Saving chunks for level '90gq'/Overworld
    [18:42:15] [Server thread/INFO]: Starting minecraft server version 1.11.2
    [18:42:15] [Server thread/INFO]: Loading properties
    [18:42:16] [Server thread/INFO]: Default game type: ADVENTURE
    [18:42:15] [Server thread/INFO]: Loading properties
    [18:42:15] [Server thread/INFO]: Default game type: ADVENTURE
    [18:42:16] [Thread-3/INFO]: Stopping server
    SHOT)
    [18:42:10] [Server thread/INFO]: Server Ping Player Sample Count: 12
    [18:42:10] [Server thread/INFO]: Using 4 threads for Netty based IO
    [18:42:10] [Server thread/INFO]: Debug logging is disabled
    [18:42:10] [Server thread/INFO]: Generating keypair
    [18:42:11] [Server thread/INFO]: Starting Minecraft server on *:35001
    [18:42:11] [Server thread/INFO]: Using epoll channel type
    [18:42:14] [Server thread/WARN]: Failed to generate a seed from SecureRandom within 3 seconds. Not enough entrophy?
    [18:42:15] [Server thread/WARN]: **** FAILED TO BIND TO PORT!
    [18:42:15] [Server thread/WARN]: The exception was: java.io.IOException: Error during bind(...): Adressen redan upptagen
    [18:42:15] [Server thread/WARN]: Perhaps a server is already running on that port?
    [18:42:15] [Server thread/INFO]: Stopping server
    [18:42:15] [Server thread/INFO]: Saving players
     
    #12 namke, Jun 6, 2017
    Last edited: Jun 6, 2017
  13. Have you tried to restart the linux server?
     
  14. Yes.
     
  15. Hmmm that is strange,

    Disk ussage ?
    Ram ussage of Linux server ( like htop )
    CPU usage (htop ?)

    I dont thik it help, but try to update BungeeCord.jar ?
    Or some BungeeCord plugings that is important ?
    Via version idk.
     
  16. Splazeing

    Supporter

    I had some kind of issue like this as well, both my servers crashed always at 6AM time.

    The issue for me was that at 6AM the backup process started. Meaning there came alot of latency and lag because of the writing and reading on the server.

    If you have some kind of script backing up your servers, try disabling that and then see if it still crashes.
     
  17. It's crashing at complete random times and different times every day. I tried removing all the flags from the start script, going good so far. Let's hope it stays that way. ^^
     
  18. do you use a system or cloud for the servers ?

    update Bungeecord, or watch BungeeCord for errors
     
  19. No, I don't. The strange thing is that BungeeCord works fine, it's the Spigot servers where the errors occurs.