Issue with artifactory OSS

Discussion in 'Systems Administration' started by Nikl, Jul 22, 2018.

  1. First off: I hope this is the right section. It's my first thread outside of the development forum ^^

    I have an artifactory instance running on a small droplet from digital ocean. It was running nice and smooth for a month now, but last week I noticed it was down. I ssh'ed in and tried to restart it, but it isn't starting. The logs are full of automatic restart attempts.

    Two days ago I put all the relevant information and things I tried together in a SO question: https://stackoverflow.com/questions/51451739/artifactory-issue-maybe-derby-related (the logs are way to much to post here anyways...)

    I have no clue why it stopped running and I haven't got a comment/answer on SO. Maybe here someone knows what else I could try?
     
    #1 Nikl, Jul 22, 2018
    Last edited: Jul 22, 2018
  2. Bump, since the issue came back a day ago. Inbetween artifactory magically was running again, without me havig any obvious part in fixing it. I updated the SO question with another interesting log file...

    Edit: What I just found out is, that even when I stop artifactory it takes almost all my CPU and most of my ram busy:
    Code (Text):
    [email protected]:~$ top
    top - 22:52:56 up 13 days,  5:21,  1 user,  load average: 2.13, 2.17, 2.25
    Tasks: 119 total,   1 running, 118 sleeping,   0 stopped,   0 zombie
    %Cpu(s): 89.1 us,  6.9 sy,  0.0 ni,  0.0 id,  0.0 wa,  0.0 hi,  0.0 si,  3.9 st
    KiB Mem :  1016056 total,   187408 free,   620284 used,   208364 buff/cache
    KiB Swap:        0 total,        0 free,        0 used.   224556 avail Mem

      PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
    13332 artifac+  20   0 4230304 568164  24872 S 97.1 55.9  32:01.62 java
    23033 nikl      20   0   40564   3828   3136 R  1.0  0.4   0:00.09 top
    23034 root      20   0   65508   6028   5316 S  1.0  0.6   0:00.03 sshd
    23019 nikl      20   0   92828   3200   2276 S  0.6  0.3   0:00.03 sshd
    1327 root      10 -10    5720   3512   2432 S  0.3  0.3  29:06.84 iscsid
    1345 root      20   0   65508   2872   2156 S  0.3  0.3   0:19.53 sshd
        1 root      20   0  185328   5256   3308 S  0.0  0.5 129:50.04 systemd
        2 root      20   0       0      0      0 S  0.0  0.0   0:00.99 kthreadd
        3 root      20   0       0      0      0 S  0.0  0.0   7:50.42 ksoftirqd/0
        5 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kworker/0:0H
        7 root      20   0       0      0      0 S  0.0  0.0  34:04.88 rcu_sched
        8 root      20   0       0      0      0 S  0.0  0.0   0:00.00 rcu_bh
        9 root      rt   0       0      0      0 S  0.0  0.0   0:00.00 migration/0
       10 root      rt   0       0      0      0 S  0.0  0.0   1:02.80 watchdog/0
       11 root      20   0       0      0      0 S  0.0  0.0   0:00.01 kdevtmpfs
       12 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 netns
       13 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 perf
       14 root      20   0       0      0      0 S  0.0  0.0   0:03.94 khungtaskd
       15 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 writeback
       16 root      25   5       0      0      0 S  0.0  0.0   0:00.00 ksmd
       17 root      39  19       0      0      0 S  0.0  0.0   0:27.80 khugepaged
       18 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 crypto
       19 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kintegrityd
       20 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       21 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kblockd
       22 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ata_sff
       23 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 md
       24 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 devfreq_wq
       28 root      20   0       0      0      0 S  0.0  0.0 393:36.76 kswapd0
       29 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 vmstat
       30 root      20   0       0      0      0 S  0.0  0.0   0:09.06 fsnotify_mark
       31 root      20   0       0      0      0 S  0.0  0.0   0:00.00 ecryptfs-kthrea
       47 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kthrotld
       48 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 acpi_thermal_pm
       49 root      20   0       0      0      0 S  0.0  0.0   0:00.00 vballoon
       50 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       51 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       52 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       53 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       54 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       55 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       56 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       57 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       58 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
       59 root      20   0       0      0      0 S  0.0  0.0   0:00.00 scsi_eh_0
       60 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 scsi_tmf_0
       61 root      20   0       0      0      0 S  0.0  0.0   0:00.00 scsi_eh_1
       62 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 scsi_tmf_1
       67 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ipv6_addrconf
       80 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 deferwq
       81 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 charger_manager
      119 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      120 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      121 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      122 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      123 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      124 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      125 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      126 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      127 root      20   0       0      0      0 S  0.0  0.0   0:00.00 scsi_eh_2
      128 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 scsi_tmf_2
      129 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kpsmoused
      443 root       0 -20       0      0      0 S  0.0  0.0   0:29.08 kworker/0:1H
      484 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 raid5wq
      513 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 bioset
      537 root      20   0       0      0      0 S  0.0  0.0   2:28.24 jbd2/vda1-8
      538 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ext4-rsv-conver
      618 root      20   0   92612   2944    568 S  0.0  0.3  36:44.59 systemd-journal
      622 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 iscsi_eh
      629 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ib_addr
      633 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ib_mcast
      635 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ib_nl_sa_wq
      636 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 ib_cm
      637 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 iw_cm_wq
      638 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 rdma_cm
      639 root      20   0       0      0      0 S  0.0  0.0   0:00.00 kauditd
      668 root      20   0   94772    628    452 S  0.0  0.1   0:00.01 lvmetad
      711 root      20   0   42760   2000    980 S  0.0  0.2   0:09.99 systemd-udevd
      788 root       0 -20       0      0      0 S  0.0  0.0   0:00.00 kvm-irqfd-clean
      975 systemd+  20   0  100324   1372   1124 S  0.0  0.1   0:09.91 systemd-timesyn
    [email protected]:~$ systemctl status artifactory.service
    ‚óŹ artifactory.service - Setup Systemd script for Artifactory in Tomcat Servlet Engine
       Loaded: loaded (/lib/systemd/system/artifactory.service; enabled; vendor preset: enabled)
       Active: inactive (dead) since Wed 2018-08-01 22:46:50 UTC; 6min ago
      Process: 22731 ExecStart=/opt/jfrog/artifactory/bin/artifactoryManage.sh start (code=killed, signal=TERM)