Project

General

Profile

Actions

Bug #7988

closed

Migrate eventlog crashes jetty with OOM

Added by Janos Mattyasovszky over 8 years ago. Updated over 8 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
Server components
Target version:
-
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

When after an update we start jetty, it starts it migration and crashes (32G heap size):

[2016-02-26 17:08:34] INFO  migration - Start migration of EventLog from format '5' to '6'
[2016-02-26 17:12:44] WARN  application - [Store Agent Run Times] Task frequency is set too low! Last task took 31273 ms but t
asks are scheduled every 10000 ms. Adjust rudder.batch.storeAgentRunTimes.updateInterval if this problem persists.
Exception in thread "Health Check Thread for LDAPConnectionPool(serverSet=SingleServerSet(server=localhost:389), maxConnection
s=2)" java.lang.OutOfMemoryError: Java heap space
        at com.unboundid.ldap.sdk.LDAPConnectionPool.doHealthCheck(LDAPConnectionPool.java:2445)Exception in thread "qtp130783
3037-35" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Connection reader for connection 2 to localhost:389" java.lang.OutOfMemoryError:
        at com.unboundid.ldap.sdk.LDAPConnectionPoolHealthCheckThread.run(LDAPConnectionPoolHealthCheckThread.javaJava heap sp
ace
Exception in thread "Connection reader for connection 1 to localhost:389" Exception in thread "Scanner-0" java.lang.OutOfMemor
yError: Java heap space
Exception in thread "pool-2-thread-8" java.lang.OutOfMemoryError:       at Exception in thread "HashSessionScavenger-0" java.l
ang.OutOfMemoryError: Exception in thread "pool-2-thread-1" java.lang.OutOfMemoryError:   at java.lang.OutOfMemoryErrorjava.ne
t.Inet4AddressJava heap space
Exception in thread "pool-2-thread-12" java.lang.OutOfMemoryError: Java heap space
java.util.ArrayList.    at net.liftweb.actor.SpecializedLiftActor$class.Exception in thread "pool-2-thread-2" java.lang.OutOfM
emoryError: Java heap space
Java heap space

It would make sense to process stuff in small batches if possible.


Related issues 1 (0 open1 closed)

Is duplicate of Rudder - Bug #7524: Java OOM during Java's log migrationReleasedNicolas CHARLES2015-12-01Actions
Actions

Also available in: Atom PDF