服务器生产环境数据同步报错kettle 导致调度无法正常启动,报错日志如下:
见第二行信息显示:由于内存不足导致,系统无法分配足够内存让调度运行。
解决办法:
可以调节 -XX:MaxPermSize=4096m" 参数,调大点。ps:还有别的参数 可以自行百度一下。如有错误,还请大家指出!谢谢~~
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (malloc) failed to allocate 2863661056 bytes for committing reserved memory.
# Possible reasons:
# The system is out of physical RAM or swap space
# In 32 bit mode, the process size limit was hit
# Possible solutions:
# Reduce memory load on the system
# Increase physical memory or swap space
# Check if swap backing store is full
# Use 64 bit Java on a 64 bit OS
# Decrease Java heap size (-Xmx/-Xms)
# Decrease number of Java threads
# Decrease Java thread stack sizes (-Xss)
# Set larger code cache with -XX:ReservedCodeCacheSize=
# This output file may be truncated or incomplete.
#
# Out of Memory Error (os_linux.cpp:2756), pid=15334, tid=140192837007104
#
# JRE version: (7.0_80-b15) (build )
# Java VM: Java HotSpot(TM) 64-Bit Server VM (24.80-b11 mixed mode linux-amd64 compressed oops)
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#--------------- T H R E A D ---------------Current thread (0x00007f8128009000): JavaThread "Unknown thread" [_thread_in_vm, id=15335, stack(0x00007f81302ff000,0x00007f8130400000)]Stack: [0x00007f81302ff000,0x00007f8130400000], sp=0x00007f81303fe1d0, free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x9a320a] VMError::report_and_die()+0x2ea
V [libjvm.so+0x498d3b] report_vm_out_of_memory(char const*, int, unsigned long, char const*)+0x9b
V [libjvm.so+0x82191e] os::Linux::commit_memory_impl(char*, unsigned long, bool)+0xfe
V [libjvm.so+0x821e69] os::pd_commit_memory(char*, unsigned long, unsigned long, bool)+0x29
V [libjvm.so+0x81bb6a] os::commit_memory(char*, unsigned long, unsigned long, bool)+0x2a
V [libjvm.so+0x88d623] PSVirtualSpace::expand_by(unsigned long)+0x53
V [libjvm.so+0x87c293] PSOldGen::initialize(ReservedSpace, unsigned long, char const*, int)+0x103
V [libjvm.so+0x29ace3] AdjoiningGenerations::AdjoiningGenerations(ReservedSpace, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long)+0x3e3
V [libjvm.so+0x843215] ParallelScavengeHeap::initialize()+0x4d5
V [libjvm.so+0x97509a] Universe::initialize_heap()+0xca
V [libjvm.so+0x976269] universe_init()+0x79
V [libjvm.so+0x5b2f25] init_globals()+0x65
V [libjvm.so+0x95db4d] Threads::create_vm(JavaVMInitArgs*, bool*)+0x1ed
V [libjvm.so+0x63b2e4] JNI_CreateJavaVM+0x74
C [libjli.so+0x2f8e] JavaMain+0x9e--------------- P R O C E S S ---------------Java Threads: ( => current thread )Other Threads:=>0x00007f8128009000 (exited) JavaThread "Unknown thread" [_thread_in_vm, id=15335, stack(0x00007f81302ff000,0x00007f8130400000)]VM state:not at safepoint (not fully initialized)VM Mutex/Monitor currently owned by a thread: NoneGC Heap History (0 events):
No eventsDeoptimization events (0 events):
No eventsInternal exceptions (0 events):
No eventsEvents (0 events):
No eventsDynamic libraries:
00400000-00401000 r-xp 00000000 fc:01 3113062 /app/jdk1.7.0_80/bin/java
00600000-00601000 rw-p 00000000 fc:01 3113062 /app/jdk1.7.0_80/bin/java
01930000-01951000 rw-p 00000000 00:00 0 [heap]
6bff80000-6fff80000 rw-p 00000000 00:00 0
7aaa80000-800000000 rw-p 00000000 00:00 0
7f8125000000-7f8125270000 rwxp 00000000 00:00 0
7f8125270000-7f8128025000 rw-p 00000000 00:00 0
7f8128025000-7f812c000000 ---p 00000000 00:00 0
7f812d076000-7f812d2bf000 rw-p 00000000 00:00 0
7f812d2bf000-7f812da14000 rw-p 00000000 00:00 0
7f812da14000-7f812dcc0000 rw-p 00000000 00:00 0
7f812dcc0000-7f812dcd7000 r-xp 00000000 fc:01 3080254 /app/jdk1.7.0_80/jre/lib/amd64/libzip.so
7f812dcd7000-7f812ded7000 ---p 00017000 fc:01 3080254 /app/jdk1.7.0_80/jre/lib/amd64/libzip.so
7f812ded7000-7f812ded8000 rw-p 00017000 fc:01 3080254 /app/jdk1.7.0_80/jre/lib/amd64/libzip.so
7f812ded8000-7f812dee5000 r-xp 00000000 fc:01 286748 /lib64/libnss_files-2.12.so
7f812dee5000-7f812e0e4000 ---p 0000d000 fc:01 286748 /lib64/libnss_files-2.12.so
7f812e0e4000-7f812e0e5000 r--p 0000c000 fc:01 286748 /lib64/libnss_files-2.12.so
7f812e0e5000-7f812e0e6000 rw-p 0000d000 fc:01 286748 /lib64/libnss_files-2.12.so
7f812e0e6000-7f812e10f000 r-xp 00000000 fc:01 3080222 /app/jdk1.7.0_80/jre/lib/amd64/libjava.so
7f812e10f000-7f812e30f000 ---p 00029000 fc:01 3080222 /app/jdk1.7.0_80/jre/lib/amd64/libjava.so
7f812e30f000-7f812e311000 rw-p 00029000 fc:01 3080222 /app/jdk1.7.0_80/jre/lib/amd64/libjava.so
7f812e311000-7f812e31e000 r-xp 00000000 fc:01 3080247 /app/jdk1.7.0_80/jre/lib/amd64/libverify.so
7f812e31e000-7f812e51d000 ---p 0000d000 fc:01 3080247 /app/jdk1.7.0_80/jre/lib/amd64/libverify.so
7f812e51d000-7f812e51f000 rw-p 0000c000 fc:01 3080247 /app/jdk1.7.0_80/jre/lib/amd64/libverify.so
7f812e51f000-7f812e526000 r-xp 00000000 fc:01 287115 /lib64/librt-2.12.so
7f812e526000-7f812e725000 ---p 00007000 fc:01 287115 /lib64/librt-2.12.so
7f812e725000-7f812e726000 r--p 00006000 fc:01 287115 /lib64/librt-2.12.so
7f812e726000-7f812e727000 rw-p 00007000 fc:01 287115 /lib64/librt-2.12.so
7f812e727000-7f812e7aa000 r-xp 00000000 fc:01 287110 /lib64/libm-2.12.so
7f812e7aa000-7f812e9a9000 ---p 00083000 fc:01 287110 /lib64/libm-2.12.so
7f812e9a9000-7f812e9aa000 r--p 00082000 fc:01 287110 /lib64/libm-2.12.so
7f812e9aa000-7f812e9ab000 rw-p 00083000 fc:01 287110 /lib64/libm-2.12.so
7f812e9ab000-7f812f521000 r-xp 00000000 fc:01 3088393 /app/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
7f812f521000-7f812f720000 ---p 00b76000 fc:01 3088393 /app/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
7f812f720000-7f812f7e4000 rw-p 00b75000 fc:01 3088393 /app/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
7f812f7e4000-7f812f825000 rw-p 00000000 00:00 0
7f812f825000-7f812f9af000 r-xp 00000000 fc:01 286732 /lib64/libc-2.12.so
7f812f9af000-7f812fbaf000 ---p 0018a000 fc:01 286732 /lib64/libc-2.12.so
7f812fbaf000-7f812fbb3000 r--p 0018a000 fc:01 286732 /lib64/libc-2.12.so
7f812fbb3000-7f812fbb5000 rw-p 0018e000 fc:01 286732 /lib64/libc-2.12.so
7f812fbb5000-7f812fbb9000 rw-p 00000000 00:00 0
7f812fbb9000-7f812fbbb000 r-xp 00000000 fc:01 287109 /lib64/libdl-2.12.so
7f812fbbb000-7f812fdbb000 ---p 00002000 fc:01 287109 /lib64/libdl-2.12.so
7f812fdbb000-7f812fdbc000 r--p 00002000 fc:01 287109 /lib64/libdl-2.12.so
7f812fdbc000-7f812fdbd000 rw-p 00003000 fc:01 287109 /lib64/libdl-2.12.so
7f812fdbd000-7f812fdd2000 r-xp 00000000 fc:01 3096598 /app/jdk1.7.0_80/lib/amd64/jli/libjli.so
7f812fdd2000-7f812ffd1000 ---p 00015000 fc:01 3096598 /app/jdk1.7.0_80/lib/amd64/jli/libjli.so
7f812ffd1000-7f812ffd2000 rw-p 00014000 fc:01 3096598 /app/jdk1.7.0_80/lib/amd64/jli/libjli.so
7f812ffd2000-7f812ffe9000 r-xp 00000000 fc:01 286756 /lib64/libpthread-2.12.so
7f812ffe9000-7f81301e9000 ---p 00017000 fc:01 286756 /lib64/libpthread-2.12.so
7f81301e9000-7f81301ea000 r--p 00017000 fc:01 286756 /lib64/libpthread-2.12.so
7f81301ea000-7f81301eb000 rw-p 00018000 fc:01 286756 /lib64/libpthread-2.12.so
7f81301eb000-7f81301ef000 rw-p 00000000 00:00 0
7f81301ef000-7f813020f000 r-xp 00000000 fc:01 287119 /lib64/ld-2.12.so
7f813023d000-7f8130249000 rw-p 00000000 00:00 0
7f8130249000-7f81302ff000 rw-p 00000000 00:00 0
7f81302ff000-7f8130302000 ---p 00000000 00:00 0
7f8130302000-7f8130404000 rw-p 00000000 00:00 0
7f8130404000-7f813040c000 rw-s 00000000 fc:01 262161 /tmp/hsperfdata_kettle/15334
7f813040c000-7f813040d000 rw-p 00000000 00:00 0
7f813040d000-7f813040e000 r--p 00000000 00:00 0
7f813040e000-7f813040f000 rw-p 00000000 00:00 0
7f813040f000-7f8130410000 r--p 00020000 fc:01 287119 /lib64/ld-2.12.so
7f8130410000-7f8130411000 rw-p 00021000 fc:01 287119 /lib64/ld-2.12.so
7f8130411000-7f8130412000 rw-p 00000000 00:00 0
7fff1d9de000-7fff1daf3000 rw-p 00000000 00:00 0 [stack]
7fff1dbb1000-7fff1dbb2000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]VM Arguments:
jvm_args: -Xms4096m -Xmx4096m -XX:MaxPermSize=1024m -Djava.library.path=/app/kettle/data-integration/../libswt/linux/x86_64/ -DKETTLE_HOME= -DKETTLE_REPOSITORY= -Duser.timezone=GMT+8 -DKETTLE_USER= -DKETTLE_PASSWORD= -DKETTLE_PLUGIN_PACKAGES= -DKETTLE_LOG_SIZE_LIMIT= -DKETTLE_JNDI_ROOT= -Dorg.eclipse.swt.internal.gtk.cairoGraphics=false
java_command: /app/kettle/data-integration/launcher/pentaho-application-launcher-5.3.0.0-213.jar -lib /app/kettle/data-integration/../libswt/linux/x86_64/ -main org.pentaho.di.kitchen.Kitchen -rep=ods_ecif -user=admin -pass=admin -file=/ecif_core_loop.kjb -job=ecif_core_loop -level=Basic
Launcher Type: SUN_STANDARDEnvironment Variables:
JAVA_HOME=/app/jdk1.7.0_80
CLASSPATH=/app/jdk1.7.0_80/lib:/lib:/app/jdk1.7.0_80
PATH=/app/jdk1.7.0_80/bin:/app/jdk1.7.0_80/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/kettle/bin
LD_LIBRARY_PATH=:
SHELL=/bin/bashSignal Handlers:
SIGSEGV: [libjvm.so+0x9a3b20], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGBUS: [libjvm.so+0x9a3b20], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x81e740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x81e740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGXFSZ: [libjvm.so+0x81e740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGILL: [libjvm.so+0x81e740], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x81ffb0], sa_mask[0]=0x00000000, sa_flags=0x10000004
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000--------------- S Y S T E M ---------------OS:CentOS release 6.5 (Final)uname:Linux 2.6.32-696.6.3.el6.x86_64 #1 SMP Wed Jul 12 14:17:22 UTC 2017 x86_64
libc:glibc 2.12 NPTL 2.12
rlimit: STACK 10240k, CORE 0k, NPROC 63702, NOFILE 1000000, AS infinity
load average:0.00 0.00 0.00/proc/meminfo:
MemTotal: 16332008 kB
MemFree: 919332 kB
Buffers: 280968 kB
Cached: 686880 kB
SwapCached: 0 kB
Active: 14737296 kB
Inactive: 416644 kB
Active(anon): 14185772 kB
Inactive(anon): 180 kB
Active(file): 551524 kB
Inactive(file): 416464 kB
Unevictable: 0 kB
Mlocked: 0 kB
SwapTotal: 0 kB
SwapFree: 0 kB
Dirty: 148 kB
Writeback: 0 kB
AnonPages: 14183456 kB
Mapped: 44500 kB
Shmem: 188 kB
Slab: 84812 kB
SReclaimable: 60680 kB
SUnreclaim: 24132 kB
KernelStack: 4640 kB
PageTables: 33444 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 8166004 kB
Committed_AS: 20943180 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 40224 kB
VmallocChunk: 34359694832 kB
HardwareCorrupted: 0 kB
AnonHugePages: 14063616 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 8184 kB
DirectMap2M: 16769024 kBCPU:total 4 (12 cores per cpu, 1 threads per core) family 6 model 63 stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, tsc/proc/cpuinfo:
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 63
model name : Intel(R) Xeon(R) CPU E5-26xx v3
stepping : 2
microcode : 1
cpu MHz : 2299.998
cache size : 4096 KB
physical id : 0
siblings : 1
core id : 0
cpu cores : 1
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc rep_good unfair_spinlock pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm xsaveopt bmi1 avx2 bmi2
bogomips : 4599.99
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 63
model name : Intel(R) Xeon(R) CPU E5-26xx v3
stepping : 2
microcode : 1
cpu MHz : 2299.998
cache size : 4096 KB
physical id : 1
siblings : 1
core id : 0
cpu cores : 1
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc rep_good unfair_spinlock pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm xsaveopt bmi1 avx2 bmi2
bogomips : 4599.99
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 63
model name : Intel(R) Xeon(R) CPU E5-26xx v3
stepping : 2
microcode : 1
cpu MHz : 2299.998
cache size : 4096 KB
physical id : 2
siblings : 1
core id : 0
cpu cores : 1
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc rep_good unfair_spinlock pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm xsaveopt bmi1 avx2 bmi2
bogomips : 4599.99
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 63
model name : Intel(R) Xeon(R) CPU E5-26xx v3
stepping : 2
microcode : 1
cpu MHz : 2299.998
cache size : 4096 KB
physical id : 3
siblings : 1
core id : 0
cpu cores : 1
apicid : 3
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 13
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc rep_good unfair_spinlock pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm xsaveopt bmi1 avx2 bmi2
bogomips : 4599.99
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management:Memory: 4k page, physical 16332008k(919332k free), swap 0k(0k free)vm_info: Java HotSpot(TM) 64-Bit Server VM (24.80-b11) for linux-amd64 JRE (1.7.0_80-b15), built on Apr 10 2015 19:53:14 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8)time: Thu Aug 20 09:57:54 2020
elapsed time: 0 seconds