Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Insufficient memory issue #4

Open
LouisChang opened this issue Jun 17, 2016 · 7 comments
Open

Insufficient memory issue #4

LouisChang opened this issue Jun 17, 2016 · 7 comments

Comments

@LouisChang
Copy link

LouisChang commented Jun 17, 2016 •
edited
Loading

I try to throw my data directly into Kafka but it seems like there are some bugs with that.

Now: 2015-07-12T14:02:31.332, Events:60000, Rate: 4401 epsJava HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000006c9000000, 830472192, 0) failed; error='Cannot allocate memory' (errno=12)

There is insufficient memory for the Java Runtime Environment to continue.
Native memory allocation (mmap) failed to map 830472192 bytes for committing reserved memory.
An error report file with more information is saved as:
/home/ubuntu/eventsim/hs_err_pid3267.log
ubuntu@ip-172-31-1-10:~/eventsim$ rm hs_err_pid3267.log
@bengecko
Copy link

Hey Sidi,

This probably means the JRE is configured to run with 8g memory but there
is not enough memory on the machine. How much RAM is on the machine you are
running? Also how is the JVM configured?

On Thursday, June 16, 2016, Sidi Chang [email protected] wrote:

I try to throw my data directly into Kafka but it seems like there are
some bugs with that.

Now: 2015-07-12T14:02:31.332, Events:60000, Rate: 4401 epsJava HotSpot(TM)
64-Bit Server VM warning: INFO: os::commit_memory(0x00000006c9000000,
830472192, 0) failed; error='Cannot allocate memory' (errno=12)

There is insufficient memory for the Java Runtime Environment to continue. Native
memory allocation (mmap) failed to map 830472192 bytes for committing
reserved memory. An error report file with more information is saved as:
/home/ubuntu/eventsim/hs_err_pid3267.log

ubuntu@ip-172-31-1-10:~/eventsim$ rm hs_err_pid3267.log

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#4, or mute the thread
https://github.com/notifications/unsubscribe/AIjLrpimyU78fTT1rLptJbChKP3W-QIpks5qMgGYgaJpZM4I3-M2
.

@LouisChang
Copy link
Author

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I have one master and three workers. All the four machines are Kafka broker, the master node is the Spark Streaming seed node and Cassandra node. I run the data generator and put the throughput into the second worker, but it will give me this bug. Do you have any idea on this?

@bengecko
Copy link

If you AWS instance is configured with 8g then you will want to up it to
16g if possible.

Run:

free -m

To see how much memory you have. Also run:

ps -ef | grep java

Then copy and paste output into this thread.

On Friday, June 17, 2016, Sidi Chang [email protected] wrote:

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I
have one master and three workers. All the four machines are Kafka broker,
the master node is the Spark Streaming seed node and Cassandra node. I run
the data generator and put the throughput into the second worker, but it
will give me this bug. Do you have any idea on this?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrvYlnGufASvF83eQL7TB7oFtrDw9ks5qMrHTgaJpZM4I3-M2
.

@LouisChang
Copy link
Author

LouisChang commented Jun 17, 2016 •
edited
Loading

Hi,
After run free -m the output is
total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

@bengecko
Copy link

OK so it definitely looks like there is not enough memory on the machine to run the java process in question. There is always a certain amount of memory used for the operating system so if the java process is asking for more memory than is available, you’ll see the error you mentioned. My conclusion is you need more RAM on the AWS instance. 16G should be fine. Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang [email protected] wrote:

Hi,
After run free -m the output is

     total       used       free     shared    buffers     cached

Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub #4 (comment), or mute the thread https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2.

@LouisChang
Copy link
Author

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang [email protected] wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp
/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp
/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp
/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper
localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp
/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>, or
mute the thread <
https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2
.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

@bengecko
Copy link

Sidi,

My pleasure I'm glad we got through it :)

On Friday, June 17, 2016, Sidi Chang [email protected] wrote:

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');
<javascript:_e(%7B%7D,'cvml','[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');');>> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');> wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp

/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg

root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties

ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp

/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf

ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true
-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false

-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp

/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/

ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus

ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer
--zookeeper
localhost:2181 --from-beginning --topic yyyyyy

ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp

/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>,
or
mute the thread <

https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
<
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2

.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrqAqJ-Ho61W_yNuYXAQ4F1O4qWqyks5qM1V9gaJpZM4I3-M2
.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@LouisChang @bengecko