Storm UI

Cluster Summary

VersionNimbus uptimeSupervisorsUsed slotsFree slotsTotal slotsExecutorsTasks
0.9.0.139d 10h 56m 17s6464064212212

Topology summary

NameIdStatusUptimeNum workersNum executorsNum tasks
NaverPostCollectorCrawlerTopology0NaverPostCollectorCrawlerTopology0-7-1714448910ACTIVE5d 10h 12m 57s133
IntegrateMassmediaCrawlerTopologyIntegrateMassmediaCrawlerTopology-4-1713944012ACTIVE11d 6h 27m 55s133
MajorCommunityCrawlerTopology1MajorCommunityCrawlerTopology1-5-1714008071ACTIVE10d 12h 40m 15s102121
NaverPostKeywordCrawlerTopology1NaverPostKeywordCrawlerTopology1-35-1702015590ACTIVE149d 7h 54m 57s133
NaverNewsCrawlerTopologyNaverNewsCrawlerTopology-14-1701057344ACTIVE160d 10h 5m 43s133
YouTubeCommentCrawlerTopology5YouTubeCommentCrawlerTopology5-9-1714450349ACTIVE5d 9h 48m 57s61919
DaumNewsCrawlerTopologyDaumNewsCrawlerTopology-8-1701057094ACTIVE160d 10h 9m 52s133
YouTubeHistoryCrawlerTopology5YouTubeHistoryCrawlerTopology5-106-1710136810ACTIVE55d 8h 1m 16s72222
ProxyIPCrawlerTopologyProxyIPCrawlerTopology-18-1701057592ACTIVE160d 10h 1m 34s144
CafeKeywordCrawlerTopology5CafeKeywordCrawlerTopology5-16-1714714081ACTIVE2d 8h 33m 26s177
NaverPostKeywordCrawlerTopology5NaverPostKeywordCrawlerTopology5-17-1701057547ACTIVE160d 10h 2m 20s133
BlogKeywordCrawlerTopology3BlogKeywordCrawlerTopology3-12-1714714033ACTIVE2d 8h 34m 14s31919
CafeKeywordCrawlerTopology3CafeKeywordCrawlerTopology3-15-1714714066ACTIVE2d 8h 33m 41s299
CafeKeywordCrawlerTopology1CafeKeywordCrawlerTopology1-14-1714714057ACTIVE2d 8h 33m 49s177
MajorCommunityCommentCrawlerTopologyMajorCommunityCommentCrawlerTopology-10-1701057174ACTIVE160d 10h 8m 32s31010
BlogKeywordCrawlerTopology1BlogKeywordCrawlerTopology1-11-1714714026ACTIVE2d 8h 34m 21s177
MajorCommunityCrawlerTopology2MajorCommunityCrawlerTopology2-17-1714725255ACTIVE2d 5h 27m 12s102121
BlogKeywordCrawlerTopology5BlogKeywordCrawlerTopology5-13-1714714037ACTIVE2d 8h 34m 9s21313
NaverNewsCommentCrawlerTopologyNaverNewsCommentCrawlerTopology-50-1704173683ACTIVE124d 8h 26m 44s41313
TwitterKeywordManualCrawlerTopology1TwitterKeywordManualCrawlerTopology1-8-1689213332ACTIVE297d 12h 5m 55s133
TwitterCollectorManualCrawlerTopology1TwitterCollectorManualCrawlerTopology1-8-1714449206ACTIVE5d 10h 8m 0s133
YouTubeCrawlerTopology1YouTubeCrawlerTopology1-10-1714462773ACTIVE5d 6h 21m 54s51616

Supervisor summary

IdHostUptimeSlotsUsed slots
450b5062-ea24-4a13-b8d4-9f1c6b5db3aasnscrawler024966d 7h 35m 11s11
373a1e19-18ae-41dc-9cdb-2cb2d2ee7496snscrawler02239d 10h 59m 10s11
dc417167-f79c-443c-8a25-fe605151e379snscrawler006164d 7h 51m 13s11
55036685-edb2-4eb2-b914-d93923a24594snscrawler034160d 11h 33m 8s11
83639c09-8726-4618-8516-b100240948b6snscrawler036160d 10h 29m 5s11
f98e68c4-8389-42b8-84a4-ac9f4bb2a9bdsnscrawler032160d 11h 49m 8s11
93d97d08-234c-4225-92df-c470d679db5bsnscrawler065160d 11h 25m 14s11
190ae23d-0c31-452d-96f6-3d6c8549592fsnscrawler097151d 9h 1m 8s11
3c857084-3544-41f0-9171-65706cc79ce2snscrawler059715d 12h 45m 13s11
71f56fdd-25f2-4229-8d4d-32ab885d3853snscrawler044198d 11h 33m 14s11
5c91c4d5-c1e2-4ad7-892e-3c7b04a929d4snscrawler068224d 15h 1m 11s11
2e4d05e1-e998-4f77-adc4-b6a4bc2a883dsnscrawler04233d 8h 43m 4s11
8305e0a4-a792-4b44-97ca-3e1c821a1eafsnscrawler056160d 10h 29m 13s11
83f602a0-be9d-4641-8bfe-3377ef5d95a9snscrawler035160d 11h 15m 12s11
d2499869-3862-416f-b080-b5e8e69af268snscrawler066532d 13h 27m 12s11
104210a1-a3db-4f68-80c3-331855f792d3snscrawler063870d 7h 37m 11s11
8a52e18e-d481-4a13-88c1-e6c17aec7d75snscrawler013160d 11h 41m 9s11
56682602-088f-499a-a266-a0848725e585snscrawler040376d 16h 9m 14s11
d858a5f7-f8f3-4bcf-b94f-811410fa245asnscrawler01575d 16h 43m 5s11
59583e3a-4dd4-44ed-a84b-61c176039b0esnscrawler064191d 14h 15m 10s11
c72c8088-3846-4a50-a830-5ac47d0a6fa6snscrawler031160d 10h 29m 1s11
75a0d199-0c88-4e3f-9791-01f61a48acd3snscrawler029299d 10h 29m 15s11
d8a51c1c-8895-489f-a5be-cfe38fbe4dc3snscrawler058160d 10h 29m 9s11
f1194d0b-4f71-4186-9161-c9c7ed76df4fsnscrawler019191d 14h 13m 9s11
ca9def75-c320-4680-b1cb-486972264665snscrawler048715d 12h 45m 11s11
1a7d95e7-2cf3-456e-bf2d-e16d69de408esnscrawler023160d 11h 33m 6s11
e83df2a0-b594-43dd-996c-6115196eda91snscrawler011160d 10h 29m 6s11
42efbd59-6f0b-43b1-84a5-12d2df03f2f4snscrawler01830d 7h 59m 14s11
7aa08022-7b34-458e-90bf-a9b67d778447snscrawler017853d 10h 37m 11s11
08970478-b810-4f78-b0c4-1b386c6ee7cfsnscrawler061160d 10h 27m 12s11
ca63082d-255a-4cf5-bd34-f8f86964fc2asnscrawler062160d 11h 23m 1s11
f0c39328-82ea-4a41-ac5c-21f69ad66b76snscrawler055297d 4h 53m 13s11
017432b6-07c1-41b2-bbc2-b4722a664c5csnscrawler039736d 12h 41m 9s11
deaddd9e-f932-4a4c-a75e-e1dd1db8813dsnscrawler06739d 10h 57m 12s11
cff45b72-c1c3-41eb-91e6-26fc56bbaf22snscrawler052542d 15h 19m 0s11
0dce88a5-d270-4056-9c19-50c099b2543asnscrawler038290d 14h 41m 10s11
eb83e274-d7b2-4921-a28d-1711842ae6d0snscrawler050283d 4h 57m 12s11
99b163f1-93e3-4725-8d35-d3e67a6519fcsnscrawler054160d 11h 29m 8s11
7c928134-bf01-471f-838c-e6e280ed5c06snscrawler041419d 12h 39m 11s11
ba4940f6-70d4-404f-aef1-a14e889dc4d7snscrawler026160d 11h 15m 5s11
ed0d7d40-9bcd-4e0c-a854-b07f12936004snscrawler047319d 13h 15m 14s11
63253f8d-853a-46b4-b7ec-e44572f0c7a9snscrawler009568d 1h 7m 10s11
1c12d2be-4e03-46e1-bc0a-af79623d4071snscrawler027130d 10h 51m 7s11
fcb271a2-ee70-4745-a098-9652c5b6c3e7snscrawler007790d 7h 49m 4s11
b1cfdfa6-f2c0-4c14-8510-110e0958598dsnscrawler043532d 13h 27m 12s11
14942697-6847-4ca5-b075-41f8149727c4snscrawler037532d 13h 27m 7s11
7a59e284-d2ac-4f01-ac6b-ff509e01bfddsnscrawler028527d 16h 33m 12s11
e251fef6-28c9-4125-a754-d77b2a121741snscrawler016874d 13h 7m 12s11
afe5cea8-3c67-4acf-996d-ae34179fd73bsnscrawler053123d 10h 59m 4s11
9c500cea-0254-4f9f-b9d9-5ecb26cb2db1snscrawler051160d 10h 29m 11s11
8dfef97c-2c1c-493d-9e12-1b9810e2e201snscrawler030773d 14h 16m 38s11
0fe6dad1-cbda-4236-a1e1-c7b652769137snscrawler049413d 16h 27m 7s11
7e63cf6b-4fd2-4c8d-9416-7b2128e6bf56snscrawler033224d 15h 1m 13s11
8f07e2c6-d662-42a3-b2bd-d36e16fae2d0snscrawler025123d 6h 21m 12s11
f34142e0-0fab-49ac-86d1-fb2e9984e29esnscrawler012163d 12h 2m 58s11
979d73c7-cb43-4d56-822d-919abf1a0812snscrawler010160d 11h 41m 10s11
36b3c5a9-daac-4924-9f17-80bf7ab9ec6esnscrawler014276d 8h 9m 14s11
de24ba5c-3614-47c7-b5a3-fbf55a81a233snscrawler045224d 15h 1m 12s11
3a3a95f1-d8c0-4a0d-95cf-b36f4a6493d8snscrawler020160d 10h 29m 12s11
6fae10f7-aaba-4674-9927-22432e00eaa2snscrawler02168d 2h 57m 11s11
e15a45d7-36d8-417e-aa0d-3cd0361b2257snscrawler0602d 8h 46m 58s11
3c81325a-04f1-41aa-b5ce-bcc14ec33ef6snscrawler046532d 13h 27m 12s11
721c1457-506a-4f83-9661-927fbc9bab7bsnscrawler069160d 12h 3m 29s11
45a19f2c-d90d-4ee7-a063-f897dcdf8e04snscrawler057160d 11h 29m 12s11

Nimbus Configuration

KeyValue
dev.zookeeper.path/tmp/dev-storm-zookeeper
topology.tick.tuple.freq.secs
topology.builtin.metrics.bucket.size.secs60
topology.fall.back.on.java.serializationtrue
topology.max.error.report.per.interval5
zmq.linger.millis5000
topology.skip.missing.kryo.registrationsfalse
storm.messaging.netty.client_worker_threads1
ui.childopts-Xmx768m
storm.zookeeper.session.timeout20000
nimbus.reassigntrue
topology.trident.batch.emit.interval.millis500
nimbus.monitor.freq.secs10
logviewer.childopts-Xmx128m
java.library.path/usr/local/lib:/opt/local/lib:/usr/lib
topology.executor.send.buffer.size1024
storm.local.dir/home/service/storm
storm.messaging.netty.buffer_size5242880
supervisor.worker.start.timeout.secs120
topology.enable.message.timeoutstrue
nimbus.cleanup.inbox.freq.secs600
nimbus.inbox.jar.expiration.secs3600
drpc.worker.threads64
topology.worker.shared.thread.pool.size4
nimbus.hostlocalhost
storm.messaging.netty.min_wait_ms100
storm.zookeeper.port2181
transactional.zookeeper.port
topology.executor.receive.buffer.size1024
transactional.zookeeper.servers
storm.zookeeper.root/storm
storm.zookeeper.retry.intervalceiling.millis30000
supervisor.enabletrue
storm.messaging.netty.server_worker_threads1
storm.zookeeper.servers["10.33.29.95" "10.34.30.168" "10.33.46.146"]
transactional.zookeeper.root/transactional
topology.acker.executors
topology.transfer.buffer.size1024
topology.worker.childopts
drpc.queue.size128
worker.childopts-Xmx768m
supervisor.heartbeat.frequency.secs5
topology.error.throttle.interval.secs10
zmq.hwm0
drpc.port3772
supervisor.monitor.frequency.secs3
drpc.childopts-Xmx768m
topology.receiver.buffer.size8
task.heartbeat.frequency.secs3
topology.tasks
storm.messaging.netty.max_retries30
topology.spout.wait.strategybacktype.storm.spout.SleepSpoutWaitStrategy
topology.max.spout.pending
storm.zookeeper.retry.interval5000
topology.sleep.spout.wait.strategy.time.ms1
nimbus.topology.validatorbacktype.storm.nimbus.DefaultTopologyValidator
supervisor.slots.ports[6700 6701 6702 6703]
topology.debugfalse
nimbus.task.launch.secs120
nimbus.supervisor.timeout.secs60
topology.message.timeout.secs30
task.refresh.poll.secs10
topology.workers1
supervisor.childopts-Xmx256m
nimbus.thrift.port6627
topology.stats.sample.rate0.05
worker.heartbeat.frequency.secs1
topology.tuple.serializerbacktype.storm.serialization.types.ListDelegateSerializer
topology.disruptor.wait.strategycom.lmax.disruptor.BlockingWaitStrategy
nimbus.task.timeout.secs30
storm.zookeeper.connection.timeout15000
topology.kryo.factorybacktype.storm.serialization.DefaultKryoFactory
drpc.invocations.port3773
logviewer.port8000
zmq.threads1
storm.zookeeper.retry.times5
storm.thrift.transportbacktype.storm.security.auth.SimpleTransportPlugin
topology.state.synchronization.timeout.secs60
supervisor.worker.timeout.secs30
nimbus.file.copy.expiration.secs600
storm.messaging.transportbacktype.storm.messaging.netty.Context
logviewer.appender.nameA1
storm.messaging.netty.max_wait_ms5000
drpc.request.timeout.secs600
storm.local.mode.zmqfalse
ui.port8080
nimbus.childopts-Xms1500m -Xmx1500m
storm.cluster.modedistributed
topology.optimizetrue
topology.max.task.parallelism