Storm UI

Cluster Summary

VersionNimbus uptimeSupervisorsUsed slotsFree slotsTotal slotsExecutorsTasks
0.9.0.129d 16h 53m 53s6463164209209

Topology summary

NameIdStatusUptimeNum workersNum executorsNum tasks
MajorCommunityCrawlerTopology2MajorCommunityCrawlerTopology2-6-1714008082ACTIVE18h 37m 41s102121
IntegrateMassmediaCrawlerTopologyIntegrateMassmediaCrawlerTopology-4-1713944012ACTIVE1d 12h 25m 31s133
MajorCommunityCrawlerTopology1MajorCommunityCrawlerTopology1-5-1714008071ACTIVE18h 37m 51s102121
BlogKeywordCrawlerTopology1BlogKeywordCrawlerTopology1-2-1701056813ACTIVE150d 16h 12m 10s177
NaverPostKeywordCrawlerTopology1NaverPostKeywordCrawlerTopology1-35-1702015590ACTIVE139d 13h 52m 33s133
BlogKeywordCrawlerTopology3BlogKeywordCrawlerTopology3-3-1701056818ACTIVE150d 16h 12m 5s31919
NaverNewsCrawlerTopologyNaverNewsCrawlerTopology-14-1701057344ACTIVE150d 16h 3m 19s133
DaumNewsCrawlerTopologyDaumNewsCrawlerTopology-8-1701057094ACTIVE150d 16h 7m 28s133
CafeKeywordCrawlerTopology3CafeKeywordCrawlerTopology3-70-1706238384ACTIVE90d 16h 52m 38s299
YouTubeHistoryCrawlerTopology5YouTubeHistoryCrawlerTopology5-106-1710136810ACTIVE45d 13h 58m 52s72222
ProxyIPCrawlerTopologyProxyIPCrawlerTopology-18-1701057592ACTIVE150d 15h 59m 10s144
YouTubeCommentCrawlerTopology5YouTubeCommentCrawlerTopology5-108-1710229284ACTIVE44d 12h 17m 39s51616
CafeKeywordCrawlerTopology5CafeKeywordCrawlerTopology5-71-1706238389ACTIVE90d 16h 52m 34s177
NaverPostKeywordCrawlerTopology5NaverPostKeywordCrawlerTopology5-17-1701057547ACTIVE150d 15h 59m 56s133
YouTubeCrawlerTopology1YouTubeCrawlerTopology1-109-1710305569ACTIVE43d 15h 6m 14s51616
NaverPostCollectorCrawlerTopology0NaverPostCollectorCrawlerTopology0-15-1701057529ACTIVE150d 16h 0m 14s133
MajorCommunityCommentCrawlerTopologyMajorCommunityCommentCrawlerTopology-10-1701057174ACTIVE150d 16h 6m 8s31010
TwitterCollectorManualCrawlerTopology1TwitterCollectorManualCrawlerTopology1-7-1689213320ACTIVE287d 18h 3m 42s133
NaverNewsCommentCrawlerTopologyNaverNewsCommentCrawlerTopology-50-1704173683ACTIVE114d 14h 24m 20s41313
BlogKeywordCrawlerTopology5BlogKeywordCrawlerTopology5-4-1701056823ACTIVE150d 16h 12m 0s21313
TwitterKeywordManualCrawlerTopology1TwitterKeywordManualCrawlerTopology1-8-1689213332ACTIVE287d 18h 3m 31s133
CafeKeywordCrawlerTopology1CafeKeywordCrawlerTopology1-69-1706238375ACTIVE90d 16h 52m 48s177

Supervisor summary

IdHostUptimeSlotsUsed slots
450b5062-ea24-4a13-b8d4-9f1c6b5db3aasnscrawler024956d 13h 32m 48s11
373a1e19-18ae-41dc-9cdb-2cb2d2ee7496snscrawler02229d 16h 56m 45s11
dc417167-f79c-443c-8a25-fe605151e379snscrawler006154d 13h 48m 45s11
55036685-edb2-4eb2-b914-d93923a24594snscrawler034150d 17h 30m 44s11
83639c09-8726-4618-8516-b100240948b6snscrawler036150d 16h 26m 42s11
f98e68c4-8389-42b8-84a4-ac9f4bb2a9bdsnscrawler032150d 17h 46m 46s11
93d97d08-234c-4225-92df-c470d679db5bsnscrawler065150d 17h 22m 45s11
190ae23d-0c31-452d-96f6-3d6c8549592fsnscrawler097141d 14h 58m 45s11
3c857084-3544-41f0-9171-65706cc79ce2snscrawler059705d 18h 42m 49s11
71f56fdd-25f2-4229-8d4d-32ab885d3853snscrawler044188d 17h 30m 48s11
5c91c4d5-c1e2-4ad7-892e-3c7b04a929d4snscrawler068214d 20h 58m 47s11
2e4d05e1-e998-4f77-adc4-b6a4bc2a883dsnscrawler04223d 14h 40m 40s11
8305e0a4-a792-4b44-97ca-3e1c821a1eafsnscrawler056150d 16h 26m 47s11
83f602a0-be9d-4641-8bfe-3377ef5d95a9snscrawler035150d 17h 12m 47s11
d2499869-3862-416f-b080-b5e8e69af268snscrawler066522d 19h 24m 49s11
104210a1-a3db-4f68-80c3-331855f792d3snscrawler063860d 13h 34m 50s11
8a52e18e-d481-4a13-88c1-e6c17aec7d75snscrawler013150d 17h 38m 46s11
56682602-088f-499a-a266-a0848725e585snscrawler040366d 22h 6m 48s11
d858a5f7-f8f3-4bcf-b94f-811410fa245asnscrawler01565d 22h 40m 45s11
59583e3a-4dd4-44ed-a84b-61c176039b0esnscrawler064181d 20h 12m 47s11
c72c8088-3846-4a50-a830-5ac47d0a6fa6snscrawler031150d 16h 26m 39s11
75a0d199-0c88-4e3f-9791-01f61a48acd3snscrawler029289d 16h 26m 50s11
d8a51c1c-8895-489f-a5be-cfe38fbe4dc3snscrawler058150d 16h 26m 44s11
f1194d0b-4f71-4186-9161-c9c7ed76df4fsnscrawler019181d 20h 10m 47s11
ca9def75-c320-4680-b1cb-486972264665snscrawler048705d 18h 42m 51s11
1a7d95e7-2cf3-456e-bf2d-e16d69de408esnscrawler023150d 17h 30m 44s11
91438cf6-988d-4a98-aa4e-b0e3b41b6befsnscrawler060556d 17h 16m 50s11
e83df2a0-b594-43dd-996c-6115196eda91snscrawler011150d 16h 26m 43s11
42efbd59-6f0b-43b1-84a5-12d2df03f2f4snscrawler01820d 13h 56m 46s11
7aa08022-7b34-458e-90bf-a9b67d778447snscrawler017843d 16h 34m 46s11
08970478-b810-4f78-b0c4-1b386c6ee7cfsnscrawler061150d 16h 24m 45s11
ca63082d-255a-4cf5-bd34-f8f86964fc2asnscrawler062150d 17h 20m 41s11
f0c39328-82ea-4a41-ac5c-21f69ad66b76snscrawler055287d 10h 50m 46s11
017432b6-07c1-41b2-bbc2-b4722a664c5csnscrawler039726d 18h 38m 47s11
deaddd9e-f932-4a4c-a75e-e1dd1db8813dsnscrawler06729d 16h 54m 46s11
cff45b72-c1c3-41eb-91e6-26fc56bbaf22snscrawler052532d 21h 16m 37s11
0dce88a5-d270-4056-9c19-50c099b2543asnscrawler038280d 20h 38m 45s11
eb83e274-d7b2-4921-a28d-1711842ae6d0snscrawler050273d 10h 54m 48s11
99b163f1-93e3-4725-8d35-d3e67a6519fcsnscrawler054150d 17h 26m 44s11
7c928134-bf01-471f-838c-e6e280ed5c06snscrawler041409d 18h 36m 45s11
ba4940f6-70d4-404f-aef1-a14e889dc4d7snscrawler026150d 17h 12m 43s11
ed0d7d40-9bcd-4e0c-a854-b07f12936004snscrawler047309d 19h 12m 50s11
63253f8d-853a-46b4-b7ec-e44572f0c7a9snscrawler009558d 7h 4m 45s11
1c12d2be-4e03-46e1-bc0a-af79623d4071snscrawler027120d 16h 48m 45s11
fcb271a2-ee70-4745-a098-9652c5b6c3e7snscrawler007780d 13h 46m 42s11
b1cfdfa6-f2c0-4c14-8510-110e0958598dsnscrawler043522d 19h 24m 47s11
14942697-6847-4ca5-b075-41f8149727c4snscrawler037522d 19h 24m 44s11
7a59e284-d2ac-4f01-ac6b-ff509e01bfddsnscrawler028517d 22h 30m 49s11
e251fef6-28c9-4125-a754-d77b2a121741snscrawler016864d 19h 4m 48s11
afe5cea8-3c67-4acf-996d-ae34179fd73bsnscrawler053113d 16h 56m 43s11
9c500cea-0254-4f9f-b9d9-5ecb26cb2db1snscrawler051150d 16h 26m 47s11
8dfef97c-2c1c-493d-9e12-1b9810e2e201snscrawler030763d 20h 14m 11s11
0fe6dad1-cbda-4236-a1e1-c7b652769137snscrawler049403d 22h 24m 43s11
7e63cf6b-4fd2-4c8d-9416-7b2128e6bf56snscrawler033214d 20h 58m 47s11
8f07e2c6-d662-42a3-b2bd-d36e16fae2d0snscrawler025113d 12h 18m 46s11
f34142e0-0fab-49ac-86d1-fb2e9984e29esnscrawler012153d 18h 0m 36s11
979d73c7-cb43-4d56-822d-919abf1a0812snscrawler010150d 17h 38m 46s11
36b3c5a9-daac-4924-9f17-80bf7ab9ec6esnscrawler014266d 14h 6m 45s11
de24ba5c-3614-47c7-b5a3-fbf55a81a233snscrawler045214d 20h 58m 47s11
3a3a95f1-d8c0-4a0d-95cf-b36f4a6493d8snscrawler020150d 16h 26m 49s11
6fae10f7-aaba-4674-9927-22432e00eaa2snscrawler02158d 8h 54m 48s11
3c81325a-04f1-41aa-b5ce-bcc14ec33ef6snscrawler046522d 19h 24m 47s11
721c1457-506a-4f83-9661-927fbc9bab7bsnscrawler069150d 18h 1m 6s10
45a19f2c-d90d-4ee7-a063-f897dcdf8e04snscrawler057150d 17h 26m 46s11

Nimbus Configuration

KeyValue
dev.zookeeper.path/tmp/dev-storm-zookeeper
topology.tick.tuple.freq.secs
topology.builtin.metrics.bucket.size.secs60
topology.fall.back.on.java.serializationtrue
topology.max.error.report.per.interval5
zmq.linger.millis5000
topology.skip.missing.kryo.registrationsfalse
storm.messaging.netty.client_worker_threads1
ui.childopts-Xmx768m
storm.zookeeper.session.timeout20000
nimbus.reassigntrue
topology.trident.batch.emit.interval.millis500
nimbus.monitor.freq.secs10
logviewer.childopts-Xmx128m
java.library.path/usr/local/lib:/opt/local/lib:/usr/lib
topology.executor.send.buffer.size1024
storm.local.dir/home/service/storm
storm.messaging.netty.buffer_size5242880
supervisor.worker.start.timeout.secs120
topology.enable.message.timeoutstrue
nimbus.cleanup.inbox.freq.secs600
nimbus.inbox.jar.expiration.secs3600
drpc.worker.threads64
topology.worker.shared.thread.pool.size4
nimbus.hostlocalhost
storm.messaging.netty.min_wait_ms100
storm.zookeeper.port2181
transactional.zookeeper.port
topology.executor.receive.buffer.size1024
transactional.zookeeper.servers
storm.zookeeper.root/storm
storm.zookeeper.retry.intervalceiling.millis30000
supervisor.enabletrue
storm.messaging.netty.server_worker_threads1
storm.zookeeper.servers["10.33.29.95" "10.34.30.168" "10.33.46.146"]
transactional.zookeeper.root/transactional
topology.acker.executors
topology.transfer.buffer.size1024
topology.worker.childopts
drpc.queue.size128
worker.childopts-Xmx768m
supervisor.heartbeat.frequency.secs5
topology.error.throttle.interval.secs10
zmq.hwm0
drpc.port3772
supervisor.monitor.frequency.secs3
drpc.childopts-Xmx768m
topology.receiver.buffer.size8
task.heartbeat.frequency.secs3
topology.tasks
storm.messaging.netty.max_retries30
topology.spout.wait.strategybacktype.storm.spout.SleepSpoutWaitStrategy
topology.max.spout.pending
storm.zookeeper.retry.interval5000
topology.sleep.spout.wait.strategy.time.ms1
nimbus.topology.validatorbacktype.storm.nimbus.DefaultTopologyValidator
supervisor.slots.ports[6700 6701 6702 6703]
topology.debugfalse
nimbus.task.launch.secs120
nimbus.supervisor.timeout.secs60
topology.message.timeout.secs30
task.refresh.poll.secs10
topology.workers1
supervisor.childopts-Xmx256m
nimbus.thrift.port6627
topology.stats.sample.rate0.05
worker.heartbeat.frequency.secs1
topology.tuple.serializerbacktype.storm.serialization.types.ListDelegateSerializer
topology.disruptor.wait.strategycom.lmax.disruptor.BlockingWaitStrategy
nimbus.task.timeout.secs30
storm.zookeeper.connection.timeout15000
topology.kryo.factorybacktype.storm.serialization.DefaultKryoFactory
drpc.invocations.port3773
logviewer.port8000
zmq.threads1
storm.zookeeper.retry.times5
storm.thrift.transportbacktype.storm.security.auth.SimpleTransportPlugin
topology.state.synchronization.timeout.secs60
supervisor.worker.timeout.secs30
nimbus.file.copy.expiration.secs600
storm.messaging.transportbacktype.storm.messaging.netty.Context
logviewer.appender.nameA1
storm.messaging.netty.max_wait_ms5000
drpc.request.timeout.secs600
storm.local.mode.zmqfalse
ui.port8080
nimbus.childopts-Xms1500m -Xmx1500m
storm.cluster.modedistributed
topology.optimizetrue
topology.max.task.parallelism