Version | Nimbus uptime | Supervisors | Used slots | Free slots | Total slots | Executors | Tasks |
---|---|---|---|---|---|---|---|
0.9.0.1 | 39d 10h 56m 17s | 64 | 64 | 0 | 64 | 212 | 212 |
Name | Id | Status | Uptime | Num workers | Num executors | Num tasks |
---|---|---|---|---|---|---|
NaverPostCollectorCrawlerTopology0 | NaverPostCollectorCrawlerTopology0-7-1714448910 | ACTIVE | 5d 10h 12m 57s | 1 | 3 | 3 |
IntegrateMassmediaCrawlerTopology | IntegrateMassmediaCrawlerTopology-4-1713944012 | ACTIVE | 11d 6h 27m 55s | 1 | 3 | 3 |
MajorCommunityCrawlerTopology1 | MajorCommunityCrawlerTopology1-5-1714008071 | ACTIVE | 10d 12h 40m 15s | 10 | 21 | 21 |
NaverPostKeywordCrawlerTopology1 | NaverPostKeywordCrawlerTopology1-35-1702015590 | ACTIVE | 149d 7h 54m 57s | 1 | 3 | 3 |
NaverNewsCrawlerTopology | NaverNewsCrawlerTopology-14-1701057344 | ACTIVE | 160d 10h 5m 43s | 1 | 3 | 3 |
YouTubeCommentCrawlerTopology5 | YouTubeCommentCrawlerTopology5-9-1714450349 | ACTIVE | 5d 9h 48m 57s | 6 | 19 | 19 |
DaumNewsCrawlerTopology | DaumNewsCrawlerTopology-8-1701057094 | ACTIVE | 160d 10h 9m 52s | 1 | 3 | 3 |
YouTubeHistoryCrawlerTopology5 | YouTubeHistoryCrawlerTopology5-106-1710136810 | ACTIVE | 55d 8h 1m 16s | 7 | 22 | 22 |
ProxyIPCrawlerTopology | ProxyIPCrawlerTopology-18-1701057592 | ACTIVE | 160d 10h 1m 34s | 1 | 4 | 4 |
CafeKeywordCrawlerTopology5 | CafeKeywordCrawlerTopology5-16-1714714081 | ACTIVE | 2d 8h 33m 26s | 1 | 7 | 7 |
NaverPostKeywordCrawlerTopology5 | NaverPostKeywordCrawlerTopology5-17-1701057547 | ACTIVE | 160d 10h 2m 20s | 1 | 3 | 3 |
BlogKeywordCrawlerTopology3 | BlogKeywordCrawlerTopology3-12-1714714033 | ACTIVE | 2d 8h 34m 14s | 3 | 19 | 19 |
CafeKeywordCrawlerTopology3 | CafeKeywordCrawlerTopology3-15-1714714066 | ACTIVE | 2d 8h 33m 41s | 2 | 9 | 9 |
CafeKeywordCrawlerTopology1 | CafeKeywordCrawlerTopology1-14-1714714057 | ACTIVE | 2d 8h 33m 49s | 1 | 7 | 7 |
MajorCommunityCommentCrawlerTopology | MajorCommunityCommentCrawlerTopology-10-1701057174 | ACTIVE | 160d 10h 8m 32s | 3 | 10 | 10 |
BlogKeywordCrawlerTopology1 | BlogKeywordCrawlerTopology1-11-1714714026 | ACTIVE | 2d 8h 34m 21s | 1 | 7 | 7 |
MajorCommunityCrawlerTopology2 | MajorCommunityCrawlerTopology2-17-1714725255 | ACTIVE | 2d 5h 27m 12s | 10 | 21 | 21 |
BlogKeywordCrawlerTopology5 | BlogKeywordCrawlerTopology5-13-1714714037 | ACTIVE | 2d 8h 34m 9s | 2 | 13 | 13 |
NaverNewsCommentCrawlerTopology | NaverNewsCommentCrawlerTopology-50-1704173683 | ACTIVE | 124d 8h 26m 44s | 4 | 13 | 13 |
TwitterKeywordManualCrawlerTopology1 | TwitterKeywordManualCrawlerTopology1-8-1689213332 | ACTIVE | 297d 12h 5m 55s | 1 | 3 | 3 |
TwitterCollectorManualCrawlerTopology1 | TwitterCollectorManualCrawlerTopology1-8-1714449206 | ACTIVE | 5d 10h 8m 0s | 1 | 3 | 3 |
YouTubeCrawlerTopology1 | YouTubeCrawlerTopology1-10-1714462773 | ACTIVE | 5d 6h 21m 54s | 5 | 16 | 16 |
Id | Host | Uptime | Slots | Used slots |
---|---|---|---|---|
450b5062-ea24-4a13-b8d4-9f1c6b5db3aa | snscrawler024 | 966d 7h 35m 11s | 1 | 1 |
373a1e19-18ae-41dc-9cdb-2cb2d2ee7496 | snscrawler022 | 39d 10h 59m 10s | 1 | 1 |
dc417167-f79c-443c-8a25-fe605151e379 | snscrawler006 | 164d 7h 51m 13s | 1 | 1 |
55036685-edb2-4eb2-b914-d93923a24594 | snscrawler034 | 160d 11h 33m 8s | 1 | 1 |
83639c09-8726-4618-8516-b100240948b6 | snscrawler036 | 160d 10h 29m 5s | 1 | 1 |
f98e68c4-8389-42b8-84a4-ac9f4bb2a9bd | snscrawler032 | 160d 11h 49m 8s | 1 | 1 |
93d97d08-234c-4225-92df-c470d679db5b | snscrawler065 | 160d 11h 25m 14s | 1 | 1 |
190ae23d-0c31-452d-96f6-3d6c8549592f | snscrawler097 | 151d 9h 1m 8s | 1 | 1 |
3c857084-3544-41f0-9171-65706cc79ce2 | snscrawler059 | 715d 12h 45m 13s | 1 | 1 |
71f56fdd-25f2-4229-8d4d-32ab885d3853 | snscrawler044 | 198d 11h 33m 14s | 1 | 1 |
5c91c4d5-c1e2-4ad7-892e-3c7b04a929d4 | snscrawler068 | 224d 15h 1m 11s | 1 | 1 |
2e4d05e1-e998-4f77-adc4-b6a4bc2a883d | snscrawler042 | 33d 8h 43m 4s | 1 | 1 |
8305e0a4-a792-4b44-97ca-3e1c821a1eaf | snscrawler056 | 160d 10h 29m 13s | 1 | 1 |
83f602a0-be9d-4641-8bfe-3377ef5d95a9 | snscrawler035 | 160d 11h 15m 12s | 1 | 1 |
d2499869-3862-416f-b080-b5e8e69af268 | snscrawler066 | 532d 13h 27m 12s | 1 | 1 |
104210a1-a3db-4f68-80c3-331855f792d3 | snscrawler063 | 870d 7h 37m 11s | 1 | 1 |
8a52e18e-d481-4a13-88c1-e6c17aec7d75 | snscrawler013 | 160d 11h 41m 9s | 1 | 1 |
56682602-088f-499a-a266-a0848725e585 | snscrawler040 | 376d 16h 9m 14s | 1 | 1 |
d858a5f7-f8f3-4bcf-b94f-811410fa245a | snscrawler015 | 75d 16h 43m 5s | 1 | 1 |
59583e3a-4dd4-44ed-a84b-61c176039b0e | snscrawler064 | 191d 14h 15m 10s | 1 | 1 |
c72c8088-3846-4a50-a830-5ac47d0a6fa6 | snscrawler031 | 160d 10h 29m 1s | 1 | 1 |
75a0d199-0c88-4e3f-9791-01f61a48acd3 | snscrawler029 | 299d 10h 29m 15s | 1 | 1 |
d8a51c1c-8895-489f-a5be-cfe38fbe4dc3 | snscrawler058 | 160d 10h 29m 9s | 1 | 1 |
f1194d0b-4f71-4186-9161-c9c7ed76df4f | snscrawler019 | 191d 14h 13m 9s | 1 | 1 |
ca9def75-c320-4680-b1cb-486972264665 | snscrawler048 | 715d 12h 45m 11s | 1 | 1 |
1a7d95e7-2cf3-456e-bf2d-e16d69de408e | snscrawler023 | 160d 11h 33m 6s | 1 | 1 |
e83df2a0-b594-43dd-996c-6115196eda91 | snscrawler011 | 160d 10h 29m 6s | 1 | 1 |
42efbd59-6f0b-43b1-84a5-12d2df03f2f4 | snscrawler018 | 30d 7h 59m 14s | 1 | 1 |
7aa08022-7b34-458e-90bf-a9b67d778447 | snscrawler017 | 853d 10h 37m 11s | 1 | 1 |
08970478-b810-4f78-b0c4-1b386c6ee7cf | snscrawler061 | 160d 10h 27m 12s | 1 | 1 |
ca63082d-255a-4cf5-bd34-f8f86964fc2a | snscrawler062 | 160d 11h 23m 1s | 1 | 1 |
f0c39328-82ea-4a41-ac5c-21f69ad66b76 | snscrawler055 | 297d 4h 53m 13s | 1 | 1 |
017432b6-07c1-41b2-bbc2-b4722a664c5c | snscrawler039 | 736d 12h 41m 9s | 1 | 1 |
deaddd9e-f932-4a4c-a75e-e1dd1db8813d | snscrawler067 | 39d 10h 57m 12s | 1 | 1 |
cff45b72-c1c3-41eb-91e6-26fc56bbaf22 | snscrawler052 | 542d 15h 19m 0s | 1 | 1 |
0dce88a5-d270-4056-9c19-50c099b2543a | snscrawler038 | 290d 14h 41m 10s | 1 | 1 |
eb83e274-d7b2-4921-a28d-1711842ae6d0 | snscrawler050 | 283d 4h 57m 12s | 1 | 1 |
99b163f1-93e3-4725-8d35-d3e67a6519fc | snscrawler054 | 160d 11h 29m 8s | 1 | 1 |
7c928134-bf01-471f-838c-e6e280ed5c06 | snscrawler041 | 419d 12h 39m 11s | 1 | 1 |
ba4940f6-70d4-404f-aef1-a14e889dc4d7 | snscrawler026 | 160d 11h 15m 5s | 1 | 1 |
ed0d7d40-9bcd-4e0c-a854-b07f12936004 | snscrawler047 | 319d 13h 15m 14s | 1 | 1 |
63253f8d-853a-46b4-b7ec-e44572f0c7a9 | snscrawler009 | 568d 1h 7m 10s | 1 | 1 |
1c12d2be-4e03-46e1-bc0a-af79623d4071 | snscrawler027 | 130d 10h 51m 7s | 1 | 1 |
fcb271a2-ee70-4745-a098-9652c5b6c3e7 | snscrawler007 | 790d 7h 49m 4s | 1 | 1 |
b1cfdfa6-f2c0-4c14-8510-110e0958598d | snscrawler043 | 532d 13h 27m 12s | 1 | 1 |
14942697-6847-4ca5-b075-41f8149727c4 | snscrawler037 | 532d 13h 27m 7s | 1 | 1 |
7a59e284-d2ac-4f01-ac6b-ff509e01bfdd | snscrawler028 | 527d 16h 33m 12s | 1 | 1 |
e251fef6-28c9-4125-a754-d77b2a121741 | snscrawler016 | 874d 13h 7m 12s | 1 | 1 |
afe5cea8-3c67-4acf-996d-ae34179fd73b | snscrawler053 | 123d 10h 59m 4s | 1 | 1 |
9c500cea-0254-4f9f-b9d9-5ecb26cb2db1 | snscrawler051 | 160d 10h 29m 11s | 1 | 1 |
8dfef97c-2c1c-493d-9e12-1b9810e2e201 | snscrawler030 | 773d 14h 16m 38s | 1 | 1 |
0fe6dad1-cbda-4236-a1e1-c7b652769137 | snscrawler049 | 413d 16h 27m 7s | 1 | 1 |
7e63cf6b-4fd2-4c8d-9416-7b2128e6bf56 | snscrawler033 | 224d 15h 1m 13s | 1 | 1 |
8f07e2c6-d662-42a3-b2bd-d36e16fae2d0 | snscrawler025 | 123d 6h 21m 12s | 1 | 1 |
f34142e0-0fab-49ac-86d1-fb2e9984e29e | snscrawler012 | 163d 12h 2m 58s | 1 | 1 |
979d73c7-cb43-4d56-822d-919abf1a0812 | snscrawler010 | 160d 11h 41m 10s | 1 | 1 |
36b3c5a9-daac-4924-9f17-80bf7ab9ec6e | snscrawler014 | 276d 8h 9m 14s | 1 | 1 |
de24ba5c-3614-47c7-b5a3-fbf55a81a233 | snscrawler045 | 224d 15h 1m 12s | 1 | 1 |
3a3a95f1-d8c0-4a0d-95cf-b36f4a6493d8 | snscrawler020 | 160d 10h 29m 12s | 1 | 1 |
6fae10f7-aaba-4674-9927-22432e00eaa2 | snscrawler021 | 68d 2h 57m 11s | 1 | 1 |
e15a45d7-36d8-417e-aa0d-3cd0361b2257 | snscrawler060 | 2d 8h 46m 58s | 1 | 1 |
3c81325a-04f1-41aa-b5ce-bcc14ec33ef6 | snscrawler046 | 532d 13h 27m 12s | 1 | 1 |
721c1457-506a-4f83-9661-927fbc9bab7b | snscrawler069 | 160d 12h 3m 29s | 1 | 1 |
45a19f2c-d90d-4ee7-a063-f897dcdf8e04 | snscrawler057 | 160d 11h 29m 12s | 1 | 1 |
Key | Value |
---|---|
dev.zookeeper.path | /tmp/dev-storm-zookeeper |
topology.tick.tuple.freq.secs | |
topology.builtin.metrics.bucket.size.secs | 60 |
topology.fall.back.on.java.serialization | true |
topology.max.error.report.per.interval | 5 |
zmq.linger.millis | 5000 |
topology.skip.missing.kryo.registrations | false |
storm.messaging.netty.client_worker_threads | 1 |
ui.childopts | -Xmx768m |
storm.zookeeper.session.timeout | 20000 |
nimbus.reassign | true |
topology.trident.batch.emit.interval.millis | 500 |
nimbus.monitor.freq.secs | 10 |
logviewer.childopts | -Xmx128m |
java.library.path | /usr/local/lib:/opt/local/lib:/usr/lib |
topology.executor.send.buffer.size | 1024 |
storm.local.dir | /home/service/storm |
storm.messaging.netty.buffer_size | 5242880 |
supervisor.worker.start.timeout.secs | 120 |
topology.enable.message.timeouts | true |
nimbus.cleanup.inbox.freq.secs | 600 |
nimbus.inbox.jar.expiration.secs | 3600 |
drpc.worker.threads | 64 |
topology.worker.shared.thread.pool.size | 4 |
nimbus.host | localhost |
storm.messaging.netty.min_wait_ms | 100 |
storm.zookeeper.port | 2181 |
transactional.zookeeper.port | |
topology.executor.receive.buffer.size | 1024 |
transactional.zookeeper.servers | |
storm.zookeeper.root | /storm |
storm.zookeeper.retry.intervalceiling.millis | 30000 |
supervisor.enable | true |
storm.messaging.netty.server_worker_threads | 1 |
storm.zookeeper.servers | ["10.33.29.95" "10.34.30.168" "10.33.46.146"] |
transactional.zookeeper.root | /transactional |
topology.acker.executors | |
topology.transfer.buffer.size | 1024 |
topology.worker.childopts | |
drpc.queue.size | 128 |
worker.childopts | -Xmx768m |
supervisor.heartbeat.frequency.secs | 5 |
topology.error.throttle.interval.secs | 10 |
zmq.hwm | 0 |
drpc.port | 3772 |
supervisor.monitor.frequency.secs | 3 |
drpc.childopts | -Xmx768m |
topology.receiver.buffer.size | 8 |
task.heartbeat.frequency.secs | 3 |
topology.tasks | |
storm.messaging.netty.max_retries | 30 |
topology.spout.wait.strategy | backtype.storm.spout.SleepSpoutWaitStrategy |
topology.max.spout.pending | |
storm.zookeeper.retry.interval | 5000 |
topology.sleep.spout.wait.strategy.time.ms | 1 |
nimbus.topology.validator | backtype.storm.nimbus.DefaultTopologyValidator |
supervisor.slots.ports | [6700 6701 6702 6703] |
topology.debug | false |
nimbus.task.launch.secs | 120 |
nimbus.supervisor.timeout.secs | 60 |
topology.message.timeout.secs | 30 |
task.refresh.poll.secs | 10 |
topology.workers | 1 |
supervisor.childopts | -Xmx256m |
nimbus.thrift.port | 6627 |
topology.stats.sample.rate | 0.05 |
worker.heartbeat.frequency.secs | 1 |
topology.tuple.serializer | backtype.storm.serialization.types.ListDelegateSerializer |
topology.disruptor.wait.strategy | com.lmax.disruptor.BlockingWaitStrategy |
nimbus.task.timeout.secs | 30 |
storm.zookeeper.connection.timeout | 15000 |
topology.kryo.factory | backtype.storm.serialization.DefaultKryoFactory |
drpc.invocations.port | 3773 |
logviewer.port | 8000 |
zmq.threads | 1 |
storm.zookeeper.retry.times | 5 |
storm.thrift.transport | backtype.storm.security.auth.SimpleTransportPlugin |
topology.state.synchronization.timeout.secs | 60 |
supervisor.worker.timeout.secs | 30 |
nimbus.file.copy.expiration.secs | 600 |
storm.messaging.transport | backtype.storm.messaging.netty.Context |
logviewer.appender.name | A1 |
storm.messaging.netty.max_wait_ms | 5000 |
drpc.request.timeout.secs | 600 |
storm.local.mode.zmq | false |
ui.port | 8080 |
nimbus.childopts | -Xms1500m -Xmx1500m |
storm.cluster.mode | distributed |
topology.optimize | true |
topology.max.task.parallelism |