Version | Nimbus uptime | Supervisors | Used slots | Free slots | Total slots | Executors | Tasks |
---|---|---|---|---|---|---|---|
0.9.0.1 | 29d 16h 53m 53s | 64 | 63 | 1 | 64 | 209 | 209 |
Name | Id | Status | Uptime | Num workers | Num executors | Num tasks |
---|---|---|---|---|---|---|
MajorCommunityCrawlerTopology2 | MajorCommunityCrawlerTopology2-6-1714008082 | ACTIVE | 18h 37m 41s | 10 | 21 | 21 |
IntegrateMassmediaCrawlerTopology | IntegrateMassmediaCrawlerTopology-4-1713944012 | ACTIVE | 1d 12h 25m 31s | 1 | 3 | 3 |
MajorCommunityCrawlerTopology1 | MajorCommunityCrawlerTopology1-5-1714008071 | ACTIVE | 18h 37m 51s | 10 | 21 | 21 |
BlogKeywordCrawlerTopology1 | BlogKeywordCrawlerTopology1-2-1701056813 | ACTIVE | 150d 16h 12m 10s | 1 | 7 | 7 |
NaverPostKeywordCrawlerTopology1 | NaverPostKeywordCrawlerTopology1-35-1702015590 | ACTIVE | 139d 13h 52m 33s | 1 | 3 | 3 |
BlogKeywordCrawlerTopology3 | BlogKeywordCrawlerTopology3-3-1701056818 | ACTIVE | 150d 16h 12m 5s | 3 | 19 | 19 |
NaverNewsCrawlerTopology | NaverNewsCrawlerTopology-14-1701057344 | ACTIVE | 150d 16h 3m 19s | 1 | 3 | 3 |
DaumNewsCrawlerTopology | DaumNewsCrawlerTopology-8-1701057094 | ACTIVE | 150d 16h 7m 28s | 1 | 3 | 3 |
CafeKeywordCrawlerTopology3 | CafeKeywordCrawlerTopology3-70-1706238384 | ACTIVE | 90d 16h 52m 38s | 2 | 9 | 9 |
YouTubeHistoryCrawlerTopology5 | YouTubeHistoryCrawlerTopology5-106-1710136810 | ACTIVE | 45d 13h 58m 52s | 7 | 22 | 22 |
ProxyIPCrawlerTopology | ProxyIPCrawlerTopology-18-1701057592 | ACTIVE | 150d 15h 59m 10s | 1 | 4 | 4 |
YouTubeCommentCrawlerTopology5 | YouTubeCommentCrawlerTopology5-108-1710229284 | ACTIVE | 44d 12h 17m 39s | 5 | 16 | 16 |
CafeKeywordCrawlerTopology5 | CafeKeywordCrawlerTopology5-71-1706238389 | ACTIVE | 90d 16h 52m 34s | 1 | 7 | 7 |
NaverPostKeywordCrawlerTopology5 | NaverPostKeywordCrawlerTopology5-17-1701057547 | ACTIVE | 150d 15h 59m 56s | 1 | 3 | 3 |
YouTubeCrawlerTopology1 | YouTubeCrawlerTopology1-109-1710305569 | ACTIVE | 43d 15h 6m 14s | 5 | 16 | 16 |
NaverPostCollectorCrawlerTopology0 | NaverPostCollectorCrawlerTopology0-15-1701057529 | ACTIVE | 150d 16h 0m 14s | 1 | 3 | 3 |
MajorCommunityCommentCrawlerTopology | MajorCommunityCommentCrawlerTopology-10-1701057174 | ACTIVE | 150d 16h 6m 8s | 3 | 10 | 10 |
TwitterCollectorManualCrawlerTopology1 | TwitterCollectorManualCrawlerTopology1-7-1689213320 | ACTIVE | 287d 18h 3m 42s | 1 | 3 | 3 |
NaverNewsCommentCrawlerTopology | NaverNewsCommentCrawlerTopology-50-1704173683 | ACTIVE | 114d 14h 24m 20s | 4 | 13 | 13 |
BlogKeywordCrawlerTopology5 | BlogKeywordCrawlerTopology5-4-1701056823 | ACTIVE | 150d 16h 12m 0s | 2 | 13 | 13 |
TwitterKeywordManualCrawlerTopology1 | TwitterKeywordManualCrawlerTopology1-8-1689213332 | ACTIVE | 287d 18h 3m 31s | 1 | 3 | 3 |
CafeKeywordCrawlerTopology1 | CafeKeywordCrawlerTopology1-69-1706238375 | ACTIVE | 90d 16h 52m 48s | 1 | 7 | 7 |
Id | Host | Uptime | Slots | Used slots |
---|---|---|---|---|
450b5062-ea24-4a13-b8d4-9f1c6b5db3aa | snscrawler024 | 956d 13h 32m 48s | 1 | 1 |
373a1e19-18ae-41dc-9cdb-2cb2d2ee7496 | snscrawler022 | 29d 16h 56m 45s | 1 | 1 |
dc417167-f79c-443c-8a25-fe605151e379 | snscrawler006 | 154d 13h 48m 45s | 1 | 1 |
55036685-edb2-4eb2-b914-d93923a24594 | snscrawler034 | 150d 17h 30m 44s | 1 | 1 |
83639c09-8726-4618-8516-b100240948b6 | snscrawler036 | 150d 16h 26m 42s | 1 | 1 |
f98e68c4-8389-42b8-84a4-ac9f4bb2a9bd | snscrawler032 | 150d 17h 46m 46s | 1 | 1 |
93d97d08-234c-4225-92df-c470d679db5b | snscrawler065 | 150d 17h 22m 45s | 1 | 1 |
190ae23d-0c31-452d-96f6-3d6c8549592f | snscrawler097 | 141d 14h 58m 45s | 1 | 1 |
3c857084-3544-41f0-9171-65706cc79ce2 | snscrawler059 | 705d 18h 42m 49s | 1 | 1 |
71f56fdd-25f2-4229-8d4d-32ab885d3853 | snscrawler044 | 188d 17h 30m 48s | 1 | 1 |
5c91c4d5-c1e2-4ad7-892e-3c7b04a929d4 | snscrawler068 | 214d 20h 58m 47s | 1 | 1 |
2e4d05e1-e998-4f77-adc4-b6a4bc2a883d | snscrawler042 | 23d 14h 40m 40s | 1 | 1 |
8305e0a4-a792-4b44-97ca-3e1c821a1eaf | snscrawler056 | 150d 16h 26m 47s | 1 | 1 |
83f602a0-be9d-4641-8bfe-3377ef5d95a9 | snscrawler035 | 150d 17h 12m 47s | 1 | 1 |
d2499869-3862-416f-b080-b5e8e69af268 | snscrawler066 | 522d 19h 24m 49s | 1 | 1 |
104210a1-a3db-4f68-80c3-331855f792d3 | snscrawler063 | 860d 13h 34m 50s | 1 | 1 |
8a52e18e-d481-4a13-88c1-e6c17aec7d75 | snscrawler013 | 150d 17h 38m 46s | 1 | 1 |
56682602-088f-499a-a266-a0848725e585 | snscrawler040 | 366d 22h 6m 48s | 1 | 1 |
d858a5f7-f8f3-4bcf-b94f-811410fa245a | snscrawler015 | 65d 22h 40m 45s | 1 | 1 |
59583e3a-4dd4-44ed-a84b-61c176039b0e | snscrawler064 | 181d 20h 12m 47s | 1 | 1 |
c72c8088-3846-4a50-a830-5ac47d0a6fa6 | snscrawler031 | 150d 16h 26m 39s | 1 | 1 |
75a0d199-0c88-4e3f-9791-01f61a48acd3 | snscrawler029 | 289d 16h 26m 50s | 1 | 1 |
d8a51c1c-8895-489f-a5be-cfe38fbe4dc3 | snscrawler058 | 150d 16h 26m 44s | 1 | 1 |
f1194d0b-4f71-4186-9161-c9c7ed76df4f | snscrawler019 | 181d 20h 10m 47s | 1 | 1 |
ca9def75-c320-4680-b1cb-486972264665 | snscrawler048 | 705d 18h 42m 51s | 1 | 1 |
1a7d95e7-2cf3-456e-bf2d-e16d69de408e | snscrawler023 | 150d 17h 30m 44s | 1 | 1 |
91438cf6-988d-4a98-aa4e-b0e3b41b6bef | snscrawler060 | 556d 17h 16m 50s | 1 | 1 |
e83df2a0-b594-43dd-996c-6115196eda91 | snscrawler011 | 150d 16h 26m 43s | 1 | 1 |
42efbd59-6f0b-43b1-84a5-12d2df03f2f4 | snscrawler018 | 20d 13h 56m 46s | 1 | 1 |
7aa08022-7b34-458e-90bf-a9b67d778447 | snscrawler017 | 843d 16h 34m 46s | 1 | 1 |
08970478-b810-4f78-b0c4-1b386c6ee7cf | snscrawler061 | 150d 16h 24m 45s | 1 | 1 |
ca63082d-255a-4cf5-bd34-f8f86964fc2a | snscrawler062 | 150d 17h 20m 41s | 1 | 1 |
f0c39328-82ea-4a41-ac5c-21f69ad66b76 | snscrawler055 | 287d 10h 50m 46s | 1 | 1 |
017432b6-07c1-41b2-bbc2-b4722a664c5c | snscrawler039 | 726d 18h 38m 47s | 1 | 1 |
deaddd9e-f932-4a4c-a75e-e1dd1db8813d | snscrawler067 | 29d 16h 54m 46s | 1 | 1 |
cff45b72-c1c3-41eb-91e6-26fc56bbaf22 | snscrawler052 | 532d 21h 16m 37s | 1 | 1 |
0dce88a5-d270-4056-9c19-50c099b2543a | snscrawler038 | 280d 20h 38m 45s | 1 | 1 |
eb83e274-d7b2-4921-a28d-1711842ae6d0 | snscrawler050 | 273d 10h 54m 48s | 1 | 1 |
99b163f1-93e3-4725-8d35-d3e67a6519fc | snscrawler054 | 150d 17h 26m 44s | 1 | 1 |
7c928134-bf01-471f-838c-e6e280ed5c06 | snscrawler041 | 409d 18h 36m 45s | 1 | 1 |
ba4940f6-70d4-404f-aef1-a14e889dc4d7 | snscrawler026 | 150d 17h 12m 43s | 1 | 1 |
ed0d7d40-9bcd-4e0c-a854-b07f12936004 | snscrawler047 | 309d 19h 12m 50s | 1 | 1 |
63253f8d-853a-46b4-b7ec-e44572f0c7a9 | snscrawler009 | 558d 7h 4m 45s | 1 | 1 |
1c12d2be-4e03-46e1-bc0a-af79623d4071 | snscrawler027 | 120d 16h 48m 45s | 1 | 1 |
fcb271a2-ee70-4745-a098-9652c5b6c3e7 | snscrawler007 | 780d 13h 46m 42s | 1 | 1 |
b1cfdfa6-f2c0-4c14-8510-110e0958598d | snscrawler043 | 522d 19h 24m 47s | 1 | 1 |
14942697-6847-4ca5-b075-41f8149727c4 | snscrawler037 | 522d 19h 24m 44s | 1 | 1 |
7a59e284-d2ac-4f01-ac6b-ff509e01bfdd | snscrawler028 | 517d 22h 30m 49s | 1 | 1 |
e251fef6-28c9-4125-a754-d77b2a121741 | snscrawler016 | 864d 19h 4m 48s | 1 | 1 |
afe5cea8-3c67-4acf-996d-ae34179fd73b | snscrawler053 | 113d 16h 56m 43s | 1 | 1 |
9c500cea-0254-4f9f-b9d9-5ecb26cb2db1 | snscrawler051 | 150d 16h 26m 47s | 1 | 1 |
8dfef97c-2c1c-493d-9e12-1b9810e2e201 | snscrawler030 | 763d 20h 14m 11s | 1 | 1 |
0fe6dad1-cbda-4236-a1e1-c7b652769137 | snscrawler049 | 403d 22h 24m 43s | 1 | 1 |
7e63cf6b-4fd2-4c8d-9416-7b2128e6bf56 | snscrawler033 | 214d 20h 58m 47s | 1 | 1 |
8f07e2c6-d662-42a3-b2bd-d36e16fae2d0 | snscrawler025 | 113d 12h 18m 46s | 1 | 1 |
f34142e0-0fab-49ac-86d1-fb2e9984e29e | snscrawler012 | 153d 18h 0m 36s | 1 | 1 |
979d73c7-cb43-4d56-822d-919abf1a0812 | snscrawler010 | 150d 17h 38m 46s | 1 | 1 |
36b3c5a9-daac-4924-9f17-80bf7ab9ec6e | snscrawler014 | 266d 14h 6m 45s | 1 | 1 |
de24ba5c-3614-47c7-b5a3-fbf55a81a233 | snscrawler045 | 214d 20h 58m 47s | 1 | 1 |
3a3a95f1-d8c0-4a0d-95cf-b36f4a6493d8 | snscrawler020 | 150d 16h 26m 49s | 1 | 1 |
6fae10f7-aaba-4674-9927-22432e00eaa2 | snscrawler021 | 58d 8h 54m 48s | 1 | 1 |
3c81325a-04f1-41aa-b5ce-bcc14ec33ef6 | snscrawler046 | 522d 19h 24m 47s | 1 | 1 |
721c1457-506a-4f83-9661-927fbc9bab7b | snscrawler069 | 150d 18h 1m 6s | 1 | 0 |
45a19f2c-d90d-4ee7-a063-f897dcdf8e04 | snscrawler057 | 150d 17h 26m 46s | 1 | 1 |
Key | Value |
---|---|
dev.zookeeper.path | /tmp/dev-storm-zookeeper |
topology.tick.tuple.freq.secs | |
topology.builtin.metrics.bucket.size.secs | 60 |
topology.fall.back.on.java.serialization | true |
topology.max.error.report.per.interval | 5 |
zmq.linger.millis | 5000 |
topology.skip.missing.kryo.registrations | false |
storm.messaging.netty.client_worker_threads | 1 |
ui.childopts | -Xmx768m |
storm.zookeeper.session.timeout | 20000 |
nimbus.reassign | true |
topology.trident.batch.emit.interval.millis | 500 |
nimbus.monitor.freq.secs | 10 |
logviewer.childopts | -Xmx128m |
java.library.path | /usr/local/lib:/opt/local/lib:/usr/lib |
topology.executor.send.buffer.size | 1024 |
storm.local.dir | /home/service/storm |
storm.messaging.netty.buffer_size | 5242880 |
supervisor.worker.start.timeout.secs | 120 |
topology.enable.message.timeouts | true |
nimbus.cleanup.inbox.freq.secs | 600 |
nimbus.inbox.jar.expiration.secs | 3600 |
drpc.worker.threads | 64 |
topology.worker.shared.thread.pool.size | 4 |
nimbus.host | localhost |
storm.messaging.netty.min_wait_ms | 100 |
storm.zookeeper.port | 2181 |
transactional.zookeeper.port | |
topology.executor.receive.buffer.size | 1024 |
transactional.zookeeper.servers | |
storm.zookeeper.root | /storm |
storm.zookeeper.retry.intervalceiling.millis | 30000 |
supervisor.enable | true |
storm.messaging.netty.server_worker_threads | 1 |
storm.zookeeper.servers | ["10.33.29.95" "10.34.30.168" "10.33.46.146"] |
transactional.zookeeper.root | /transactional |
topology.acker.executors | |
topology.transfer.buffer.size | 1024 |
topology.worker.childopts | |
drpc.queue.size | 128 |
worker.childopts | -Xmx768m |
supervisor.heartbeat.frequency.secs | 5 |
topology.error.throttle.interval.secs | 10 |
zmq.hwm | 0 |
drpc.port | 3772 |
supervisor.monitor.frequency.secs | 3 |
drpc.childopts | -Xmx768m |
topology.receiver.buffer.size | 8 |
task.heartbeat.frequency.secs | 3 |
topology.tasks | |
storm.messaging.netty.max_retries | 30 |
topology.spout.wait.strategy | backtype.storm.spout.SleepSpoutWaitStrategy |
topology.max.spout.pending | |
storm.zookeeper.retry.interval | 5000 |
topology.sleep.spout.wait.strategy.time.ms | 1 |
nimbus.topology.validator | backtype.storm.nimbus.DefaultTopologyValidator |
supervisor.slots.ports | [6700 6701 6702 6703] |
topology.debug | false |
nimbus.task.launch.secs | 120 |
nimbus.supervisor.timeout.secs | 60 |
topology.message.timeout.secs | 30 |
task.refresh.poll.secs | 10 |
topology.workers | 1 |
supervisor.childopts | -Xmx256m |
nimbus.thrift.port | 6627 |
topology.stats.sample.rate | 0.05 |
worker.heartbeat.frequency.secs | 1 |
topology.tuple.serializer | backtype.storm.serialization.types.ListDelegateSerializer |
topology.disruptor.wait.strategy | com.lmax.disruptor.BlockingWaitStrategy |
nimbus.task.timeout.secs | 30 |
storm.zookeeper.connection.timeout | 15000 |
topology.kryo.factory | backtype.storm.serialization.DefaultKryoFactory |
drpc.invocations.port | 3773 |
logviewer.port | 8000 |
zmq.threads | 1 |
storm.zookeeper.retry.times | 5 |
storm.thrift.transport | backtype.storm.security.auth.SimpleTransportPlugin |
topology.state.synchronization.timeout.secs | 60 |
supervisor.worker.timeout.secs | 30 |
nimbus.file.copy.expiration.secs | 600 |
storm.messaging.transport | backtype.storm.messaging.netty.Context |
logviewer.appender.name | A1 |
storm.messaging.netty.max_wait_ms | 5000 |
drpc.request.timeout.secs | 600 |
storm.local.mode.zmq | false |
ui.port | 8080 |
nimbus.childopts | -Xms1500m -Xmx1500m |
storm.cluster.mode | distributed |
topology.optimize | true |
topology.max.task.parallelism |