forked from elodina/scala-kafka
-
Notifications
You must be signed in to change notification settings - Fork 0
/
20150123.test.out
1205 lines (1201 loc) · 190 KB
/
20150123.test.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Note: in order to honour the org.gradle.jvmargs and/or org.gradle.java.home values specified for this build, it is necessary to fork a new JVM.
To avoid the slowdown associated with this extra process, you might want to consider running Gradle with the daemon enabled.
Please see the user guide chapter on the daemon at /root/.gradle/wrapper/dists/gradle-1.4-all/3eio91dg5g0q0huhii19qgaho0/gradle-1.4/docs/userguide/gradle_daemon.html.
:compileJava UP-TO-DATE
:compileScala UP-TO-DATE
:processResources UP-TO-DATE
:classes UP-TO-DATE
:compileTestJava UP-TO-DATE
:compileTestScala UP-TO-DATE
:processTestResources UP-TO-DATE
:testClasses UP-TO-DATE
:specs
[2015-01-24 04:57:32,911] INFO ProducerConfig values:
value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
block.on.buffer.full = true
retry.backoff.ms = 100
buffer.memory = 33554432
batch.size = 16384
metrics.sample.window.ms = 30000
metadata.max.age.ms = 300000
receive.buffer.bytes = 32768
timeout.ms = 30000
max.in.flight.requests.per.connection = 5
metric.reporters = []
bootstrap.servers = [192.168.86.10:9092]
client.id =
compression.type = none
retries = 0
max.request.size = 1048576
send.buffer.bytes = 131072
acks = 1
reconnect.backoff.ms = 10
linger.ms = 0
metrics.num.samples = 2
metadata.fetch.timeout.ms = 60000
(org.apache.kafka.clients.producer.ProducerConfig)
[2015-01-24 04:57:33,025] INFO >>> starting sample broker testing (ly.stealth.testing.AkkaKafkaSpec)
[2015-01-24 04:57:33,083] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,202] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,204] INFO Property client.id is overridden to f8839cde-474a-4841-a756-864067cff8fe (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,208] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,212] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,214] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,219] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,222] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,382] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(2f24c004-d70c-46c9-821f-113f9bf728f4) (kafka.client.ClientUtils$)
[2015-01-24 04:57:33,390] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:33,446] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:33,479] WARN Error while fetching metadata [{TopicMetadata for topic 2f24c004-d70c-46c9-821f-113f9bf728f4 ->
No partition metadata for topic 2f24c004-d70c-46c9-821f-113f9bf728f4 due to kafka.common.LeaderNotAvailableException}] for topic [2f24c004-d70c-46c9-821f-113f9bf728f4]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:33,490] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(2f24c004-d70c-46c9-821f-113f9bf728f4) (kafka.client.ClientUtils$)
[2015-01-24 04:57:33,492] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:33,497] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:33,554] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:33,576] INFO >>> message sent (ly.stealth.testing.AkkaKafkaSpec)
[2015-01-24 04:57:33,604] INFO >>> starting consumer (ly.stealth.testing.AkkaKafkaSpec)
[2015-01-24 04:57:33,620] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,622] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,624] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,626] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,627] INFO Property group.id is overridden to 530d1ec1-3b94-4502-84ac-280e6e9cdc4d (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,629] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,635] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,637] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,638] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:33,702] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:33,725] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:33,744] INFO Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:host.name=precise64 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.version=1.6.0_45 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.vendor=Sun Microsystems Inc. (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.home=/usr/lib/jvm/java-6-oracle/jre (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.class.path=/vagrant/build/classes/main:/vagrant/build/resources/main:/root/.gradle/caches/artifacts-23/filestore/org.apache.kafka/kafka_2.10/0.8.2.0/jar/23cbf3bea75e3cf0be5c56578a5465dc11e5940d/kafka_2.10-0.8.2.0.jar:/root/.gradle/caches/artifacts-23/filestore/com.101tec/zkclient/0.3/jar/dedcf2b53fb742adba7080ac3aed781694ba616e/zkclient-0.3.jar:/root/.gradle/caches/artifacts-23/filestore/log4j/log4j/1.2.17/bundle/5af35056b4d257e4b64b9e8069c0746e8b08629f/log4j-1.2.17.jar:/root/.gradle/caches/artifacts-23/filestore/net.sf.jopt-simple/jopt-simple/4.5/jar/6065cc95c661255349c1d0756657be17c29a4fd3/jopt-simple-4.5.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.avro/avro/1.7.5/jar/8343a5b33f56fa16306ed27fa7b1a79278c26c2d/avro-1.7.5.jar:/root/.gradle/caches/artifacts-23/filestore/com.github.scopt/scopt_2.9.2/3.1.0/jar/9d68b9d2d824f188eff91129cdc01cf95201c3a3/scopt_2.9.2-3.1.0.jar:/root/.gradle/caches/artifacts-23/filestore/com.yammer.metrics/metrics-core/2.2.0/jar/f82c035cfa786d3cbec362c38c22a5f5b1bc8724/metrics-core-2.2.0.jar:/root/.gradle/caches/artifacts-23/filestore/nl.grons/metrics-scala_2.9.2/3.0.3/jar/a95b625f803bc9415381d83d2f3dca06a7b1c212/metrics-scala_2.9.2-3.0.3.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.thrift/libthrift/0.9.1/jar/16c9cccf08caa385b5fc93934cb3216fe6ac6a72/libthrift-0.9.1.jar:/root/.gradle/caches/artifacts-23/filestore/joda-time/joda-time/2.3/jar/56498efd17752898cfcc3868c1b6211a07b12b8f/joda-time-2.3.jar:/root/.gradle/caches/artifacts-23/filestore/org.joda/joda-convert/1.5/jar/df05d18d5b32d198154184b3d309e370383ed533/joda-convert-1.5.jar:/root/.gradle/caches/artifacts-23/filestore/com.sclasen/akka-kafka_2.10/0.0.10/jar/e38329651a1fa030d047224a732ae8f8bb16cb85/akka-kafka_2.10-0.0.10.jar:/root/.gradle/caches/artifacts-23/filestore/com.typesafe.akka/akka-slf4j_2.10/2.3.1/jar/d5a46939f4d8e44855e67e420ab64875b35930f/akka-slf4j_2.10-2.3.1.jar:/root/.gradle/caches/artifacts-23/filestore/com.typesafe.akka/akka-testkit_2.10/2.3.1/jar/97260c47c12b3c7bddb0fa32a944b21790b19a70/akka-testkit_2.10-2.3.1.jar:/root/.gradle/caches/artifacts-23/filestore/org.slf4j/log4j-over-slf4j/1.6.6/jar/170e8f7395753ebbe6710bb862a84689db1f128b/log4j-over-slf4j-1.6.6.jar:/root/.gradle/caches/artifacts-23/filestore/org.scala-lang/scala-library/2.10.4/jar/9aae4cb1802537d604e03688cab744ff47b31a7d/scala-library-2.10.4.jar:/root/.gradle/caches/artifacts-23/filestore/com.typesafe.akka/akka-actor_2.10/2.3.2/jar/25f1192b460c9562b99ef30a6545b690aa0fc93c/akka-actor_2.10-2.3.2.jar:/root/.gradle/caches/artifacts-23/filestore/org.slf4j/slf4j-api/1.7.6/jar/562424e36df3d2327e8e9301a76027fca17d54ea/slf4j-api-1.7.6.jar:/root/.gradle/caches/artifacts-23/filestore/net.jpountz.lz4/lz4/1.2.0/jar/cd301e9a481eae5b68c53267100aeca43b782b9f/lz4-1.2.0.jar:/root/.gradle/caches/artifacts-23/filestore/org.xerial.snappy/snappy-java/1.1.1.6/bundle/e3f12835a135c0d253bee4dbbe74d37ce35d7269/snappy-java-1.1.1.6.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.kafka/kafka-clients/0.8.2.0/jar/7fb75343990284eac962950e91c5847ff00df2a4/kafka-clients-0.8.2.0.jar:/root/.gradle/caches/artifacts-23/filestore/org.slf4j/slf4j-log4j12/1.6.1/jar/bd245d6746cdd4e6203e976e21d597a46f115802/slf4j-log4j12-1.6.1.jar:/root/.gradle/caches/artifacts-23/filestore/junit/junit/3.8.1/jar/99129f16442844f6a4a11ae22fbbee40b14d774f/junit-3.8.1.jar:/root/.gradle/caches/artifacts-23/filestore/jline/jline/0.9.94/jar/99a18e9a44834afdebc467294e1138364c207402/jline-0.9.94.jar:/root/.gradle/caches/artifacts-23/filestore/io.netty/netty/3.7.0.Final/bundle/7a8c35599c68c0bf383df74469aa3e03d9aca87/netty-3.7.0.Final.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.zookeeper/zookeeper/3.4.6/jar/1b2502e29da1ebaade2357cd1de35a855fa3755/zookeeper-3.4.6.jar:/root/.gradle/caches/artifacts-23/filestore/org.codehaus.jackson/jackson-core-asl/1.9.13/jar/3c304d70f42f832e0a86d45bd437f692129299a4/jackson-core-asl-1.9.13.jar:/root/.gradle/caches/artifacts-23/filestore/org.codehaus.jackson/jackson-mapper-asl/1.9.13/jar/1ee2f2bed0e5dd29d1cb155a166e6f8d50bbddb7/jackson-mapper-asl-1.9.13.jar:/root/.gradle/caches/artifacts-23/filestore/com.thoughtworks.paranamer/paranamer/2.3/jar/4a85963a752c0a2f715c3924bfc686865e7e1bc6/paranamer-2.3.jar:/root/.gradle/caches/artifacts-23/filestore/org.tukaani/xz/1.0/jar/ecff5cb8b1189514c9d1d8d68eb77ac372e000c9/xz-1.0.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.commons/commons-compress/1.4.1/jar/b02e84a993d88568417536240e970c4b809126fd/commons-compress-1.4.1.jar:/root/.gradle/caches/artifacts-23/filestore/com.codahale.metrics/metrics-core/3.0.1/bundle/1e98427c7f6e53363b598e2943e50903ce4f3657/metrics-core-3.0.1.jar:/root/.gradle/caches/artifacts-23/filestore/com.codahale.metrics/metrics-healthchecks/3.0.1/bundle/bec37e61ebe40bf0f52f3fc8b7df57b5c1773682/metrics-healthchecks-3.0.1.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.commons/commons-lang3/3.1/jar/905075e6c80f206bbe6cf1e809d2caa69f420c76/commons-lang3-3.1.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.httpcomponents/httpcore/4.2.4/jar/3b7f38df6de5dd8b500e602ae8c2dd5ee446f883/httpcore-4.2.4.jar:/root/.gradle/caches/artifacts-23/filestore/commons-logging/commons-logging/1.1.1/jar/5043bfebc3db072ed80fbd362e7caf00e885d8ae/commons-logging-1.1.1.jar:/root/.gradle/caches/artifacts-23/filestore/commons-codec/commons-codec/1.6/jar/b7f0fc8f61ecadeb3695f0b9464755eee44374d4/commons-codec-1.6.jar:/root/.gradle/caches/artifacts-23/filestore/org.apache.httpcomponents/httpclient/4.2.5/jar/666e26e76f2e87d84e4f16acb546481ae1b8e9a6/httpclient-4.2.5.jar:/root/.gradle/caches/artifacts-23/filestore/com.typesafe/config/1.2.0/bundle/b2b6ad16307793a8e57f378de24447a4968c0ca3/config-1.2.0.jar:/vagrant/build/classes/test:/vagrant/build/resources/test:/root/.gradle/caches/artifacts-23/filestore/org.scalatest/scalatest_2.10/2.0/jar/36b9ceaf3cef7d881c0c9e98ba9de630bd0e8f53/scalatest_2.10-2.0.jar:/root/.gradle/caches/artifacts-23/filestore/org.specs2/specs2_2.10/2.2.2/jar/81fe3d0ee3ccbf6912eb9d5706b8a9da3105a352/specs2_2.10-2.2.2.jar:/root/.gradle/caches/artifacts-23/filestore/org.scala-lang/scala-reflect/2.10.0/jar/10ec1256a6e875e886fec050edb0669166912d0d/scala-reflect-2.10.0.jar:/root/.gradle/caches/artifacts-23/filestore/org.scalaz/scalaz-core_2.10/7.0.2/bundle/290ca1f69c0fd03fa015b507dc14a3018ab0e015/scalaz-core_2.10-7.0.2.jar:/root/.gradle/caches/artifacts-23/filestore/org.scalaz/scalaz-effect_2.10/7.0.2/bundle/ec35b74a24a7c4b144877a5b566205075ac1fb4a/scalaz-effect_2.10-7.0.2.jar:/root/.gradle/caches/artifacts-23/filestore/org.scalaz/scalaz-concurrent_2.10/7.0.2/bundle/1326de4d49c3b969c421fd2a3bb4e5be8bf4aa26/scalaz-concurrent_2.10-7.0.2.jar (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.library.path=/usr/lib/jvm/java-6-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-6-oracle/jre/lib/amd64:/usr/lib/jvm/java-6-oracle/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:os.version=3.2.0-23-generic (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,744] INFO Client environment:user.dir=/vagrant (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,749] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@5a0eddac (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:33,799] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:33,800] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:33,810] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a0025, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:33,814] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:33.866] [default-akka.actor.default-dispatcher-4] [akka://default/user/$b] at=start
[2015-01-24 04:57:33,904] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], begin registering consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:33,989] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], end registering consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,006] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], starting watcher executor thread for consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,039] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], begin rebalancing consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,263] INFO [ConsumerFetcherManager-1422075453821] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,265] INFO [ConsumerFetcherManager-1422075453821] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,269] INFO [ConsumerFetcherManager-1422075453821] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,272] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,277] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,280] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,284] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,365] INFO Consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff rebalancing the following partitions: ArrayBuffer(0) for topic 2f24c004-d70c-46c9-821f-113f9bf728f4 with consumers: List(530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:34,370] INFO 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:34,401] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0 successfully owned partition 0 for topic 2f24c004-d70c-46c9-821f-113f9bf728f4 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,441] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], Consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff selected partitions : 2f24c004-d70c-46c9-821f-113f9bf728f4:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,446] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:34,450] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], end rebalancing consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff try #0 (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:34.459] [default-akka.actor.default-dispatcher-4] [akka://default/user/$b] at=created-streams
[2015-01-24 04:57:34,494] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,495] INFO Property client.id is overridden to 530d1ec1-3b94-4502-84ac-280e6e9cdc4d (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,497] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,498] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,500] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(2f24c004-d70c-46c9-821f-113f9bf728f4) (kafka.client.ClientUtils$)
[2015-01-24 04:57:34,515] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:34,518] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[INFO] [01/24/2015 04:57:34.526] [default-akka.actor.default-dispatcher-2] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:34,558] INFO [ConsumerFetcherThread-530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:34,585] INFO [ConsumerFetcherManager-1422075453821] Added fetcher for partitions ArrayBuffer([[2f24c004-d70c-46c9-821f-113f9bf728f4,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,690] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:34,768] INFO [ConsumerFetcherManager-1422075453821] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,771] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:34,774] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:34,777] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:34,778] INFO [ConsumerFetcherManager-1422075453821] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,778] INFO [ConsumerFetcherThread-530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:34,811] INFO >>> starting sample broker testing (ly.stealth.testing.AkkaKafkaSpec)
[2015-01-24 04:57:34,812] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,815] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,817] INFO Property client.id is overridden to f99da50a-cd48-4958-b15e-d659b416e4b5 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,828] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,836] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,839] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,841] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,843] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:34,853] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:34,855] INFO [ConsumerFetcherThread-530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:34,858] INFO [ConsumerFetcherManager-1422075453821] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:34,855] INFO [ConsumerFetcherThread-530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:34,858] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(104518a3-0653-41fa-b7b0-4cb235ee3083) (kafka.client.ClientUtils$)
[2015-01-24 04:57:34,863] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:34,868] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:34,873] INFO Session: 0x14b1a26b86a0025 closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:34,874] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:34,877] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], ZKConsumerConnector shutdown completed in 186 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:34.879] [default-akka.actor.default-dispatcher-3] [ActorSystem(default)] at=consumer-stopped
[2015-01-24 04:57:34,882] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:34,884] WARN Error while fetching metadata [{TopicMetadata for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 ->
No partition metadata for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 due to kafka.common.LeaderNotAvailableException}] for topic [104518a3-0653-41fa-b7b0-4cb235ee3083]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:34,885] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(104518a3-0653-41fa-b7b0-4cb235ee3083) (kafka.client.ClientUtils$)
[2015-01-24 04:57:34,887] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:34,898] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:34,900] WARN Error while fetching metadata [{TopicMetadata for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 ->
No partition metadata for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 due to kafka.common.LeaderNotAvailableException}] for topic [104518a3-0653-41fa-b7b0-4cb235ee3083]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:34,907] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: 104518a3-0653-41fa-b7b0-4cb235ee3083 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:57:34,914] INFO Back off for 100 ms before retrying send. Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
[INFO] [01/24/2015 04:57:34.919] [default-akka.actor.default-dispatcher-3] [akka://default/user/$b/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$b/stream0#-275444141] to Actor[akka://default/user/$b/stream0#-275444141] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:34.920] [default-akka.actor.default-dispatcher-3] [akka://default/user/$b/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$b/stream0#-275444141] to Actor[akka://default/user/$b/stream0#-275444141] was not delivered. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[2015-01-24 04:57:35,014] INFO [530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff], stopping watcher executor thread for consumer 530d1ec1-3b94-4502-84ac-280e6e9cdc4d_precise64-1422075453701-618ba8ff (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,019] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 2 for 1 topic(s) Set(104518a3-0653-41fa-b7b0-4cb235ee3083) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,021] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,023] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,026] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,239] INFO >>> messages sent (ly.stealth.testing.AkkaKafkaSpec)
[2015-01-24 04:57:35,249] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,256] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,257] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,259] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,261] INFO Property group.id is overridden to 9f08a4dd-d745-4536-bb3e-d81356aa31e7 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,262] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,264] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,266] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,268] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,269] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,271] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@6fb8fcdd (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:35,272] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:35,273] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,279] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,281] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a0026, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,282] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:35.284] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c] at=start
[2015-01-24 04:57:35,284] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,286] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,287] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,288] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,285] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], begin registering consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,292] INFO Property group.id is overridden to 6fa18655-969e-4da4-951c-9e7cf866cd6d (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,295] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,297] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,297] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,298] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,301] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,303] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@22c393a1 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:35,304] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:35,309] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,310] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,312] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a0027, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,312] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:35.315] [default-akka.actor.default-dispatcher-5] [akka://default/user/$d] at=start
[2015-01-24 04:57:35,315] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], end registering consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,317] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], begin registering consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,328] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], begin rebalancing consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,326] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], starting watcher executor thread for consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,335] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], end registering consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,339] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], starting watcher executor thread for consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,342] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], begin rebalancing consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,398] INFO [ConsumerFetcherManager-1422075455314] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,412] INFO [ConsumerFetcherManager-1422075455314] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,410] INFO [ConsumerFetcherManager-1422075455282] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,418] INFO [ConsumerFetcherManager-1422075455282] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,420] INFO [ConsumerFetcherManager-1422075455282] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,421] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,422] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,424] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,426] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,428] INFO [ConsumerFetcherManager-1422075455314] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,430] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,431] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,432] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,434] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,476] INFO Consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 rebalancing the following partitions: ArrayBuffer(0) for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 with consumers: List(9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0, 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,482] WARN No broker partitions consumed by consumer thread 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-1 for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,485] INFO 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,484] INFO Consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 rebalancing the following partitions: ArrayBuffer(0) for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 with consumers: List(6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0, 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,490] INFO 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,492] WARN No broker partitions consumed by consumer thread 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-1 for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:35,500] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0 successfully owned partition 0 for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,502] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], Consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 selected partitions : 104518a3-0653-41fa-b7b0-4cb235ee3083:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,507] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], end rebalancing consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,507] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0 successfully owned partition 0 for topic 104518a3-0653-41fa-b7b0-4cb235ee3083 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,509] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], Consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 selected partitions : 104518a3-0653-41fa-b7b0-4cb235ee3083:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,518] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[INFO] [01/24/2015 04:57:35.510] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c] at=created-streams
[INFO] [01/24/2015 04:57:35.510] [default-akka.actor.default-dispatcher-2] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:35,518] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], end rebalancing consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:35.524] [default-akka.actor.default-dispatcher-5] [akka://default/user/$d] at=created-streams
[INFO] [01/24/2015 04:57:35.524] [default-akka.actor.default-dispatcher-7] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:35,530] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,534] INFO Property client.id is overridden to 9f08a4dd-d745-4536-bb3e-d81356aa31e7 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,534] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,535] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,538] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,541] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(104518a3-0653-41fa-b7b0-4cb235ee3083) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,545] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,550] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,551] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,566] INFO [ConsumerFetcherManager-1422075455282] Added fetcher for partitions ArrayBuffer([[104518a3-0653-41fa-b7b0-4cb235ee3083,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,565] INFO [ConsumerFetcherThread-9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,567] INFO Property client.id is overridden to 6fa18655-969e-4da4-951c-9e7cf866cd6d (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,571] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,573] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,576] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(104518a3-0653-41fa-b7b0-4cb235ee3083) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,587] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,605] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,612] INFO [ConsumerFetcherManager-1422075455314] Added fetcher for partitions ArrayBuffer([[104518a3-0653-41fa-b7b0-4cb235ee3083,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,618] INFO [ConsumerFetcherThread-6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,674] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,674] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:35,693] INFO [ConsumerFetcherManager-1422075455282] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,709] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,711] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,707] INFO [ConsumerFetcherManager-1422075455314] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,711] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,714] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,714] INFO [ConsumerFetcherManager-1422075455282] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,716] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,716] INFO [ConsumerFetcherThread-9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,716] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:35,728] INFO [ConsumerFetcherManager-1422075455314] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,729] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,729] INFO [ConsumerFetcherThread-6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,736] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,740] INFO Property client.id is overridden to 1c7d0bed-4a54-4026-b05d-7f7f265f6cbb (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,742] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,743] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,744] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,745] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,745] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,755] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(white1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,756] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,754] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:35,766] INFO [ConsumerFetcherThread-6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,767] INFO [ConsumerFetcherManager-1422075455314] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,775] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,777] WARN Error while fetching metadata [{TopicMetadata for topic white1422075455729 ->
No partition metadata for topic white1422075455729 due to kafka.common.LeaderNotAvailableException}] for topic [white1422075455729]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:35,778] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:35,778] INFO [ConsumerFetcherThread-6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,781] INFO Session: 0x14b1a26b86a0027 closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:35,781] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,779] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(white1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,781] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], ZKConsumerConnector shutdown completed in 100 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:35.786] [default-akka.actor.default-dispatcher-5] [ActorSystem(default)] at=consumer-stopped
[INFO] [01/24/2015 04:57:35.786] [default-akka.actor.default-dispatcher-7] [akka://default/user/$d/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$d/stream0#-1477495902] to Actor[akka://default/user/$d/stream0#-1477495902] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.786] [default-akka.actor.default-dispatcher-7] [akka://default/user/$d/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$d/stream0#-1477495902] to Actor[akka://default/user/$d/stream0#-1477495902] was not delivered. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.790] [default-akka.actor.default-dispatcher-7] [akka://default/user/$d/stream1] Message [com.sclasen.akka.kafka.StreamFSM$Stop$] from Actor[akka://default/user/$d#447100812] to Actor[akka://default/user/$d/stream1#-1148672014] was not delivered. [3] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.790] [default-akka.actor.default-dispatcher-7] [akka://default/user/$d/stream1] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$d/stream1#-1148672014] to Actor[akka://default/user/$d/stream1#-1148672014] was not delivered. [4] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[2015-01-24 04:57:35,792] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,807] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,808] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:35,810] WARN Error while fetching metadata [{TopicMetadata for topic white1422075455729 ->
No partition metadata for topic white1422075455729 due to kafka.common.LeaderNotAvailableException}] for topic [white1422075455729]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:35,812] INFO [ConsumerFetcherThread-9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,813] INFO [ConsumerFetcherThread-9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:35,814] INFO [ConsumerFetcherManager-1422075455282] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:35,815] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:35,814] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: white1422075455729 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:57:35,816] INFO Back off for 100 ms before retrying send. Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:57:35,823] INFO Session: 0x14b1a26b86a0026 closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:35,823] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:35,823] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], ZKConsumerConnector shutdown completed in 142 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:35.825] [default-akka.actor.default-dispatcher-9] [ActorSystem(default)] at=consumer-stopped
[INFO] [01/24/2015 04:57:35.826] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream0#-143708189] to Actor[akka://default/user/$c/stream0#-143708189] was not delivered. [5] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.826] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream0#-143708189] to Actor[akka://default/user/$c/stream0#-143708189] was not delivered. [6] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.826] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c/stream1] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream1#-962337576] to Actor[akka://default/user/$c/stream1#-962337576] was not delivered. [7] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:35.827] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c/stream1] Message [com.sclasen.akka.kafka.StreamFSM$Stop$] from Actor[akka://default/user/$c#-1984323695] to Actor[akka://default/user/$c/stream1#-962337576] was not delivered. [8] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[2015-01-24 04:57:35,917] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 2 for 1 topic(s) Set(white1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,918] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,919] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,921] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,926] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,926] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,927] INFO Property client.id is overridden to e863d73e-2e2d-4f24-96f7-d5ffb0a63927 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,928] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,928] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,929] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,930] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,931] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:35,934] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(black1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,935] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,945] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,947] WARN Error while fetching metadata [{TopicMetadata for topic black1422075455729 ->
No partition metadata for topic black1422075455729 due to kafka.common.LeaderNotAvailableException}] for topic [black1422075455729]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:35,947] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(black1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:35,953] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,957] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:35,958] WARN Error while fetching metadata [{TopicMetadata for topic black1422075455729 ->
No partition metadata for topic black1422075455729 due to kafka.common.LeaderNotAvailableException}] for topic [black1422075455729]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:35,959] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: black1422075455729 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:57:35,960] INFO Back off for 100 ms before retrying send. Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:57:36,061] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 2 for 1 topic(s) Set(black1422075455729) (kafka.client.ClientUtils$)
[2015-01-24 04:57:36,062] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:36,065] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:36,067] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:36,081] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,082] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,084] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,085] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,086] INFO Property group.id is overridden to b9bd1c64-ee35-4a52-a499-d1ec86397805 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,088] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,089] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,095] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,097] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,101] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,101] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@31672113 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:36,102] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:36,104] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:36,104] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:36,107] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a0028, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:36,107] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:36.109] [default-akka.actor.default-dispatcher-9] [akka://default/user/$b] at=start
[2015-01-24 04:57:36,125] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], begin registering consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,137] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], end registering consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,140] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], starting watcher executor thread for consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,156] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], begin rebalancing consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,180] INFO [ConsumerFetcherManager-1422075456108] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:36,182] INFO [ConsumerFetcherManager-1422075456108] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:36,185] INFO [ConsumerFetcherManager-1422075456108] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:36,186] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,188] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,189] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,191] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,223] INFO Consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa rebalancing the following partitions: ArrayBuffer(0) for topic white1422075262650 with consumers: List(b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0, b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,224] WARN No broker partitions consumed by consumer thread b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1 for topic white1422075262650 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,225] INFO b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,226] INFO Consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa rebalancing the following partitions: ArrayBuffer(0) for topic white1422073216839 with consumers: List(b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0, b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,226] WARN No broker partitions consumed by consumer thread b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1 for topic white1422073216839 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,227] INFO b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,229] INFO Consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa rebalancing the following partitions: ArrayBuffer(0) for topic white1422075455729 with consumers: List(b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0, b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,232] WARN No broker partitions consumed by consumer thread b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1 for topic white1422075455729 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,234] INFO b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,235] INFO Consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa rebalancing the following partitions: ArrayBuffer(0) for topic white1422075363159 with consumers: List(b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0, b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,236] WARN No broker partitions consumed by consumer thread b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-1 for topic white1422075363159 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,238] INFO b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:36,253] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 successfully owned partition 0 for topic white1422073216839 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,260] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 successfully owned partition 0 for topic white1422075363159 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,269] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 successfully owned partition 0 for topic white1422075455729 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,276] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0 successfully owned partition 0 for topic white1422075262650 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,278] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa selected partitions : white1422075455729:0: fetched offset = -1: consumed offset = -1,white1422075262650:0: fetched offset = -1: consumed offset = -1,white1422075363159:0: fetched offset = -1: consumed offset = -1,white1422073216839:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,281] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], end rebalancing consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,282] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:36,284] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Creating topic event watcher for topics white.* (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,288] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,291] INFO Property client.id is overridden to b9bd1c64-ee35-4a52-a499-d1ec86397805 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,293] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,295] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:36,296] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 4 topic(s) Set(white1422075455729, white1422075262650, white1422075363159, white1422073216839) (kafka.client.ClientUtils$)
[2015-01-24 04:57:36,297] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:36,300] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:36,313] INFO [ConsumerFetcherThread-b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:36,315] INFO [ConsumerFetcherManager-1422075456108] Added fetcher for partitions ArrayBuffer([[white1422073216839,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] , [[white1422075363159,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] , [[white1422075455729,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] , [[white1422075262650,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:36,326] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], Topics to consume = List(white1422075262650, white1422073216839, white1422075455729, white1422075363159) (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:36,330] INFO [9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702], stopping watcher executor thread for consumer 9f08a4dd-d745-4536-bb3e-d81356aa31e7_precise64-1422075455269-43605702 (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:36.332] [default-akka.actor.default-dispatcher-9] [akka://default/user/$b] at=created-streams
[INFO] [01/24/2015 04:57:36.334] [default-akka.actor.default-dispatcher-2] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:36,341] INFO [6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7], stopping watcher executor thread for consumer 6fa18655-969e-4da4-951c-9e7cf866cd6d_precise64-1422075455301-863b26c7 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,114] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,128] INFO Shutting down topic event watcher. (kafka.consumer.ZookeeperTopicEventWatcher)
[2015-01-24 04:57:41,132] INFO [ConsumerFetcherManager-1422075456108] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,135] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,138] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,138] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,141] INFO [ConsumerFetcherManager-1422075456108] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,143] INFO [ConsumerFetcherThread-b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,143] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], stopping watcher executor thread for consumer b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,185] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,186] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,189] INFO Property client.id is overridden to be4b9555-04e2-46cb-9457-2aa7e1837ab2 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,191] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,194] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,195] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,198] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,199] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,211] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,213] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,215] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,217] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,219] INFO Property group.id is overridden to c55cf308-d297-457e-bf7f-ed6aa7e58fb1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,221] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(8c6c8d83-0333-4cf8-b71a-ab391a783851) (kafka.client.ClientUtils$)
[2015-01-24 04:57:41,222] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,224] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,224] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,223] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,226] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,229] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,231] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:41,233] INFO [ConsumerFetcherThread-b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,233] INFO [ConsumerFetcherManager-1422075456108] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,233] INFO [ConsumerFetcherThread-b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,237] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@73feb3a6 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:41,238] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:41,244] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,245] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,249] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:41,236] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,250] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a0029, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,250] WARN Error while fetching metadata [{TopicMetadata for topic 8c6c8d83-0333-4cf8-b71a-ab391a783851 ->
No partition metadata for topic 8c6c8d83-0333-4cf8-b71a-ab391a783851 due to kafka.common.LeaderNotAvailableException}] for topic [8c6c8d83-0333-4cf8-b71a-ab391a783851]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:41,255] INFO Session: 0x14b1a26b86a0028 closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:41,256] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,255] INFO [b9bd1c64-ee35-4a52-a499-d1ec86397805_precise64-1422075456100-9cdb69fa], ZKConsumerConnector shutdown completed in 139 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,254] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:41.260] [default-akka.actor.default-dispatcher-5] [akka://default/user/$c] at=start
[2015-01-24 04:57:41,264] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(8c6c8d83-0333-4cf8-b71a-ab391a783851) (kafka.client.ClientUtils$)
[INFO] [01/24/2015 04:57:41.257] [default-akka.actor.default-dispatcher-6] [ActorSystem(default)] at=consumer-stopped
[2015-01-24 04:57:41,265] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,270] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], begin registering consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,274] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,277] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,286] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], end registering consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,294] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], starting watcher executor thread for consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,297] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], begin rebalancing consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,315] INFO [ConsumerFetcherManager-1422075461259] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,316] INFO [ConsumerFetcherManager-1422075461259] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,318] INFO [ConsumerFetcherManager-1422075461259] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,320] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,321] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,326] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,328] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,353] INFO Consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 rebalancing the following partitions: ArrayBuffer(0) for topic 8c6c8d83-0333-4cf8-b71a-ab391a783851 with consumers: List(c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:41,356] INFO c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:41,371] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0 successfully owned partition 0 for topic 8c6c8d83-0333-4cf8-b71a-ab391a783851 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,373] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], Consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 selected partitions : 8c6c8d83-0333-4cf8-b71a-ab391a783851:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,375] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], end rebalancing consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:41.376] [default-akka.actor.default-dispatcher-5] [akka://default/user/$c] at=created-streams
[INFO] [01/24/2015 04:57:41.376] [default-akka.actor.default-dispatcher-2] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:41,387] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,399] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,402] INFO Property client.id is overridden to c55cf308-d297-457e-bf7f-ed6aa7e58fb1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,404] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,406] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,408] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(8c6c8d83-0333-4cf8-b71a-ab391a783851) (kafka.client.ClientUtils$)
[2015-01-24 04:57:41,412] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,416] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,421] INFO [ConsumerFetcherManager-1422075461259] Added fetcher for partitions ArrayBuffer([[8c6c8d83-0333-4cf8-b71a-ab391a783851,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,431] INFO [ConsumerFetcherThread-c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,701] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,714] INFO [ConsumerFetcherManager-1422075461259] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,716] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,718] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,723] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:41,726] INFO [ConsumerFetcherManager-1422075461259] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,727] INFO [ConsumerFetcherThread-c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,760] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,767] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,769] INFO Property client.id is overridden to c74d61ee-f813-4a64-a45c-6bdf16e90d70 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,771] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,773] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,775] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,777] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,785] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,790] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(0bee0dff-fca8-4d06-b29f-a75720a3f673) (kafka.client.ClientUtils$)
[2015-01-24 04:57:41,795] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,803] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:41,806] INFO [ConsumerFetcherThread-c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,806] INFO [ConsumerFetcherManager-1422075461259] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:41,808] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:41,812] INFO Session: 0x14b1a26b86a0029 closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:41,813] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,811] INFO [ConsumerFetcherThread-c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:41,812] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], ZKConsumerConnector shutdown completed in 109 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:41.831] [default-akka.actor.default-dispatcher-8] [ActorSystem(default)] at=consumer-stopped
[INFO] [01/24/2015 04:57:41.832] [default-akka.actor.default-dispatcher-2] [akka://default/user/$c/stream0] Message [com.sclasen.akka.kafka.StreamFSM$Stop$] from Actor[akka://default/user/$c#-1950447329] to Actor[akka://default/user/$c/stream0#-239227643] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:57:41.833] [default-akka.actor.default-dispatcher-2] [akka://default/user/$c/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream0#-239227643] to Actor[akka://default/user/$c/stream0#-239227643] was not delivered. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[2015-01-24 04:57:41,842] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,846] WARN Error while fetching metadata [{TopicMetadata for topic 0bee0dff-fca8-4d06-b29f-a75720a3f673 ->
No partition metadata for topic 0bee0dff-fca8-4d06-b29f-a75720a3f673 due to kafka.common.LeaderNotAvailableException}] for topic [0bee0dff-fca8-4d06-b29f-a75720a3f673]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:41,850] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(0bee0dff-fca8-4d06-b29f-a75720a3f673) (kafka.client.ClientUtils$)
[2015-01-24 04:57:41,855] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,860] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,867] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,877] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,879] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,882] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,884] INFO Property group.id is overridden to 46939788-b6c0-42a0-a4c2-825cf6efc88c (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,885] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,888] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,889] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,891] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:41,893] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:41,895] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:41,899] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@17589d3d (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:41,900] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:41,910] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,911] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,924] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002a, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:41,925] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:41.974] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c] at=start
[2015-01-24 04:57:41,981] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], begin registering consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,001] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], end registering consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,004] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], starting watcher executor thread for consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,008] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], begin rebalancing consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,031] INFO [ConsumerFetcherManager-1422075461925] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:42,032] INFO [ConsumerFetcherManager-1422075461925] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:42,033] INFO [ConsumerFetcherManager-1422075461925] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:42,035] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,036] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,038] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,040] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,059] INFO Consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 rebalancing the following partitions: ArrayBuffer(0) for topic 0bee0dff-fca8-4d06-b29f-a75720a3f673 with consumers: List(46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:42,062] INFO 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:42,075] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0 successfully owned partition 0 for topic 0bee0dff-fca8-4d06-b29f-a75720a3f673 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,077] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], Consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 selected partitions : 0bee0dff-fca8-4d06-b29f-a75720a3f673:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,079] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], end rebalancing consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:42,081] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[INFO] [01/24/2015 04:57:42.088] [default-akka.actor.default-dispatcher-6] [akka://default/user/$c] at=created-streams
[INFO] [01/24/2015 04:57:42.108] [default-akka.actor.default-dispatcher-2] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:42,110] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:42,113] INFO Property client.id is overridden to 46939788-b6c0-42a0-a4c2-825cf6efc88c (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:42,116] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:42,118] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:42,123] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(0bee0dff-fca8-4d06-b29f-a75720a3f673) (kafka.client.ClientUtils$)
[2015-01-24 04:57:42,129] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:42,131] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:42,144] INFO [ConsumerFetcherThread-46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:42,145] INFO [ConsumerFetcherManager-1422075461925] Added fetcher for partitions ArrayBuffer([[0bee0dff-fca8-4d06-b29f-a75720a3f673,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:42,298] INFO [c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712], stopping watcher executor thread for consumer c55cf308-d297-457e-bf7f-ed6aa7e58fb1_precise64-1422075461229-3ea5d712 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:51,973] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:51,991] INFO [ConsumerFetcherManager-1422075461925] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:51,995] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:51,997] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:51,997] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,000] INFO [ConsumerFetcherManager-1422075461925] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,004] INFO [ConsumerFetcherThread-46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:52,015] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], stopping watcher executor thread for consumer 46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,038] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,040] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,040] INFO Property client.id is overridden to 3fde34de-4037-4d6a-a4a6-aaa964d49146 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,042] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,042] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,043] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,044] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,053] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,054] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:57:52,056] INFO [ConsumerFetcherThread-46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:52,057] INFO [ConsumerFetcherManager-1422075461925] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,057] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:52,056] INFO [ConsumerFetcherThread-46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:57:52,062] INFO Session: 0x14b1a26b86a002a closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:52,062] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:52,062] INFO [46939788-b6c0-42a0-a4c2-825cf6efc88c_precise64-1422075461893-48045712], ZKConsumerConnector shutdown completed in 88 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:52.062] [default-akka.actor.default-dispatcher-8] [ActorSystem(default)] at=consumer-stopped
[2015-01-24 04:57:52,066] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,067] INFO Property auto.commit.enable is overridden to false (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,068] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,070] INFO Property consumer.timeout.ms is overridden to 400 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,072] INFO Property group.id is overridden to 394f5c0b-b348-4fcf-87a2-ba2730fba516 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,073] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,075] INFO Property zookeeper.connection.timeout.ms is overridden to 10000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,076] INFO Property zookeeper.session.timeout.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,081] INFO Property zookeeper.sync.time.ms is overridden to 1000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,088] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,096] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=1000 watcher=org.I0Itec.zkclient.ZkClient@6e73a35c (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:57:52,109] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:52,110] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:52,112] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002b, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:57:52,116] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:57:52,116] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[INFO] [01/24/2015 04:57:52.118] [default-akka.actor.default-dispatcher-3] [akka://default/user/$c] at=start
[2015-01-24 04:57:52,119] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], begin registering consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,132] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], end registering consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,135] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], starting watcher executor thread for consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,140] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(4f868d4a-2ae4-43bc-adad-00d3578379af) (kafka.client.ClientUtils$)
[2015-01-24 04:57:52,142] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,142] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], begin rebalancing consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,152] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,153] WARN Error while fetching metadata [{TopicMetadata for topic 4f868d4a-2ae4-43bc-adad-00d3578379af ->
No partition metadata for topic 4f868d4a-2ae4-43bc-adad-00d3578379af due to kafka.common.LeaderNotAvailableException}] for topic [4f868d4a-2ae4-43bc-adad-00d3578379af]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:57:52,154] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(4f868d4a-2ae4-43bc-adad-00d3578379af) (kafka.client.ClientUtils$)
[2015-01-24 04:57:52,224] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,226] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,228] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Topic info for path /brokers/topics/4f868d4a-2ae4-43bc-adad-00d3578379af changed to {"version":1,"partitions":{"0":[1]}}, triggering rebalance (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,230] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,241] INFO [ConsumerFetcherManager-1422075472117] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,242] INFO [ConsumerFetcherManager-1422075472117] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,244] INFO [ConsumerFetcherManager-1422075472117] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,245] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,246] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,247] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,248] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,266] INFO Consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 rebalancing the following partitions: ArrayBuffer(0) for topic 4f868d4a-2ae4-43bc-adad-00d3578379af with consumers: List(394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:52,268] INFO 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:52,284] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0 successfully owned partition 0 for topic 4f868d4a-2ae4-43bc-adad-00d3578379af (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,286] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 selected partitions : 4f868d4a-2ae4-43bc-adad-00d3578379af:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,287] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], end rebalancing consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,289] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], begin rebalancing consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:57:52.292] [default-akka.actor.default-dispatcher-3] [akka://default/user/$c] at=created-streams
[INFO] [01/24/2015 04:57:52.294] [default-akka.actor.default-dispatcher-3] [ActorSystem(default)] at=consumer-started
[2015-01-24 04:57:52,317] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,323] INFO [ConsumerFetcherManager-1422075472117] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,327] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,326] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,330] INFO Property client.id is overridden to 394f5c0b-b348-4fcf-87a2-ba2730fba516 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,332] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,332] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,335] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(4f868d4a-2ae4-43bc-adad-00d3578379af) (kafka.client.ClientUtils$)
[2015-01-24 04:57:52,336] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,337] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,343] WARN Fetching topic metadata with correlation id 0 for topics [Set(4f868d4a-2ae4-43bc-adad-00d3578379af)] from broker [id:1,host:192.168.86.10,port:9092] failed (kafka.client.ClientUtils$)
java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:100)
at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:73)
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:72)
at kafka.producer.SyncProducer.send(SyncProducer.scala:113)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:93)
at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)
[2015-01-24 04:57:52,346] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,356] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,356] INFO [ConsumerFetcherManager-1422075472117] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,357] INFO [ConsumerFetcherManager-1422075472117] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,357] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,357] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,358] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,358] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,364] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,385] INFO Consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 rebalancing the following partitions: ArrayBuffer(0) for topic 4f868d4a-2ae4-43bc-adad-00d3578379af with consumers: List(394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:52,387] INFO 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:57:52,393] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0 successfully owned partition 0 for topic 4f868d4a-2ae4-43bc-adad-00d3578379af (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,394] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], Consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 selected partitions : 4f868d4a-2ae4-43bc-adad-00d3578379af:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,395] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], end rebalancing consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:57:52,397] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:57:52,403] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,405] INFO Property client.id is overridden to 394f5c0b-b348-4fcf-87a2-ba2730fba516 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,406] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,407] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:57:52,409] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(4f868d4a-2ae4-43bc-adad-00d3578379af) (kafka.client.ClientUtils$)
[2015-01-24 04:57:52,411] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,414] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:57:52,418] INFO [ConsumerFetcherManager-1422075472117] Added fetcher for partitions ArrayBuffer([[4f868d4a-2ae4-43bc-adad-00d3578379af,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:57:52,418] INFO [ConsumerFetcherThread-394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[INFO] [01/24/2015 04:57:58.254] [default-akka.actor.default-dispatcher-2] [akka://default/user/$c] at=recieve-timeout outstanding=0 batch-size=50
[2015-01-24 04:58:01,264] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:01,278] INFO [ConsumerFetcherManager-1422075472117] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:01,280] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:01,284] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:01,284] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:01,287] INFO [ConsumerFetcherManager-1422075472117] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:01,288] INFO [ConsumerFetcherThread-394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:01,323] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:58:01,325] INFO [ConsumerFetcherThread-394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:01,325] INFO [ConsumerFetcherThread-394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:01,328] INFO [ConsumerFetcherManager-1422075472117] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:01,330] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:01,333] INFO Session: 0x14b1a26b86a002b closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:01,334] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:01,333] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], ZKConsumerConnector shutdown completed in 67 ms (kafka.consumer.ZookeeperConsumerConnector)
[INFO] [01/24/2015 04:58:01.338] [default-akka.actor.default-dispatcher-9] [ActorSystem(default)] at=consumer-stopped
[INFO] [01/24/2015 04:58:01.339] [default-akka.actor.default-dispatcher-9] [akka://default/user/$c/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream0#1638573138] to Actor[akka://default/user/$c/stream0#1638573138] was not delivered. [1] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[INFO] [01/24/2015 04:58:01.339] [default-akka.actor.default-dispatcher-9] [akka://default/user/$c/stream0] Message [akka.dispatch.sysmsg.Terminate] from Actor[akka://default/user/$c/stream0#1638573138] to Actor[akka://default/user/$c/stream0#1638573138] was not delivered. [2] dead letters encountered. This logging can be turned off or adjusted with configuration settings 'akka.log-dead-letters' and 'akka.log-dead-letters-during-shutdown'.
[2015-01-24 04:58:01,399] INFO [394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565], stopping watcher executor thread for consumer 394f5c0b-b348-4fcf-87a2-ba2730fba516_precise64-1422075472087-a3015565 (kafka.consumer.ZookeeperConsumerConnector)
AkkaKafkaSpec [37m[0m
[37m[0m [37m[0m
[37m[0m [37mSimple Producer and AkkaConsumer should[0m [37m[0m
[37m[0m [32m+[0m send string to broker and consume that string back [37m[0m
[37m[0m [32m+[0m send 100 messages to broker and consume them back in different consumer groups [37m[0m
[37m[0m [32m+[0m work fine with topic filters [37m[0m
[37m[0m [37m[0m
[37m[0m [37mAkkaProducer and AkkaConsumer should[0m [37m[0m
[37m[0m [32m+[0m send 100 messages with Akka producer and consume them back [37m[0m
[37m[0m [37m[0m
[37m[0m [37mAkkaProducer and AkkaBatchConsumer should[0m [37m[0m
[37m[0m [32m+[0m send and receive 100 messages in one batch [37m[0m
[37m[0m [32m+[0m ensure that non-full batches won't be received until batch timeout comes [37m[0m
[37m[0m [37m[0m
[37m[0m [37m[0m
[37m[0m Total for specification AkkaKafkaSpec
[34mFinished in 29 seconds, 439 ms[0m
[34m[0m[34m6 examples, 0 failure, 0 error[0m
[2015-01-24 04:58:02,314] INFO starting sample broker testing (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,316] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,317] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,318] INFO Property client.id is overridden to 2262f1a4-d9ac-47d1-8076-0b2b7b78233f (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,319] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,320] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,321] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,322] INFO starting sample broker testing (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,322] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,324] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,325] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,325] INFO Property client.id is overridden to dbe70e25-2d3f-4c24-89f4-503f5adb5bfe (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,326] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,327] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,327] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,328] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,325] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,329] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,334] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,336] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,338] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(3efd8876-71ac-463c-9787-baf3ddd92dfe) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,346] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,348] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,361] WARN Error while fetching metadata [{TopicMetadata for topic 89698b13-c18d-4644-b884-2b54ae408f0d ->
No partition metadata for topic 89698b13-c18d-4644-b884-2b54ae408f0d due to kafka.common.LeaderNotAvailableException}] for topic [89698b13-c18d-4644-b884-2b54ae408f0d]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:58:02,364] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,374] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,380] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,382] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,384] WARN Error while fetching metadata [{TopicMetadata for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe ->
No partition metadata for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe due to kafka.common.LeaderNotAvailableException}] for topic [3efd8876-71ac-463c-9787-baf3ddd92dfe]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:58:02,385] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(3efd8876-71ac-463c-9787-baf3ddd92dfe) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,386] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,384] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,395] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,396] WARN Error while fetching metadata [{TopicMetadata for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe ->
No partition metadata for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe due to kafka.common.LeaderNotAvailableException}] for topic [3efd8876-71ac-463c-9787-baf3ddd92dfe]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:58:02,397] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: 3efd8876-71ac-463c-9787-baf3ddd92dfe (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:58:02,398] INFO Back off for 100 ms before retrying send. Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
[2015-01-24 04:58:02,425] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,426] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,426] INFO Property group.id is overridden to 7dc70fd8-1f88-413c-955f-5a9b24cae099 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,427] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,431] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,436] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@4f6c14e7 (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:02,436] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:02,439] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,440] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,443] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002c, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,444] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2015-01-24 04:58:02,449] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], starting auto committer every 60000 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,461] INFO setup:start topic=89698b13-c18d-4644-b884-2b54ae408f0d for zk=192.168.86.5:2181 and groupId=7dc70fd8-1f88-413c-955f-5a9b24cae099 (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,475] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], begin registering consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,489] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], end registering consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,497] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], starting watcher executor thread for consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,500] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 2 for 1 topic(s) Set(3efd8876-71ac-463c-9787-baf3ddd92dfe) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,503] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,504] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], begin rebalancing consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,505] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,514] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,521] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,526] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,528] INFO Property group.id is overridden to e021b030-547b-437d-be50-172c5016383d (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,532] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,534] INFO [ConsumerFetcherManager-1422075482444] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,536] INFO [ConsumerFetcherManager-1422075482444] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,539] INFO [ConsumerFetcherManager-1422075482444] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,541] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,543] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,545] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,546] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,553] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@208c5a4f (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:02,554] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:02,556] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,559] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,565] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,568] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002d, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,569] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2015-01-24 04:58:02,572] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], starting auto committer every 60000 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,575] INFO setup:start topic=3efd8876-71ac-463c-9787-baf3ddd92dfe for zk=192.168.86.5:2181 and groupId=e021b030-547b-437d-be50-172c5016383d (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,583] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], begin registering consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,586] INFO Consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e rebalancing the following partitions: ArrayBuffer(0) for topic 89698b13-c18d-4644-b884-2b54ae408f0d with consumers: List(7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,588] INFO 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,596] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], end registering consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,603] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], starting watcher executor thread for consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,605] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0 successfully owned partition 0 for topic 89698b13-c18d-4644-b884-2b54ae408f0d (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,609] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e selected partitions : 89698b13-c18d-4644-b884-2b54ae408f0d:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,611] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], begin rebalancing consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,612] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], end rebalancing consumer 7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,612] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Creating topic event watcher for topics 89698b13-c18d-4644-b884-2b54ae408f0d (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,614] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,625] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], Topics to consume = List(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,632] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,633] INFO Property client.id is overridden to 7dc70fd8-1f88-413c-955f-5a9b24cae099 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,632] INFO setup:complete topic=89698b13-c18d-4644-b884-2b54ae408f0d for zk=192.168.86.5:2181 and groupId=7dc70fd8-1f88-413c-955f-5a9b24cae099 (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,642] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,646] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,649] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,648] INFO KafkaSpec : consumer 1 - is waiting some seconds (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,652] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,652] INFO [ConsumerFetcherManager-1422075482569] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,656] INFO [ConsumerFetcherManager-1422075482569] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,657] INFO [ConsumerFetcherManager-1422075482569] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,658] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,660] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,662] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,658] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,666] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,679] INFO [ConsumerFetcherManager-1422075482444] Added fetcher for partitions ArrayBuffer([[89698b13-c18d-4644-b884-2b54ae408f0d,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,681] INFO [ConsumerFetcherThread-7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,686] INFO reading on stream now (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,701] INFO Consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 rebalancing the following partitions: ArrayBuffer(0) for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe with consumers: List(e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,705] INFO writing from stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,704] INFO e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,713] INFO testMessage 1 = b4612ed4-793d-4974-b417-4fbe7de10190 and consumed message 1 = b4612ed4-793d-4974-b417-4fbe7de10190 (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,724] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0 successfully owned partition 0 for topic 3efd8876-71ac-463c-9787-baf3ddd92dfe (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,726] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 selected partitions : 3efd8876-71ac-463c-9787-baf3ddd92dfe:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,727] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,737] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], end rebalancing consumer e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,738] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Creating topic event watcher for topics 3efd8876-71ac-463c-9787-baf3ddd92dfe (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,738] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,748] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], Topics to consume = List(3efd8876-71ac-463c-9787-baf3ddd92dfe) (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,749] INFO setup:complete topic=3efd8876-71ac-463c-9787-baf3ddd92dfe for zk=192.168.86.5:2181 and groupId=e021b030-547b-437d-be50-172c5016383d (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,755] INFO Shutting down topic event watcher. (kafka.consumer.ZookeeperTopicEventWatcher)
[2015-01-24 04:58:02,758] INFO KafkaSpec is waiting some seconds (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,759] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,761] INFO Property client.id is overridden to e021b030-547b-437d-be50-172c5016383d (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,764] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,765] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,766] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(3efd8876-71ac-463c-9787-baf3ddd92dfe) (kafka.client.ClientUtils$)
[2015-01-24 04:58:02,767] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,769] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:02,772] INFO reading on stream now (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,774] INFO [ConsumerFetcherManager-1422075482569] Added fetcher for partitions ArrayBuffer([[3efd8876-71ac-463c-9787-baf3ddd92dfe,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,777] INFO [ConsumerFetcherThread-e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,779] INFO [ConsumerFetcherManager-1422075482444] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,780] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,781] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,782] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,785] INFO writing from stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,788] INFO [ConsumerFetcherManager-1422075482444] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,790] INFO [ConsumerFetcherThread-7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,796] INFO testMessage = 632dc03f-1fdf-43c8-9067-336aadcc0249 and consumed message = 632dc03f-1fdf-43c8-9067-336aadcc0249 (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,801] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:58:02,802] INFO [ConsumerFetcherThread-7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,802] INFO [ConsumerFetcherThread-7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,804] INFO [ConsumerFetcherManager-1422075482444] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,814] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,816] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:02,820] INFO Session: 0x14b1a26b86a002c closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:02,820] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,822] INFO [7dc70fd8-1f88-413c-955f-5a9b24cae099_precise64-1422075482431-a2aa901e], ZKConsumerConnector shutdown completed in 93 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,835] INFO written to stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,843] INFO KafkaSpec : consumer 1 - consumed (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,843] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,845] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,846] INFO Property group.id is overridden to 6ffab4dc-4df8-4f96-99dd-e7c5460115f6 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,847] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:02,849] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,851] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@5f996bbd (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:02,852] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:02,853] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,859] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,853] INFO Shutting down topic event watcher. (kafka.consumer.ZookeeperTopicEventWatcher)
[2015-01-24 04:58:02,861] INFO [ConsumerFetcherManager-1422075482569] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,866] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002e, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,863] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,867] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,868] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:02,873] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2015-01-24 04:58:02,872] INFO [ConsumerFetcherManager-1422075482569] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,876] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], starting auto committer every 60000 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,874] INFO [ConsumerFetcherThread-e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,878] INFO setup:start topic=89698b13-c18d-4644-b884-2b54ae408f0d for zk=192.168.86.5:2181 and groupId=6ffab4dc-4df8-4f96-99dd-e7c5460115f6 (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,890] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], begin registering consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,887] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:58:02,900] INFO [ConsumerFetcherThread-e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,900] INFO [ConsumerFetcherThread-e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:02,902] INFO [ConsumerFetcherManager-1422075482569] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,909] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], end registering consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,910] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], starting watcher executor thread for consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,915] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:02,918] INFO Session: 0x14b1a26b86a002d closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:02,918] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:02,918] INFO [e021b030-547b-437d-be50-172c5016383d_precise64-1422075482543-9d1c1be7], ZKConsumerConnector shutdown completed in 102 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,920] INFO written to stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:02,918] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], begin rebalancing consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,930] INFO KafkaSpec consumed (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,946] INFO [ConsumerFetcherManager-1422075482875] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,947] INFO [ConsumerFetcherManager-1422075482875] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,949] INFO [ConsumerFetcherManager-1422075482875] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:02,950] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,952] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,953] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,955] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,974] INFO Consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 rebalancing the following partitions: ArrayBuffer(0) for topic 89698b13-c18d-4644-b884-2b54ae408f0d with consumers: List(6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0) (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,976] INFO 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0 attempting to claim partition 0 (kafka.consumer.RangeAssignor)
[2015-01-24 04:58:02,986] INFO starting sample broker testing (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:02,990] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0 successfully owned partition 0 for topic 89698b13-c18d-4644-b884-2b54ae408f0d (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,992] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 selected partitions : 89698b13-c18d-4644-b884-2b54ae408f0d:0: fetched offset = -1: consumed offset = -1 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,994] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], end rebalancing consumer 6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453 try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,994] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Creating topic event watcher for topics 89698b13-c18d-4644-b884-2b54ae408f0d (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:02,997] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:03,005] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], Topics to consume = List(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,006] INFO setup:complete topic=89698b13-c18d-4644-b884-2b54ae408f0d for zk=192.168.86.5:2181 and groupId=6ffab4dc-4df8-4f96-99dd-e7c5460115f6 (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:03,009] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,011] INFO Property client.id is overridden to 6ffab4dc-4df8-4f96-99dd-e7c5460115f6 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,012] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,013] INFO Property request.timeout.ms is overridden to 30000 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,016] INFO Fetching metadata from broker id:1,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(89698b13-c18d-4644-b884-2b54ae408f0d) (kafka.client.ClientUtils$)
[2015-01-24 04:58:03,016] INFO starting sample broker testing (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,017] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,024] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,028] INFO KafkaSpec : consumer 2 - is waiting some seconds (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,032] INFO [ConsumerFetcherThread-6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0-1], Starting (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:03,034] INFO [ConsumerFetcherManager-1422075482875] Added fetcher for partitions ArrayBuffer([[89698b13-c18d-4644-b884-2b54ae408f0d,0], initOffset -1 to broker id:1,host:192.168.86.10,port:9092] ) (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,036] INFO starting sample broker testing (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,043] INFO reading on stream now (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:03,045] INFO writing from stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:03,052] INFO starting akka producertesting (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,059] INFO testMessage 2 = b4612ed4-793d-4974-b417-4fbe7de10190 and consumed message 2 = b4612ed4-793d-4974-b417-4fbe7de10190 (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,081] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,096] INFO Shutting down topic event watcher. (kafka.consumer.ZookeeperTopicEventWatcher)
[2015-01-24 04:58:03,098] INFO [ConsumerFetcherManager-1422075482875] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,099] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:03,103] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:03,103] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)
[2015-01-24 04:58:03,106] INFO [ConsumerFetcherManager-1422075482875] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,108] INFO [ConsumerFetcherThread-6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0-1], Shutting down (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:03,143] INFO Reconnect due to socket error: java.nio.channels.ClosedByInterruptException (kafka.consumer.SimpleConsumer)
[2015-01-24 04:58:03,143] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,145] INFO [ConsumerFetcherThread-6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0-1], Shutdown completed (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:03,147] INFO [ConsumerFetcherManager-1422075482875] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,145] INFO [ConsumerFetcherThread-6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453-0-1], Stopped (kafka.consumer.ConsumerFetcherThread)
[2015-01-24 04:58:03,151] INFO Property auto.offset.reset is overridden to smallest (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,156] INFO Property group.id is overridden to 143e4a37-782e-4610-846e-2293220efbcb (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,159] INFO Property zookeeper.connect is overridden to 192.168.86.5:2181 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,162] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:03,164] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], Connecting to zookeeper instance at 192.168.86.5:2181 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,166] INFO Initiating client connection, connectString=192.168.86.5:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@7519ca2c (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:03,167] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2015-01-24 04:58:03,167] INFO Opening socket connection to server 192.168.86.5/192.168.86.5:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration) (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:03,168] INFO Socket connection established to 192.168.86.5/192.168.86.5:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:03,172] INFO Session: 0x14b1a26b86a002e closed (org.apache.zookeeper.ZooKeeper)
[2015-01-24 04:58:03,172] INFO Session establishment complete on server 192.168.86.5/192.168.86.5:2181, sessionid = 0x14b1a26b86a002f, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:03,172] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn)
[2015-01-24 04:58:03,172] INFO [6ffab4dc-4df8-4f96-99dd-e7c5460115f6_precise64-1422075482849-26e81453], ZKConsumerConnector shutdown completed in 89 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,174] INFO written to stream (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:03,176] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2015-01-24 04:58:03,176] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], starting auto committer every 60000 ms (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,180] INFO setup:start topic=43608691-c943-4d6f-a7c3-e7dd61291739 for zk=192.168.86.5:2181 and groupId=143e4a37-782e-4610-846e-2293220efbcb (kafka.consumer.KafkaConsumer)
[2015-01-24 04:58:03,186] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], begin registering consumer 143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,192] INFO Verifying properties (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,194] INFO Property batch.num.messages is overridden to 200 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,195] INFO Property client.id is overridden to 6b5f37ae-1fef-44e8-9572-5fad5a82ca60 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,197] INFO Property compression.codec is overridden to 1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,198] INFO Property message.send.max.retries is overridden to 3 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,201] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], end registering consumer 143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,204] INFO KafkaSpec : consumer 2 - consumed (ly.stealth.testing.KafkaSpec)
[2015-01-24 04:58:03,201] INFO Property metadata.broker.list is overridden to 192.168.86.10:9092 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,206] INFO Property producer.type is overridden to sync (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,208] INFO Property request.required.acks is overridden to -1 (kafka.utils.VerifiableProperties)
[2015-01-24 04:58:03,208] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], begin rebalancing consumer 143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,204] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], starting watcher executor thread for consumer 143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,222] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 0 for 1 topic(s) Set(43608691-c943-4d6f-a7c3-e7dd61291739) (kafka.client.ClientUtils$)
[2015-01-24 04:58:03,229] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,241] INFO [ConsumerFetcherManager-1422075483176] Stopping leader finder thread (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,244] INFO [ConsumerFetcherManager-1422075483176] Stopping all fetchers (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,248] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,252] WARN Error while fetching metadata [{TopicMetadata for topic 43608691-c943-4d6f-a7c3-e7dd61291739 ->
No partition metadata for topic 43608691-c943-4d6f-a7c3-e7dd61291739 due to kafka.common.LeaderNotAvailableException}] for topic [43608691-c943-4d6f-a7c3-e7dd61291739]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)
[2015-01-24 04:58:03,253] INFO Fetching metadata from broker id:0,host:192.168.86.10,port:9092 with correlation id 1 for 1 topic(s) Set(43608691-c943-4d6f-a7c3-e7dd61291739) (kafka.client.ClientUtils$)
[2015-01-24 04:58:03,256] INFO Connected to 192.168.86.10:9092 for producing (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,249] INFO [ConsumerFetcherManager-1422075483176] All connections stopped (kafka.consumer.ConsumerFetcherManager)
[2015-01-24 04:58:03,264] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], Cleared all relevant queues for this fetcher (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,266] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], Cleared the data chunks in all the consumer message iterators (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,267] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], Committing all offsets after clearing the fetcher queues (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,268] INFO [143e4a37-782e-4610-846e-2293220efbcb_precise64-1422075483164-c9cc103a], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConnector)
[2015-01-24 04:58:03,310] INFO Disconnecting from 192.168.86.10:9092 (kafka.producer.SyncProducer)
[2015-01-24 04:58:03,314] WARN Error while fetching metadata [{TopicMetadata for topic 43608691-c943-4d6f-a7c3-e7dd61291739 ->
No partition metadata for topic 43608691-c943-4d6f-a7c3-e7dd61291739 due to kafka.common.LeaderNotAvailableException}] for topic [43608691-c943-4d6f-a7c3-e7dd61291739]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo)