to Behzad Bordbar (internal) (privately):

good morning
from Behzad Bordbar (internal) (privately):
Good morning
from anup goel to Everyone:
yes
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) (privately):
Can you hear me stefano and eleonora?
from Behzad Bordbar (internal) to Everyone:
Eleonora and Stefano, can you hear me?
from anup goel to Everyone:
is Kafka ser vice already running?
from Behzad Bordbar (internal) to Everyone:
You can check that by
from Behzad Bordbar (internal) to Everyone:
sudo service kafka-server status
from Behzad Bordbar (internal) to Everyone:
please check
from Behzad Bordbar (internal) to Everyone:
you can start and stop and restart
from Behzad Bordbar (internal) to Everyone:
for example
from anup goel to Everyone:
sure
from anup goel to Everyone:
i am getting an exception when i am starting kafka consumer console
from Behzad Bordbar (internal) (privately):
please use two terminal
from anup goel to Everyone:
kafka.common.NotLeaderForPartitionException
from Behzad Bordbar (internal) (privately):
terminals
from anup goel to Everyone:
yes am using 2 different tabs
from Behzad Bordbar (internal) (privately):
please check if zookeeper is running
from anup goel to Everyone:
Failed to add leader for partitions [weblogs,0]; will retry (kafka.consumer.Cons
umerFetcherManager$LeaderFinderThread)
from anup goel to Everyone:
both are up
from Behzad Bordbar (internal) (privately):
how about we restart
from anup goel to Everyone:
sure
from anup goel to Everyone:
when i did zookeper start, it started successfully
from Behzad Bordbar (internal) (privately):
I am looking at your vm
from Behzad Bordbar (internal) (privately):
is that OK?
from anup goel to Everyone:
sure
from anup goel to Everyone:
please go ahead
from anup goel to Everyone:
when i started kafka server it failed with error as: Kafka Server is dead and p
id file exists
from Behzad Bordbar (internal) (privately):
please stop kafka server
from Behzad Bordbar (internal) (privately):
and then stop
from Behzad Bordbar (internal) (privately):
By the way did you run the script at the beginning
from anup goel to Everyone:
no we did not run the catchup script
from Behzad Bordbar (internal) (privately):
different keyboard layout for me
from Behzad Bordbar (internal) (privately):
OK
from anup goel to Everyone:
i am trying to stop kafka first n then start
from anup goel to Everyone:
will update you
from Behzad Bordbar (internal) (privately):
OK
from Behzad Bordbar (internal) (privately):
an alternative is to start with a new vm
from anup goel to Everyone:
it started now :)
from anup goel to Everyone:
which script?
from anup goel to Everyone:
sure i am trying
to Behzad Bordbar (internal) (privately):
i have created the topic already
to Behzad Bordbar (internal) (privately):
i am starting the producer and consumer now
to Behzad Bordbar (internal) (privately):
yes its working
to Behzad Bordbar (internal) (privately):
:)
to Behzad Bordbar (internal) (privately):
thank you
from anup goel to Everyone:
Where do we compress and encrypt data?
from anup goel to Everyone:
is it flume interceptors?
from anup goel to Everyone:
yes
from anup goel to Everyone:
yes
from Eleonora to Everyone:
ok
from anup goel to Everyone:
speed is ok
from anup goel to Everyone:
could you explain avro source please
from anup goel to Everyone:
i guess it is used mainly for multiplexing
from anup goel to Everyone:
i am good
from anup goel to Everyone:
yes
from anup goel to Everyone:
yes sure
from Behzad Bordbar (internal) to Everyone:
How is it going? Who has finished the exercise?
from anup goel to Everyone:
finished
from anup goel to Everyone:
returned from break
from Behzad Bordbar (internal) to Everyone:
Well done!
from anup goel to Everyone:
I cant hear you , Are you on mute?
from Eleonora to Everyone:
yes
from Eleonora to Everyone:
both of us
from anup goel to Everyone:
yes
from Eleonora to Everyone:
go on
from anup goel to Everyone:
does kafka channel ensures 0 loss of events ?
from anup goel to Everyone:
ye sthanks
from anup goel to Everyone:
I am done with exercies
from Behzad Bordbar (internal) to Everyone:
Awesome :-)
from Behzad Bordbar (internal) to Everyone:
welldone, very strong class
from Behzad Bordbar (internal) to Everyone:
:-)
from anup goel to Everyone:
:)
from Eleonora to Everyone:
ok
from Eleonora to Everyone:
behinde the pdf
from Eleonora to Everyone:
ok
from Eleonora to Everyone:
yes
from anup goel to Everyone:
yes my team is in progress
from Behzad Bordbar (internal) to Everyone:
is the example clear?
from Eleonora to Everyone:
clear
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) to Everyone:
lambda (x, y ): (y,x)
from anup goel to Everyone:
no
from Eleonora to Everyone:
no
from anup goel to Everyone:
what is the most optimal time in seconds given to the StreaminContext
from anup goel to Everyone:
?
from Behzad Bordbar (internal) to Everyone:
0.5 sec
from anup goel to Everyone:
Does it depends on size of data?
from Behzad Bordbar (internal) to Everyone:
size + duration of your operation
from anup goel to Everyone:
thanks
from Eleonora to Everyone:
what if the time ends up before the streaming's end?
from Eleonora to Everyone:
time= duration
from Behzad Bordbar (internal) to Everyone:
Do you mean no more data?
from Eleonora to Everyone:
i mean that the last record it's not received entirely
from Eleonora to Everyone:
if I receive data from a socket
from Eleonora to Everyone:
we are talking about it...
from Eleonora to Everyone:
if I read a stream from a socket then can it happen that the last record it is n
ot received completely?
from anup goel to Everyone:
what happens oif we keep smaller window and data is huge in volume?
from anup goel to Everyone:
Could you please state teh same example again?
from anup goel to Everyone:
yes
from anup goel to Everyone:
it answers very well
from anup goel to Everyone:
yes
from anup goel to Everyone:
please
from Eleonora to Everyone:
yes
from Behzad Bordbar (internal) to Everyone:
shall we say 15 minutes
from Behzad Bordbar (internal) to Everyone:
?
from Eleonora to Everyone:
we've done
from Eleonora to Everyone:
just a question
from Behzad Bordbar (internal) to Everyone:
anup have you finished?
from anup goel to Everyone:
yes done
from Eleonora to Everyone:
we stop the s
from anup goel to Everyone:
please go ahead
from Behzad Bordbar (internal) to Everyone:
well done very strong class
from Behzad Bordbar (internal) to Everyone:
impressive :-)
from Eleonora to Everyone:
we stop the test
from Eleonora to Everyone:
we stop the testscript
from Eleonora to Everyone:
tand
from Eleonora to Everyone:
then we look at the spark application and we had a lot of connection errot...rig
ht?!
from Eleonora to Everyone:
then we stopped the spark application and we had an erro in awaitTermination()
from Eleonora to Everyone:
sure
from Eleonora to Everyone:
ok
from Eleonora to Everyone:
I'm starting the test script...
from anup goel to Everyone:
sure
from anup goel to Everyone:
evening snack for us
from Eleonora to Everyone:
start the application
from Behzad Bordbar (internal) (privately):
indeed, evening snack. I hope that you are not too tired.
from Behzad Bordbar (internal) (privately):
`Hopefully we will finish a bit earlier tonight. The class is strong and the exe
rcises are completed ahed of time.
from Behzad Bordbar (internal) (privately):
Good job :-)
from anup goel to Everyone:
yeah sure
to Behzad Bordbar (internal) (privately):
not tired at all
to Behzad Bordbar (internal) (privately):
yes
from Eleonora to Everyone:
yes
from Eleonora to Everyone:
yes
from Eleonora to Everyone:
both things
from anup goel to Everyone:
yes
from anup goel to Everyone:
both
from Behzad Bordbar (internal) (privately):
is this clear?
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) (privately):
is the use case clear?
from anup goel to Everyone:
yes
from Eleonora to Everyone:
yes
from Eleonora to Everyone:
yes
from anup goel to Everyone:
why newCounts is a list?
from Behzad Bordbar (internal) (privately):
yes
from anup goel to Everyone:
the state Dstream could grow in size? how can we optimize it?
from anup goel to Everyone:
no i
from anup goel to Everyone:
am good
from anup goel to Everyone:
thanks :)
from Eleonora to Everyone:
yes
from Eleonora to Everyone:
thanks
from Behzad Bordbar (internal) (privately):
Did I answer your question Eleornora?
from anup goel to Everyone:
no
from Eleonora to Everyone:
nope
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) (privately):
shall we start?
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) (privately):
Anup, how is it going? completed the exercise?
from Eleonora to Everyone:
5 min for the bonus pls
from anup goel to Everyone:
done with exercies
from anup goel to Everyone:
doing bonus
from Behzad Bordbar (internal) (privately):
14:10
from Behzad Bordbar (internal) (privately):
Excellent, very impressive :-)
from Behzad Bordbar (internal) to Everyone:
Excellent, very impressive :-)
from Eleonora to Everyone:
ok
from anup goel to Everyone:
yes
from anup goel to Everyone:
getting this Caused by: py4j.Py4JException: Cannot obtain a new communication ch
annel
from anup goel to Everyone:
on doing bonus exercise any idea?
from anup goel to Everyone:
i have stopped all process
from anup goel to Everyone:
will try and let you know
from anup goel to Everyone:
we can go ahead
from Behzad Bordbar (internal) (privately):
OK, are you sure? I can have a peak at yoru solution
from anup goel to Everyone:
sure
from Behzad Bordbar (internal) (privately):
or may be after this?
from Eleonora to Everyone:
ok
from Eleonora to Everyone:
yes
from Behzad Bordbar (internal) (privately):
who exact one and at least once
from anup goel to Everyone:
no
from anup goel to Everyone:
yes
from anup goel to Everyone:
yes
from Behzad Bordbar (internal) (privately):
Hi Anup
from anup goel to Everyone:
hi
from Behzad Bordbar (internal) (privately):
would you like to finish this exercise first? or do you prefer we discuss the pr
evious bonus
from Behzad Bordbar (internal) (privately):
exercise?
from anup goel to Everyone:
exericse first
from anup goel to Everyone:
will let you know and then wil ldo bonus
from anup goel to Everyone:
is it ok?
from Behzad Bordbar (internal) (privately):
good decision :-)
to Behzad Bordbar (internal) (privately):
done
to Behzad Bordbar (internal) (privately):
can we please see the bonux?
from Behzad Bordbar (internal) (privately):
sure
from Behzad Bordbar (internal) (privately):
may i look at you vm?
to Behzad Bordbar (internal) (privately):
sure please go ahead
from Behzad Bordbar (internal) (privately):
i am there
from Behzad Bordbar (internal) (privately):
go ahead
to Behzad Bordbar (internal) (privately):
slow a little
from Behzad Bordbar (internal) (privately):
you can help the seed by reducing the resultion at the top
from Behzad Bordbar (internal) (privately):
*speed*
to Behzad Bordbar (internal) (privately):
oh i didnt know
from Behzad Bordbar (internal) (privately):
May i click
to Behzad Bordbar (internal) (privately):
sure did yiu see the error
from Behzad Bordbar (internal) (privately):
No i didn't. Please scroll to the error
to Behzad Bordbar (internal) (privately):
sure
to Behzad Bordbar (internal) (privately):
now?
to Behzad Bordbar (internal) (privately):
its is my mistake sorry
to Behzad Bordbar (internal) (privately):
in the code i have misspelled something will correct and let you know
from Behzad Bordbar (internal) (privately):
OK
from Behzad Bordbar (internal) (privately):
please go ahead
to Behzad Bordbar (internal) (privately):
sure
to Behzad Bordbar (internal) (privately):
working
to Behzad Bordbar (internal) (privately):
:)
from Behzad Bordbar (internal) (privately):
excellent
from Behzad Bordbar (internal) (privately):
good job
from Behzad Bordbar (internal) (privately):
btw if you are looking for older commands
from Behzad Bordbar (internal) (privately):
history
to Behzad Bordbar (internal) (privately):
thanks
from Behzad Bordbar (internal) (privately):
then the number of command prepened with !
from Behzad Bordbar (internal) (privately):
for example to run the command 221
from Behzad Bordbar (internal) (privately):
!221
to Behzad Bordbar (internal) (privately):
cool
from Behzad Bordbar (internal) (privately):
or
from Behzad Bordbar (internal) (privately):
!cle
to Behzad Bordbar (internal) (privately):
Behzad, I will be logging of now . Is it good to close this session with few enc
ouraging words ?
from Behzad Bordbar (internal) (privately):
can you please fill in the survey
from Behzad Bordbar (internal) (privately):
Please go to training.cloudera.com and complete the survey
You need your username and password and probably the following info.
Class ID: 6297
Class Key: xUh5pHew
from Behzad Bordbar (internal) (privately):
If you have time
to Behzad Bordbar (internal) (privately):
sure i wil make a note
to Behzad Bordbar (internal) (privately):
no worries
from Behzad Bordbar (internal) (privately):
BTW I sent an email with regards to discount from o'rielly
from Behzad Bordbar (internal) (privately):
hope you have got that too. If not email me
from Behzad Bordbar (internal) (privately):
bordbar@cloudera.com
from Behzad Bordbar (internal) (privately):
it was nice to work with you
to Behzad Bordbar (internal) (privately):
thanks:)