-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Python bokeh graph ui #4
base: master
Are you sure you want to change the base?
Conversation
…aration kafa producer
4bb9eb6
to
8acba38
Compare
@@ -50,23 +67,32 @@ RUN \ | |||
&& pip3 install kafka-python==1.3.2 \ | |||
&& pip3 install bokeh==0.12.4 | |||
|
|||
# Create a directory to | |||
RUN mkdir ~/.ssh | |||
COPY ./config/ssh_config .ssh/config |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why is this needed ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
git reads the keys from the .ssh folder from your home folder . Hence we need to have the ssh keys in that folder in order to execute the next command . I am using this branch for D3 and flask development .
# Sbt | ||
# git clone during image build and setting enviroment variables | ||
cd ~ \ | ||
&& git clone https://[email protected]/abgoswam/streamai |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
https://github.com/abgoswam/streamaiis it the same as doing git clone on base URL i.e. 'git clone https://github.com/abgoswam/streamai'
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
there is a failure at this step..
Step 10/13 : COPY ./config/ssh_config .ssh/config lstat config/ssh_config: no such file or directoryThere was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok thanks , its not happening to me . I will look at it
cd ~ \ | ||
&& wget http://apache.claz.org/kafka/${KAFKA_CLIENT_VERSION}/kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz \ | ||
&& tar -xvzf kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz \ | ||
&& rm kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz | ||
|
||
|
||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I thought you said that in to docker file you will also start zookeeper and kafka... (right now we do that by running the file 'streamai/binsc/setup/RUNME_ONCE.sh')... I dont see you starting the contents in the RUNME_ONCE.sh file
could you clarify ? am i missing something ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I removed the code that was starting kafka ,zookeeper and spark . Keep your work flow going as it is for now . I will add that code back with docker compose . We don't want all in the same container when you run on ECS
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if possible lets put 'streamai/binsc/setup/RUNME_ONCE.sh' in the docker file so that kafka and zookeeper start by default when we spin up new container
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
trial run did not go through.. check your changes..i have provided som ecomments...
Summary