Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python bokeh graph ui #4

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

Python bokeh graph ui #4

wants to merge 7 commits into from

Conversation

yogeshgo05
Copy link
Collaborator

Summary

  1. End point to show streaming bokeh plots for line graph in the browser in real time .
  2. End point to read the data from wine file and create a response in a streaming fashion . It uses python generators to yield the data to browser for every send to kafka .

@yogeshgo05 yogeshgo05 force-pushed the python-bokeh-graph-ui branch from 4bb9eb6 to 8acba38 Compare March 13, 2017 08:27
@@ -50,23 +67,32 @@ RUN \
&& pip3 install kafka-python==1.3.2 \
&& pip3 install bokeh==0.12.4

# Create a directory to
RUN mkdir ~/.ssh
COPY ./config/ssh_config .ssh/config
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this needed ?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

git reads the keys from the .ssh folder from your home folder . Hence we need to have the ssh keys in that folder in order to execute the next command . I am using this branch for D3 and flask development .

# Sbt
# git clone during image build and setting enviroment variables
cd ~ \
&& git clone https://[email protected]/abgoswam/streamai
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://github.com/abgoswam/streamaiis it the same as doing git clone on base URL i.e. 'git clone https://github.com/abgoswam/streamai'

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is a failure at this step..

Step 10/13 : COPY ./config/ssh_config .ssh/config lstat config/ssh_config: no such file or directory

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok thanks , its not happening to me . I will look at it

cd ~ \
&& wget http://apache.claz.org/kafka/${KAFKA_CLIENT_VERSION}/kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz \
&& tar -xvzf kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz \
&& rm kafka_${SCALA_MAJOR_VERSION}-${KAFKA_CLIENT_VERSION}.tgz



Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I thought you said that in to docker file you will also start zookeeper and kafka... (right now we do that by running the file 'streamai/binsc/setup/RUNME_ONCE.sh')... I dont see you starting the contents in the RUNME_ONCE.sh file

could you clarify ? am i missing something ?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed the code that was starting kafka ,zookeeper and spark . Keep your work flow going as it is for now . I will add that code back with docker compose . We don't want all in the same container when you run on ECS

Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if possible lets put 'streamai/binsc/setup/RUNME_ONCE.sh' in the docker file so that kafka and zookeeper start by default when we spin up new container

Copy link
Owner

@abgoswam abgoswam left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

trial run did not go through.. check your changes..i have provided som ecomments...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants