Skip to content

Commit 528a5b5

Browse files
authored
Add files via upload
1 parent 25b8e4b commit 528a5b5

29 files changed

+14277
-0
lines changed

Diff for: after-compose.sh

+14
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
#!/bin/bash
2+
3+
docker exec -it namenode bash -c "hdfs dfs -mkdir /data/ && \
4+
hdfs dfs -chmod 777 /data && \
5+
hdfs dfs -mkdir /data/covid_data && \
6+
hdfs dfs -chmod 777 /data/covid_data && \
7+
hdfs dfs -mkdir /data/kafka_data && \
8+
hdfs dfs -chmod 777 /data/kafka_data"
9+
10+
docker exec -it kafka bash -c "
11+
kafka-topics.sh --bootstrap-server localhost:9094 --create --topic covidin && \
12+
kafka-topics.sh --bootstrap-server localhost:9094 --create --topic covidout"
13+
14+
docker exec -it spark-master bash -c "spark-submit --master spark://spark-master:7077 --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.2.0,org.apache.kafka:kafka-clients:3.2.0 /opt/spark-apps/streaming.py"

Diff for: after-nifi.sh

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
#!/bin/bash
2+
3+
docker exec -it namenode bash -c "hdfs dfs -chmod -R 777 /data/"
4+
5+
docker exec -it spark-master bash -c "service ssh start"
6+
7+
docker exec -it spark-master bash -c "spark-sql -f /opt/spark-apps/createDB.sql"

0 commit comments

Comments
 (0)