Skip to content

Commit 723dcfe

Browse files
author
Kevin Glinski
committed
rename project files to new repo name
1 parent 6d8c9b8 commit 723dcfe

File tree

8 files changed

+18
-18
lines changed

8 files changed

+18
-18
lines changed

.gitignore

+1-1
Original file line numberDiff line numberDiff line change
@@ -8,4 +8,4 @@
88
startDevEnv.sh
99
*.zip
1010
.vscode
11-
aws_glue_etl_jupyter_deploy
11+
aws_glue_etl_docker_deploy

README.md

+6-6
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ This project is a helper for creating scripts that run in both [AWS Glue](https:
55
Glue has specific methods to load and save data to s3 which won't work when running in a jupyter notebook. The glueshim provides a higher level api to work in both scenarios.
66

77
```python
8-
from aws_glue_etl_jupyter import glueshim
8+
from aws_glue_etl_docker import glueshim
99
shim = glueshim.GlueShim()
1010

1111
params = shim.arguments({'data_bucket': "examples"})
@@ -40,7 +40,7 @@ Running locally is easiest in a docker container
4040

4141
```python
4242
import sys
43-
!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_jupyter
43+
!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_docker
4444
```
4545

4646
## AWS Deployment
@@ -55,16 +55,16 @@ The shim is currently setup to delete any data in the output folder so that if y
5555

5656
## Converting Workbook to Python Script
5757

58-
aws_glue_etl_jupyter can also be used as a cli tool to clean up Jupyter metadata from a workbook or convert it to a python script.
58+
aws_glue_etl_docker can also be used as a cli tool to clean up Jupyter metadata from a workbook or convert it to a python script.
5959

6060
## Clean
6161

6262
The clean command will open all workbooks in a given path and remove any metadata, output and execution information. This keeps the workbooks cleaner in source control
6363

64-
``` aws_glue_etl_jupyter clean --path /dir/to/workbooks ```
64+
``` aws_glue_etl_docker clean --path /dir/to/workbooks ```
6565

6666
## Build
6767

68-
The build command will open all workbooks in a given path and convert them to python scripts. Build will convert any markdown cells to multiline comments. This command will not convert any cells that contain ```#LOCALDEV``` or lines that start with ```!``` as in ```!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_jupyter```
68+
The build command will open all workbooks in a given path and convert them to python scripts. Build will convert any markdown cells to multiline comments. This command will not convert any cells that contain ```#LOCALDEV``` or lines that start with ```!``` as in ```!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_docker```
6969

70-
``` aws_glue_etl_jupyter build --path /dir/to/workbooks ```
70+
``` aws_glue_etl_docker build --path /dir/to/workbooks ```
File renamed without changes.
File renamed without changes.
File renamed without changes.

deploytos3.sh

+6-6
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,11 @@
11
#!/usr/bin/env bash
2-
rm -rf aws_glue_etl_jupyter_deploy
3-
mkdir aws_glue_etl_jupyter_deploy
4-
cd aws_glue_etl_jupyter_deploy
5-
echo "git+https://github.com/purecloudlabs/aws_glue_etl_jupyter" > requirements.txt
2+
rm -rf aws_glue_etl_docker_deploy
3+
mkdir aws_glue_etl_docker_deploy
4+
cd aws_glue_etl_docker_deploy
5+
echo "git+https://github.com/purecloudlabs/aws_glue_etl_docker" > requirements.txt
66
mkdir deps
77
virtualenv -p python2.7 .
88
bin/pip2.7 install -r requirements.txt --install-option --install-lib="$(PWD)/deps"
9-
cd deps && zip -r ../aws_glue_etl_jupyter_deploy.zip . && cd ..
10-
aws s3 cp ./aws_glue_etl_jupyter_deploy.zip $1
9+
cd deps && zip -r ../aws_glue_etl_docker_deploy.zip . && cd ..
10+
aws s3 cp ./aws_glue_etl_docker_deploy.zip $1
1111

examples/TestWorkbook.ipynb

+2-2
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@
77
"cell_type": "code",
88
"source": [
99
"import sys\n",
10-
"!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_jupyter.git\n",
10+
"!{sys.executable} -m pip install git+https://github.com/purecloudlabs/aws_glue_etl_docker.git\n",
1111
"# Because the previous line starts with a !, it will be removed from the output py file"
1212
],
1313
"outputs": [],
@@ -24,7 +24,7 @@
2424
"execution_count": 0,
2525
"cell_type": "code",
2626
"source": [
27-
"from aws_glue_etl_jupyter import glueshim\n",
27+
"from aws_glue_etl_docker import glueshim\n",
2828
"\n",
2929
"print(\"starting\")\n",
3030
"print(sys.argv)\n",

setup.py

+3-3
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
from setuptools import setup
22
setup(
3-
name = 'aws_glue_etl_jupyter',
3+
name = 'aws_glue_etl_docker',
44
version = '0.2.0',
5-
packages = ['aws_glue_etl_jupyter'],
5+
packages = ['aws_glue_etl_docker'],
66
license='mit',
77
install_requires = ['boto3'],
88
entry_points = {
99
'console_scripts': [
10-
'aws_glue_etl_jupyter = aws_glue_etl_jupyter.__main__:main'
10+
'aws_glue_etl_docker = aws_glue_etl_docker.__main__:main'
1111
]
1212
})

0 commit comments

Comments
 (0)