Skip to content

New Ray Serve tutorial #3709

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
crypdick wants to merge 29 commits into
base: main
Choose a base branch
from
Open

New Ray Serve tutorial #3709

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
ac21240
initial draft
Nov 14, 2025
b45b2cc
progress
Nov 17, 2025
0c1c18f
formatting
Nov 25, 2025
7f2e70a
bump Ray version
Dec 9, 2025
2b7b560
Create paired tutorial docs
Dec 9, 2025
9a64caa
ignore cursor configs
crypdick Dec 12, 2025
608aa19
add serve to docker reqs
crypdick Dec 12, 2025
9257827
Add completed ray serve tutorial
crypdick Dec 12, 2025
035d4f1
add tutorial to index
crypdick Dec 12, 2025
1f3e44e
unstage ipynb and md
crypdick Dec 12, 2025
6afcd3b
Merge branch 'pytorch:main' into ray-serve-tutorial
crypdick Dec 15, 2025
83e68e7
tmp checkpt
crypdick Dec 18, 2025
fa5d2e0
sync
Dec 18, 2025
7002920
ignore more data files; ignore intermediates
Dec 18, 2025
3d7a1f0
ignore more files
Dec 18, 2025
06378e2
edit gitignore for symlink
Dec 18, 2025
69dfe1c
finalize serving tutorial
Dec 18, 2025
0ac13d6
rm tutorial intermediates
Dec 18, 2025
aa881f3
minor fixes
Dec 18, 2025
091d9ca
clarify expanation of max_ongoing_requests and max_queued_requests
Jan 7, 2026
caa63f9
make linter happy
Jan 7, 2026
ae04c95
Merge branch 'main' into ray-serve-tutorial
crypdick Jan 7, 2026
4f38ddf
add grid cards for 'what you will learn' and prerequisites. Add fault…
Jan 7, 2026
970805c
Merge branch 'main' into ray-serve-tutorial
crypdick Jan 12, 2026
9e68127
Merge branch 'main' into ray-serve-tutorial
crypdick Jan 26, 2026
1e3f1dc
Ignore localhost links Serving tutorial
Jan 26, 2026
239bcd0
fix links
Jan 26, 2026
64a0924
add ray serve logo
Jan 26, 2026
935f12d
bump pydantic requirement to try to override cached pydantic v1 in CI…
Jan 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions .ci/docker/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,8 @@ pytorch_sphinx_theme2==0.3.0
# Tutorial dependencies
tqdm==4.66.1
numpy==1.24.4
pydantic>=2.10
fastapi
matplotlib
librosa
torch==2.10
Expand All @@ -31,8 +33,8 @@ PyHamcrest
bs4
awscliv2==2.1.1
flask
spacy==3.4.1
ray[tune]==2.52.1
spacy>=3.7.0
ray[serve,tune]==2.52.1
tensorboard
jinja2==3.1.3
pytorch-lightning
Expand All @@ -59,6 +61,7 @@ sphinxcontrib.katex
boto3
pandas
requests
aiohttp
scikit-image
scipy==1.11.1
numba==0.57.1
Expand Down
17 changes: 16 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,9 @@ prototype
/unstable
sg_execution_times.rst

#data things
# Datasets
_data/
data/
advanced_source/images/
advanced_source/data/
beginner_source/.data/
Expand Down Expand Up @@ -54,6 +55,7 @@ var/
*.egg-info/
.installed.cfg
*.egg
.git

# PyInstaller
# Usually these files are written by a python script from a template
Expand Down Expand Up @@ -111,6 +113,7 @@ celerybeat-schedule

# virtualenv
venv/
.venv/
ENV/

# Spyder project settings
Expand All @@ -137,3 +140,15 @@ dictionary.dic

# linters
/.lintbin

# Intermediate tutorial files
beginner_source/*/*_tutorial.md
beginner_source/*/*_tutorial.ipynb
intermediate_source/*/*_tutorial.md
intermediate_source/*/*_tutorial.ipynb
advanced_source/*/*_tutorial.md
advanced_source/*/*_tutorial.ipynb
recipes_source/*/*_tutorial.md
recipes_source/*/*_tutorial.ipynb
prototype_source/*/*_tutorial.md
prototype_source/*/*_tutorial.ipynb
4 changes: 4 additions & 0 deletions .lycheeignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,7 @@ http://localhost:6006

# Ignore local host link from advanced_source/cpp_frontend.rst
https://www.uber.com/blog/deep-neuroevolution/

# Ignore localhost links Serving tutorial
http://localhost:8000
http://127.0.0.1:8000
Binary file added _static/img/ray-serve.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading