Skip to content

Commit

Permalink
Proto-X removal (#64)
Browse files Browse the repository at this point in the history
**Summary**: removed everything related to Proto-X from the codebase.

**Details**:
* Proto-X is not going away. It's just going to be in its own submodule.
* Also removed `tune/demo/`.
  • Loading branch information
wangpatrick57 authored Dec 26, 2024
1 parent 3b304aa commit 8227c5e
Show file tree
Hide file tree
Showing 345 changed files with 52 additions and 23,808 deletions.
10 changes: 0 additions & 10 deletions .github/workflows/tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -58,13 +58,3 @@ jobs:
. "$HOME/.cargo/env"
export
./scripts/run_integration_tests.sh
# - name: Run end-to-end tests
# # End-to-end tests are like integration tests in that they require external systems to be running.
# # Unlike integration tests though, they don't perform detailed checks for any individual module.
# #
# # Note that we need to run with a non-root user in order to start Postgres. This is configured in the .yaml
# # file for our self-hosted GHA runners.
# run: |
# . "$HOME/.cargo/env"
# python -m scripts.run_protox_e2e_test ssd
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,6 @@ The tasks are grouped into categories that correspond to the top-level directori

- `benchmark` - tasks to generate data and queries for different benchmarks (e.g., TPC-H, JOB)
- `dbms` - tasks to build and start DBMSs (e.g., PostgreSQL)
- `tune` - tasks to train autonomous database tuning agents

## Credits

Expand Down
Empty file removed analyze/__init__.py
Empty file.
79 changes: 0 additions & 79 deletions analyze/cli.py

This file was deleted.

Empty file removed analyze/tests/__init__.py
Empty file.
Binary file removed analyze/tests/unittest_analysis_files/out.tfevents
Binary file not shown.
31 changes: 0 additions & 31 deletions analyze/tests/unittest_analyze.py

This file was deleted.

2 changes: 1 addition & 1 deletion benchmark/job/load_info.py
Original file line number Diff line number Diff line change
Expand Up @@ -74,5 +74,5 @@ def get_table_file_delimiter(self) -> str:

def get_constraints_fpath(self) -> Optional[Path]:
# JOB does not have any constraints. It does have indexes, but we don't want to create
# those indexes so that Proto-X can start from a clean slate.
# those indexes so that the tuning agent can start from a clean slate.
return None
8 changes: 4 additions & 4 deletions dbms/load_info_base_class.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,16 +10,16 @@ class LoadInfoBaseClass:
"""

def get_schema_fpath(self) -> Path:
raise NotImplemented
raise NotImplementedError

def get_tables_and_fpaths(self) -> list[tuple[str, Path]]:
raise NotImplemented
raise NotImplementedError

# We assume the table file has a "csv-like" format where values are separated by a delimiter.
def get_table_file_delimiter(self) -> str:
raise NotImplemented
raise NotImplementedError

# If the subclassing benchmark does not have constraints, you can return None here.
# Constraints are also indexes.
def get_constraints_fpath(self) -> Optional[Path]:
raise NotImplemented
raise NotImplementedError
3 changes: 0 additions & 3 deletions dbms/postgres/cli.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,5 @@
"""
At a high level, this file's goal is to (1) build postgres and (2) create dbdata (aka pgdata).
On the other hand, the goal of tune.protox.env.util.postgres is to provide helpers to manage
a Postgres instance during agent tuning.
util.pg provides helpers used by *both* of the above files (as well as other files).
"""

import logging
Expand Down
33 changes: 0 additions & 33 deletions experiments/protox_tpch_sf0point1/main.sh

This file was deleted.

27 changes: 0 additions & 27 deletions experiments/protox_tpch_sf1/main.sh

This file was deleted.

31 changes: 0 additions & 31 deletions experiments/protox_tpch_sf10/main.sh

This file was deleted.

6 changes: 0 additions & 6 deletions scripts/_run_tests.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,6 @@
import sys
import unittest

# See comment in the base task.py file for why we do this.
os.environ["TF_CPP_MIN_LOG_LEVEL"] = "3"
import tensorflow

del os.environ["TF_CPP_MIN_LOG_LEVEL"]

if __name__ == "__main__":
loader = unittest.TestLoader()
suite = loader.discover(".", pattern=sys.argv[1])
Expand Down
2 changes: 1 addition & 1 deletion scripts/configs/apt_requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,4 +6,4 @@ rpm
zlib1g-dev
cbindgen
redis-server
redis-tools
redis-tools
Loading

0 comments on commit 8227c5e

Please sign in to comment.