fix(container): reducing amount of caching to avoid cross environment issues

Author: RembrandtK

.devcontainer/README.md

@@ -18,50 +18,37 @@ The dev container provides a consistent development environment with caching to
 
 ## Cache System
 
-The container uses a simple caching system:
+The container uses a conservative caching approach to prevent cache corruption issues:
 
-1. **Host Cache Directories**: Created on the host and mounted into the container
+1. **Local Cache Directories**: Each container instance maintains its own cache directories
 
-   - `/cache/vscode-cache` → `/home/vscode/.cache`
-   - `/cache/vscode-config` → `/home/vscode/.config`
-   - `/cache/vscode-data` → `/home/vscode/.local/share`
-   - `/cache/vscode-bin` → `/home/vscode/.local/bin`
-   - `/cache/*` → Tool-specific cache directories
+   - `vscode-cache` → `/home/vscode/.cache` (VS Code cache)
+   - `vscode-config` → `/home/vscode/.config` (VS Code configuration)
+   - `vscode-data` → `/home/vscode/.local/share` (VS Code data)
+   - `vscode-bin` → `/home/vscode/.local/bin` (User binaries)
 
-2. **Package Cache Symlinks**: Created inside the container by project-setup.sh
-   - Each package's cache directory is symlinked to a subdirectory in `/cache/hardhat`
+2. **Safe Caches Only**: Only caches that won't cause cross-branch issues are configured
 
-## Setup Instructions
-
-### 1. Host Setup (One-time)
-
-Before starting the dev container for the first time, run the included host setup script to create the necessary cache directories on the host:
-
-```bash
-sudo /git/graphprotocol/contracts/.devcontainer/host-setup.sh
-```
+   - GitHub CLI: `/home/vscode/.cache/github`
+   - Python packages: `/home/vscode/.cache/pip`
 
-This script creates all required cache directories on the host, including:
+3. **Intentionally Not Cached**: These tools use their default cache locations to avoid contamination
+   - NPM, Yarn (different dependency versions per branch)
+   - Foundry, Solidity (different compilation artifacts per branch)
+   - Hardhat (different build artifacts per branch)
 
-- Standard VS Code directories (for .cache, .config, etc.)
-- Tool-specific cache directories (for npm, yarn, cargo, etc.)
-
-The script is idempotent and can be run multiple times without issues.
-
-The container was designed to be used for development with contracts repo at `/git/graphprotocol/contracts` and with `/git` mounted from the host by `docker-compose.yml`.
+## Setup Instructions
 
-### 2. Start the Dev Container
+### Start the Dev Container
 
-After creating the cache directories, you can start the dev container:
+To start the dev container:
 
 1. Open VS Code
 2. Use the "Remote-Containers: Open Folder in Container" command
 3. Select the repository directory (for example `/git/graphprotocol/contracts`)
 
 When the container starts, the `project-setup.sh` script will automatically run and:
 
-- Create package-specific cache directories
-- Set up symlinks for package cache directories
 - Install project dependencies using yarn
 - Configure Git to use SSH signing with your forwarded SSH key
 - Source shell customizations if available in PATH
@@ -87,11 +74,13 @@ These environment variables are needed for Git commit signing to work properly.
 
 ## Troubleshooting
 
-If you encounter permission denied errors when trying to access directories, make sure you've run the `host-setup.sh` script on the host before starting the container:
+### Cache Issues
 
-```bash
-sudo .devcontainer/host-setup.sh
-```
+If you encounter build or compilation issues that seem related to cached artifacts:
+
+1. **Rebuild the container**: This will start with fresh local caches
+2. **Clean project caches**: Run `yarn clean` to clear project-specific build artifacts
+3. **Clear node modules**: Delete `node_modules` and run `yarn install` again
 
 ### Git SSH Signing Issues
 

.devcontainer/docker-compose.yml

@@ -3,53 +3,38 @@ services:
     build:
       context: .
       dockerfile: Dockerfile
-      x-bake:
-        cache-from:
-          - type=local,src=/cache/docker
-        cache-to:
-          - type=local,dest=/cache/docker,mode=max
     env_file:
       - /opt/configs/graphprotocol/contracts.env
     environment:
-      # Cache directories
-      - FOUNDRY_CACHE_DIR=/cache/foundry
-      - SOLC_CACHE=/cache/solidity
+      # Essential for large builds
+      - NODE_OPTIONS=--max-old-space-size=4096
 
-      # GitHub
-      - GH_CONFIG_DIR=/cache/github
+      # Clean development environment
+      - PYTHONDONTWRITEBYTECODE=1
 
-      # XDG standard directories
+      # Standard user directories
       - XDG_CACHE_HOME=/home/vscode/.cache
       - XDG_CONFIG_HOME=/home/vscode/.config
       - XDG_DATA_HOME=/home/vscode/.local/share
 
-      # Tool-specific settings
-      - HARDHAT_CACHE_DIR=/cache/hardhat
-      - HARDHAT_ANALYTICS=true
-      - HARDHAT_NO_ANALYTICS_PROMPT=true
-
-      # Node.js settings
-      - NPM_CONFIG_CACHE=/cache/npm
-      - YARN_CACHE_FOLDER=/cache/yarn
-      - NODE_OPTIONS=--max-old-space-size=4096
+      # Safe caches (won't cause cross-branch issues)
+      - GH_CONFIG_DIR=/home/vscode/.cache/github
+      - PIP_CACHE_DIR=/home/vscode/.cache/pip
 
-      # Python settings
-      - PIP_CACHE_DIR=/cache/pip
-      - PYTHONPYCACHEPREFIX=/cache/pycache
-      - PYTHONDONTWRITEBYTECODE=1
+      # Note: NPM, Yarn, Foundry, and Solidity caches are intentionally not set
+      # to avoid cross-branch contamination. Tools will use their default locations.
     volumes:
-      # Mount cache directory
-      - /cache:/cache
-
-      # System-specific mounts that need specific locations
-      - /cache/apt:/var/cache/apt
-      - /cache/apt-lib:/var/lib/apt
-
       # Git repo root
       - /git:/git
 
-      # Local cache directories for XDG standards
-      - /cache/vscode-cache:/home/vscode/.cache
-      - /cache/vscode-config:/home/vscode/.config
-      - /cache/vscode-data:/home/vscode/.local/share
-      - /cache/vscode-bin:/home/vscode/.local/bin
+      # Local directories for user data (keep local to container)
+      - vscode-cache:/home/vscode/.cache
+      - vscode-config:/home/vscode/.config
+      - vscode-data:/home/vscode/.local/share
+      - vscode-bin:/home/vscode/.local/bin
+
+volumes:
+  vscode-cache:
+  vscode-config:
+  vscode-data:
+  vscode-bin:

.devcontainer/project-setup.sh

@@ -11,73 +11,15 @@ REPO_ROOT="$(cd "$SCRIPT_DIR/.." && pwd)"
 echo "Script directory: $SCRIPT_DIR"
 echo "Repository root: $REPO_ROOT"
 
-# Check if cache directories exist
-echo "Checking if cache directories exist..."
+# Set up local user directories with proper permissions
+echo "Setting up local user directories..."
 
-# Required cache directories
-REQUIRED_DIRS=(
-  "/cache/hardhat"
-  "/cache/npm"
-  "/cache/yarn"
-)
+# Ensure all user directories exist and have proper ownership
+sudo mkdir -p /home/vscode/.cache /home/vscode/.config /home/vscode/.local/share /home/vscode/.local/bin
+sudo chown -R vscode:vscode /home/vscode/.cache /home/vscode/.config /home/vscode/.local
+sudo chmod -R 755 /home/vscode/.cache /home/vscode/.config /home/vscode/.local
 
-# Check if required directories exist
-missing_dirs=()
-for dir in "${REQUIRED_DIRS[@]}"; do
-  if [ ! -d "$dir" ]; then
-    missing_dirs+=("$dir")
-  fi
-done
-
-# If any required directories are missing, show a warning
-# Note: With set -u, we need to ensure missing_dirs is always initialized
-if [ "${#missing_dirs[@]}" -gt 0 ]; then
-  echo "WARNING: The following required cache directories are missing:"
-  for dir in "${missing_dirs[@]}"; do
-    echo "  - $dir"
-  done
-  echo "Please run the host setup script before starting the container:"
-  echo "  sudo .devcontainer/host-setup.sh"
-  echo "Continuing anyway, but you may encounter issues..."
-fi
-
-# Set up cache symlinks
-echo "Setting up cache symlinks..."
-
-# Function to create symlinks for package cache directories
-setup_cache_symlink() {
-  # With set -u, we need to ensure all parameters are provided
-  if [ "$#" -ne 1 ]; then
-    echo "Error: setup_cache_symlink requires exactly 1 argument (package_name)"
-    return 1
-  fi
-
-  local package_name=$1
-  local cache_path="$REPO_ROOT/packages/${package_name}/cache"
-  local cache_dest="/cache/hardhat/${package_name}"
-
-  # Skip if the package directory doesn't exist
-  if [ ! -d "$REPO_ROOT/packages/${package_name}" ]; then
-    return
-  fi
-
-  # Create the package-specific cache directory if it doesn't exist
-  if [ ! -d "$cache_dest" ]; then
-    echo "Creating package-specific cache directory: $cache_dest"
-    mkdir -p "$cache_dest"
-    chmod -R 777 "$cache_dest"
-  fi
-
-  # Create the symlink (will replace existing symlink if it exists)
-  ln -sf "$cache_dest" "$cache_path"
-  echo "Created symlink for ${package_name} cache"
-}
-
-# Set up cache symlinks for main packages
-setup_cache_symlink "contracts"
-setup_cache_symlink "horizon"
-setup_cache_symlink "subgraph-service"
-setup_cache_symlink "data-edge"
+echo "User directories set up with proper permissions"
 
 # Install project dependencies
 echo "Installing project dependencies..."