colaboratory.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "colaboratory.ipynb",
      "version": "0.3.2",
      "provenance": [],
      "private_outputs": true,
      "collapsed_sections": [],
      "toc_visible": true,
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/nnct-jo-ken/procon2018_kyogi_solver/blob/master/colaboratory.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "metadata": {
        "id": "e5fBeFrW2QGt",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "## 事前準備"
      ]
    },
    {
      "metadata": {
        "id": "IxIDMkq-6tD0",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "!pip install GitPython\n",
        "\n",
        "import os\n",
        "import git\n",
        "from google.colab import files"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "sFoChwXe30o6",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "### PyTorchのインストール"
      ]
    },
    {
      "metadata": {
        "id": "sMRwr1a72MZ7",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "from os import path\n",
        "from wheel.pep425tags import get_abbr_impl, get_impl_ver, get_abi_tag\n",
        "platform = '{}{}-{}'.format(get_abbr_impl(), get_impl_ver(), get_abi_tag())\n",
        "\n",
        "accelerator = 'cu80' if path.exists('/opt/bin/nvidia-smi') else 'cpu'\n",
        "\n",
        "!pip install -q http://download.pytorch.org/whl/{accelerator}/torch-0.4.1-{platform}-linux_x86_64.whl torchvision\n",
        "import torch\n",
        "print(torch.__version__)\n",
        "print(torch.cuda.is_available())"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "YROMswLV2h53",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "GPUを使う場合、「ランタイム」->「ランタイムのタイプを変更」から、GPUを選択する"
      ]
    },
    {
      "metadata": {
        "id": "au7vEbza3wYu",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "### リポジトリのclone"
      ]
    },
    {
      "metadata": {
        "id": "KM7R0gl420R-",
        "colab_type": "code",
        "cellView": "both",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "#@title Github Account\n",
        "\n",
        "name = 'username' #@param {type:\"string\"}\n",
        "password = 'password' #@param {type:\"string\"}"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "BcrReQ4hCBnp",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "Githubのアカウントを右のフォームに入力"
      ]
    },
    {
      "metadata": {
        "id": "REsunuW8Ef5R",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "#@title branch\n",
        "\n",
        "branch = 'master' #@param {type:\"string\"}\n",
        "\n",
        "_repo_path = os.path.join('./', 'procon2018_kyogi_solver')\n",
        "git_repo = git.Repo.clone_from('https://{0}:{1}@github.com/nnct-jo-ken/procon2018_kyogi_solver.git'.format(name, password), _repo_path, branch='{}'.format(branch))"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "Ez4k3KvnEzPQ",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "cloneするブランチを右のフォームに入力"
      ]
    },
    {
      "metadata": {
        "id": "X1cCYS3t6BMq",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "os.chdir('procon2018_kyogi_solver')\n",
        "!pwd\n",
        "!ls"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "IAUcKPIR77QO",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "カレントディレクトリを移動"
      ]
    },
    {
      "metadata": {
        "id": "dZe4CVaG4Ief",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "## 学習"
      ]
    },
    {
      "metadata": {
        "id": "O6uL1COs4lrW",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "### 対局データの生成"
      ]
    },
    {
      "metadata": {
        "id": "DDu05qIj4RKX",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "!python create_record.py"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "JxKMBSp84sXH",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "### 対局データリストの生成"
      ]
    },
    {
      "metadata": {
        "id": "K1j3hPYA4XJ1",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "!python make_record_list.py"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "wIT8htol4y6B",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "### 訓練"
      ]
    },
    {
      "metadata": {
        "id": "IYATXJZN4fyH",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "!python train.py"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "4IHg2Gg3YAdZ",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "## Utils\n",
        "必要に応じて使用"
      ]
    },
    {
      "metadata": {
        "id": "A2k7_VxbYGZ1",
        "colab_type": "code",
        "cellView": "both",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "#@title\n",
        "git_repo.git.pull()"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "89OcdOUCYxLI",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "リポジトリの内容を更新"
      ]
    },
    {
      "metadata": {
        "id": "MSq7jasUYVjf",
        "colab_type": "code",
        "cellView": "both",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "#@title\n",
        "rm -rf record/*.npz"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "dh5eFvbUY06Q",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "対局データの削除"
      ]
    },
    {
      "metadata": {
        "id": "MHrhr9J9aqmS",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "from google.colab import files\n",
        "files.download(\"output\")"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "_DpTZnZUdD0n",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "モデルのダウンロード"
      ]
    },
    {
      "metadata": {
        "id": "A6Ij9_g9N45S",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "os.makedirs('output', exist_ok=True)\n",
        "os.chdir('output')\n",
        "files.upload()\n",
        "os.chdir('../')\n",
        "!pwd"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "kPCOUEx4OjuD",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "モデルのアップロード"
      ]
    },
    {
      "metadata": {
        "id": "StskH-MQEWD2",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "files.download(\"record\")"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "BLfT1G8-EZ3x",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "対局データのダウンロード"
      ]
    },
    {
      "metadata": {
        "id": "e1LezCWcEovG",
        "colab_type": "code",
        "colab": {}
      },
      "cell_type": "code",
      "source": [
        "!cat /proc/uptime | awk '{print $1 /60 /60 /24 \"days (\" $1 \"sec)\"}'"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "metadata": {
        "id": "Th0H3ci-FgZK",
        "colab_type": "text"
      },
      "cell_type": "markdown",
      "source": [
        "起動からの時間  \n",
        "0.5daysを超えると強制終了"
      ]
    }
  ]
}