small

docs/getting_started/grid.ipynb

@@ -246,6 +246,7 @@
         "* After taking an action, you go to a state with an observation (symbol \u2299). After this you proceed to another tile state.\n",
         "    + If you try to go into a wall, you observe that you hit a wall (1)\n",
         "    + If you do not hit a wall, you observe this as well (0)\n",
+        "* Every state has a reward according to our reward model (euro sign). Solving the maze will give you 100 reward but taking a step will cost 1.\n",
         "\n",
         "For example, if you try to go left in tile (3,2), you observe that you hit a wall and you go back to (3,2). However, if you try to go up, you observe that you don't hit a wall and proceed to (3,1)."
       ]
@@ -280,7 +281,9 @@
       "source": [
         "from stormvogel.mapping import stormvogel_to_stormpy\n",
         "\n",
-        "stormpy_model = stormvogel_to_stormpy(pomdp)"
+        "stormpy_model = stormvogel_to_stormpy(pomdp)\n",
+        "\n",
+        "# TODO use stormpy to find the best policy/schedule, i.e. escape the maze as quickly as possible."
       ]
     },
     {