Outdated documentation

[idk2me]

The section on building MDPs is either outdated or is missing some parts. I recognize that it is an explanation of 01-building-mdps.py (this one works). What's missing is states_labeling definition and this results in NameError: name 'state_labeling' is not defined. Did you mean: 'choice_labeling'?. According to the example, to fix this in the documentation nr_states = 13 needs to be declared and after defining/building transition_matrix state_labeling needs to be defined and labels added.

[linusheck]

Thank you for opening the issue! Indeed, it seems like the state_labeling definition is missing.

If you want to build a small MDP using Python, you could also try out our new more accessible Python library, stormvogel. You can find docs on how to build an MDP there. But this is not as fast as the SparseMatrixBuilder.

[volkm]

The documentation tries to find a balance between completeness and conciseness. For MDPs we opted to not again explain how to build the state labeling, because it is already explained in the DTMC case. #204 will add links to the relevant documentation such that it should be a bit clearer.
Note that the notebook itself also contains the state labeling, it is just hidden for the documentation. So if you start the notebook you should also see the complete code.

[idk2me]

Note that the notebook itself also contains the state labeling, it is just hidden for the documentation. So if you start the notebook you should also see the complete code.

This would be fine, but I find myself getting timed out when starting your binder notebooks session or receiving too many connections error. To clarify, this is not always the case, but still majority of the time this is what happens, at least within the last week.

[volkm]

The notebooks use the external binder service which has limited computation resources. You can however also run the Jupter notebooks locally.

Install Jupyter notebook with

pip install jupyterlab==4.1.8

Run it with

jupyter lab

In the commandline, there should be a local url http://127.0.0.1:8888/lab?token=... which you can open in a web browser. From there on you can open the notebooks. Our notebooks are located under the path doc/source/doc/.