CCM: Context Chain Machine

CCM is inspired by GPT forward process. It is a experimental construct that seeks to understand the probabilistic model origin of transformer architecture

Fit

### ccm06 is hard coded to be 2-layer
### use --model=GPT to compare to nanoGPT
python3 train.py config/train_shakespeare.py --model=CCM06 --init_from=scratch --compile=True --n_layer=2 

Sample

python3 sample.py --out_dir=out-shakespeare-word --model=CCM06

acknowledgements

Training and sampling scripts are taken from the nanoGPT by Andrej Kaparthy

Changelog:

2023-12-14,Feng Geng: implemented CCM06