Notebook walkthrough implementation of the unconditional Behavior Transformer (BeT) architecture.
Original Paper: https://arxiv.org/abs/2206.11251
Original Implementation: https://github.com/notmahi/bet
pip install -r requirements.txt
After training on the data and hyperparameters provided by the paper for 500 epochs.
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333828939-1e0d0c69-d82e-443b-abb0-6c16e8ed3951.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc5NDMsIm5iZiI6MTczOTM1NzY0MywicGF0aCI6Ii83NzY3NTU0MC8zMzM4Mjg5MzktMWUwZDBjNjktZDgyZS00NDNiLWFiYjAtNmMxNmU4ZWQzOTUxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNTQwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTU0N2QyZjBiNzQzODY0ZDNmNWE2Y2Q4ZGM5ZTNmMTQ0MzFhMTBkMTBkZjc2ZDgxYzU2Y2M5ZDI4ZTUyMWRhNTQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.E4-QFFaNZlC4I-NCzTImhA8ju73WWG0_XIJp-XwLOVY)
Training Curves:
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863802-687aa70e-d958-4554-8515-6c453b50b295.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc5NDMsIm5iZiI6MTczOTM1NzY0MywicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDItNjg3YWE3MGUtZDk1OC00NTU0LTg1MTUtNmM0NTNiNTBiMjk1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNTQwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTI1YWM3OTNiNmNhOTFjNjQ1NDNjNDAxNTIyZmY0M2FhZmFmYjg5YjcxNzg0Nzc5ZTRlZWYxMTYyODQxMTA1MzMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.M6lmnzHVfVL7U0rcCEEjjucJe5j4j6FFcdDI3auijZo)
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863804-22e898f8-8d60-4ee3-881a-5a268fa13e26.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc5NDMsIm5iZiI6MTczOTM1NzY0MywicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDQtMjJlODk4ZjgtOGQ2MC00ZWUzLTg4MWEtNWEyNjhmYTEzZTI2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNTQwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTQ4OGQzNzc2NzAzZjcyODJmNTc1MzczMjc2MWI1ODcyOGI3NDYxNTVlYzljMDNiMmVjNGQzZTA0NWZjMTkzMjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.FKDfyIMjvox4FzKuVRgonviPkL9d-A9zAQoEL_Y5nsY)
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863807-53c68604-f61a-4afc-86e5-35983e27ca3a.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzNTc5NDMsIm5iZiI6MTczOTM1NzY0MywicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDctNTNjNjg2MDQtZjYxYS00YWZjLTg2ZTUtMzU5ODNlMjdjYTNhLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEyVDEwNTQwM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTAzYTMxNjMzNTU2MjE1MDA2OGViMDMzMjA0YWJjMjBjMjBjNzM4NTZhOTYzODkzMTQ0NjBiMjFhNjYwZjNhYWUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.3nmyZmChdO501MmulEOuIq1zr6Wq83IDkSz5N55Gwow)
Video Demo after 500 epochs: