Notebook walkthrough implementation of the unconditional Behavior Transformer (BeT) architecture.
Original Paper: https://arxiv.org/abs/2206.11251
Original Implementation: https://github.com/notmahi/bet
pip install -r requirements.txt
After training on the data and hyperparameters provided by the paper for 500 epochs.
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333828939-1e0d0c69-d82e-443b-abb0-6c16e8ed3951.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxNzI1MjIsIm5iZiI6MTczOTE3MjIyMiwicGF0aCI6Ii83NzY3NTU0MC8zMzM4Mjg5MzktMWUwZDBjNjktZDgyZS00NDNiLWFiYjAtNmMxNmU4ZWQzOTUxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEwVDA3MjM0MlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTlhMzI3N2ZlNzlhODMzNmQ2ZDI5OWQ5ODNiY2U5MGNiYmE3YzliODI2ZjhmNTNkYTFlMjA3ZTEzZWVlMzhiNjEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.B5sKQJRBby8w7u1zuL0z5e3WQ3PN8JhmIHNbrdkSlP4)
Training Curves:
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863802-687aa70e-d958-4554-8515-6c453b50b295.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxNzI1MjIsIm5iZiI6MTczOTE3MjIyMiwicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDItNjg3YWE3MGUtZDk1OC00NTU0LTg1MTUtNmM0NTNiNTBiMjk1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEwVDA3MjM0MlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQxMjQxYzgwMWU3Y2I5NDNkNDExYTRhNzIzMGY1ODAzYjIzZjA3MDQzNmQxZTdhZjI4MDI1YzIxOWQwYWU1ZDImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.M2ofsA80410RycJJYvJlpwvXDqxWE6CT03vOfinoZbY)
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863804-22e898f8-8d60-4ee3-881a-5a268fa13e26.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxNzI1MjIsIm5iZiI6MTczOTE3MjIyMiwicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDQtMjJlODk4ZjgtOGQ2MC00ZWUzLTg4MWEtNWEyNjhmYTEzZTI2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEwVDA3MjM0MlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRlMmIyNTJmZDA5NzVjMTllODJjN2NmZWQ1NDlmNGZmNDkzMTc0OTE2OTE4M2ExZjNlMDIwZTI1NjAxMGU1NTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.nJ2fjIwzqmhy4Uwt4jUdZdIUPWEkNKubsehcsnI8V-I)
![hyperparameters](https://private-user-images.githubusercontent.com/77675540/333863807-53c68604-f61a-4afc-86e5-35983e27ca3a.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkxNzI1MjIsIm5iZiI6MTczOTE3MjIyMiwicGF0aCI6Ii83NzY3NTU0MC8zMzM4NjM4MDctNTNjNjg2MDQtZjYxYS00YWZjLTg2ZTUtMzU5ODNlMjdjYTNhLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTAlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjEwVDA3MjM0MlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQ1ZWZjNWZjMTk2YjAxYzljOWVmZDk5MmY1NzE2YzY5OWM0NTQxYTI1MTIxOWIxMzBhYjliMDYzMTVkYTIxYWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.BiH1DA4cAaQ47Ku7UMW7aHckYOozMVHJSctY287zLsA)
Video Demo after 500 epochs: