| CARVIEW |
BFM Implementation
A proxy agent is first trained in simulation via large-scale motion imitation as preparation of the large-scale behavioral datasets for BFM pretraining.
The BFM is then implemented as a Conditional Variational Autoencoder with a versatile control interface based on our mathematical formulation and leverage the paradigm of masked online distillation for pretraining.
BFM Applications
Behavoior Composition
BFM allows behavior composition through linear interpolation of latent variables from two distinct control modes, generating novel behaviors integrating the features of both control modes.
Root Mode Only
After Composition
Keypoint Mode Only
Behavoior Modulation
BFM allows behavior modulation through linear extrapolation in the latent space, thereby enabling behavior generation that better aligns with the desired control mode.
$$z = (1+\lambda)\mu^{\rho}(s_t^{p,real},s_t^{g,real}) - \lambda\mu^{\rho}(s_{t}^{p,real},\emptyset), \lambda>0$$
Before Modulation
After Modulation
Efficient Behavior Acquisition
We adopt residual learning on our pretrained BFM to leverage a broad spectrum of inherent knowledge encoded in our BFM for efficient acquisition of novel behaviors.