Exporters From Japan
Wholesale exporters from Japan   Company Established 1983
CARVIEW
Select Language

BFM Implementation


A proxy agent is first trained in simulation via large-scale motion imitation as preparation of the large-scale behavioral datasets for BFM pretraining.

The BFM is then implemented as a Conditional Variational Autoencoder with a versatile control interface based on our mathematical formulation and leverage the paradigm of masked online distillation for pretraining.


BFM Implementation
Figure 1: Overview of BFM Implementation

BFM Applications

Behavoior Composition


BFM allows behavior composition through linear interpolation of latent variables from two distinct control modes, generating novel behaviors integrating the features of both control modes.


Root Mode Only

After Composition

Keypoint Mode Only

Behavoior Modulation


BFM allows behavior modulation through linear extrapolation in the latent space, thereby enabling behavior generation that better aligns with the desired control mode.

$$z = (1+\lambda)\mu^{\rho}(s_t^{p,real},s_t^{g,real}) - \lambda\mu^{\rho}(s_{t}^{p,real},\emptyset), \lambda>0$$


Before Modulation

After Modulation

Efficient Behavior Acquisition


We adopt residual learning on our pretrained BFM to leverage a broad spectrum of inherent knowledge encoded in our BFM for efficient acquisition of novel behaviors.


Residual Learning
Figure 2: Overview of Residual Learning on BFM

BFM ONLY

RL from Scratch

BFM + Residual Learning

Real Deployment