More details on the actual arch would be nice. It seems like this autoregressive action world model space is a local max until the JEPA work takes over.
gunalx•7mo ago
Dont see how we could not hack on jepa instead of any other input encoders on a transformers llm .
blovescoffee•7mo ago
gunalx•7mo ago