FYI... has anyone here considered how to represent background information (background context) at the beginning of a transformer sequence? Specialized tokens that refer to user attributes (a token preamble, if you will...).
FYI... has anyone here considered how to represent background information (background context) at the beginning of a transformer sequence? Specialized tokens that refer to user attributes (a token preamble, if you will...).