• Farid@startrek.website
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    10 months ago

    It doesn’t actually have memory in that sense. It can only remember things that are in the training data and within its limited context (4-32k tokens, depending on model). But when you send a message, ChatGPT does a semantic search of everything in the conversation and tries to fit the relevant parts inside the context, if there’s room.