• 0 Posts
  • 6 Comments
Joined 1 year ago
cake
Cake day: June 20th, 2023

help-circle

  • Without knowing anything about this model or what it was trained on or how it was trained, it’s impossible to say exactly why it displays this behavior. But there is no “hidden layer” in llama.cpp that allows for “hardcoded”/“built-in” content.

    It is absolutely possible for the model to “override pretty much anything in the system context”. Consider any regular “censored” model, and how any attempt at adding system instructions to change/disable this behavior is mostly ignored. This model is probably doing much the same thing except with a “built-in story” rather than a message that says “As an AI assistant, I am not able to …”.

    As I say, without knowing anything more about what model this is or what the training data looked like, it’s impossible to say exactly why/how it has learned this behavior or even if it’s intentional (this could just be a side-effect of the model being trained on a small selection of specific stories, or perhaps those stories were over-represented in the training data).




  • Yes, we are talking about the same thing.

    The setting that I am referring to is at “Settings > Post History > Mark Posts as Read”.

    EDIT: Note that this will not affect posts that already appear this way, as previously explained. The only difference is that when you open an “unread” post, it will no longer change to being “read”. Existing posts are unaffected. If you use another client, the posts that you read on there may still appear as “read” in Infinity.


  • I’m pretty sure this is supposed to be determined by the “mark posts as read” setting. However, this only determines whether or not Infinity will mark posts as read through the API. Posts that have been marked as read by another client or the web interface are still displayed with the different colors. There should be a separate setting to ignore the “read” status entirely (and then posts that have been marked as read by a different client won’t be greyed or hidden) but there isn’t. There also doesn’t appear to be a way to mark posts as “unread” again.