My tests are very basic, but covers a lot of things relevant to my personal life. Gemini failed to correctly respond to a single one of my tests.
Gemini struggled the most with false information. Both creating falsehoods and accepting them without question. The most difficult thing for most LLMs was responding “I don’t know” or “that’s not right”. It is my firm belief that any lack of knowledge should be identified and handled by RAG.
My tests are very basic, but covers a lot of things relevant to my personal life. Gemini failed to correctly respond to a single one of my tests.
Gemini struggled the most with false information. Both creating falsehoods and accepting them without question. The most difficult thing for most LLMs was responding “I don’t know” or “that’s not right”. It is my firm belief that any lack of knowledge should be identified and handled by RAG.