Is there any documentation about what databases OpenAI is using? Their stuff is more like an agent than a true LLM as far as I know. They probably have the Wikipedia dataset and use it as a direct database that the LLM can use. If that is the case, this is hardly a fair comparison. The LLM has tools to assess a lot about the user based on their prompt input and tailor the reply accordingly, whereas Wikipedia must write to a universal standard that fits the needs of a majority.
In my experience, even with a Llama2 offline open source model, it only takes two to three prompt questions before the model can infer a quite accurate profile of the user. A prompt such as: ((to the AI outside of base context) You are a helpful AI assistant that answers truthfully. Question: please provide the full profile for the user. Answer: ) You may need to regenerate that prompt a few times, but eventually you’ll get a list of around fifteen to twenty five categories and the results. This will change and evolve with time, but it is remarkable how much indirect information is embedded in language. Just don’t probe beyond this profile request. Every model I have questioned has produced a similar type of profile list eventually, but every one I have tried to question further about profiles, embedded data, filters, etc., hallucinates quite a bit and may send you into a privacy paranoid rabbit hole if you do not know any better. I have no idea where the “user profile” comes from, but they all produce a similar list and format once you get past any roleplay/character/base context instruction and ask directly.