also seemed to be able to regurgitate accurate information related to unreleased mechanics that the developer says they had only written into GDocs the day before the player’s AI interaction.
Then I don’t believe the “training” argument. Training takes time. They don’t release a new model daily.
Either it had access to this doc while it was researching for the answer (that might be accidentally be some missing access controls or some link was shared somewhere with that user or…) or might have had a good guess. Depending on the game, players will be speculating about new patches, how to fix/change certain mechanics and such and the AI might have found/trained on this and just made a lucky guess. Same for the character name - if you know the other names and maybe there’s an (unconscious) pattern on how they’re named, it could also be a lucky guess.
“Training” refers to a process where training data is passed backwards through a model in order to modify the model’s weights. This happens before the model is deployed to the public. Search happens at (or right before) inference time (i.e. when the model is actually used) and does not modify the model weights.
Then I don’t believe the “training” argument. Training takes time. They don’t release a new model daily.
Either it had access to this doc while it was researching for the answer (that might be accidentally be some missing access controls or some link was shared somewhere with that user or…) or might have had a good guess. Depending on the game, players will be speculating about new patches, how to fix/change certain mechanics and such and the AI might have found/trained on this and just made a lucky guess. Same for the character name - if you know the other names and maybe there’s an (unconscious) pattern on how they’re named, it could also be a lucky guess.
The ai was probably using the Google docs embedded into a vectordb. No training involved and a very common technique to do
Yeah, but then there should be access controls about which vectorization should be accessible for queries by whom…
That’s a definitional question. What counts as “training”? Is “search” different from training? Sometimes, but it depends what you mean.
“Training” refers to a process where training data is passed backwards through a model in order to modify the model’s weights. This happens before the model is deployed to the public. Search happens at (or right before) inference time (i.e. when the model is actually used) and does not modify the model weights.
Of course they are different. You can guess because we even have two different words for it