• acockworkorange@mander.xyz
    cake
    link
    fedilink
    English
    arrow-up
    3
    ·
    12 days ago

    If there’s no user feedback reaching their servers, there’s limited value to be extracted from the logs.

    • Buddahriffic@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      12 days ago

      There is feedback that makes it back to their servers: the next prompt.

      Though from my understanding, a lot of the agentic tools do a lot of prompt generation, so that would be a weakness of just logging everything and using subsequent prompts to evaluate earlier ones. They’d have no idea whether each prompt is coming from an actual user or another LLM.