Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

job chat: don't make up adaptors #177

Open
josephjclark opened this issue Feb 26, 2025 · 0 comments
Open

job chat: don't make up adaptors #177

josephjclark opened this issue Feb 26, 2025 · 0 comments

Comments

@josephjclark
Copy link
Collaborator

Just read a horrible AI response where a user wanted to create a JSON file from some records and either send it by email, or upload to google drive.

The problem is that the assistant:

  1. Invented an "email adaptor" that doesn't exist, with this code:
send(
  fields(
    field('to', '[email protected]'),
    field('subject', 'Transformed Invoices'),
    field('body', 'Please find the attached JSON file with transformed invoices.'),
    field('attachments', [
      {
        filename: 'transformed_invoices.json',
        content: state.jsonFile,
        encoding: 'base64'
      }
    ])
  )
);

Bonus issue: That pattern looks a lot like one of the examples that we feed into the prompt, with the fields stuff. The fields pattern is, I would politely say, outdated now. My fault - we shouldn't be including that stuff in the prompt.

  1. Then went on to also invent a "google-drive" adaptor, which also doesn't exist and has the same nonsense code example
createFile(
  fields(
    field('name', 'transformed_invoices.json'),
    field('type', 'application/json'),
    field('content', state.jsonFile),
    field('parents', ['FOLDER_ID_HERE'])
  )
);

Look pal. If we don't have an adaptor ready made for the solution, we need to push the user onto community or something.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant