+Before the upload the browser scales an image down to fit 1920×1080 and converts it to WebP (to JPEG in a browser which can not encode WebP, e.g. Safari). The plugin accepts images up to 3.75 MB: the model gets them as base64, and the smallest per-image limit of the providers is 5 MB. Every image costs tokens on every model call, so the model sees an image for a while after it was sent, and only the latest few at once. Older images of a message are replaced with one note, and the agent loads them again with the `view_image` tool before answering about them. With one call per answer it loads all images of the messages which may match the request, the most likely first: it sees all the loaded images for this answer and keeps the ones it picks for the next messages. When one answer needs more images than allowed, the agent asks which images matter.
0 commit comments