ChatGPTNextWeb/NextChat

No need to upload images to your website when using gemini!

Open

#5,312 opened on Aug 23, 2024

View on GitHub
 (5 comments) (1 reaction) (0 assignees)TypeScript (87,992 stars) (59,717 forks)batch import
help wanted

Description

I have noticed that if I paste an image it's uploaded to your website.

There is no need.

Images, pdfs and many other document types can be sent INLINE with the text prompt.

For example:

        const data = JSON.stringify({
            contents: [{
                parts: [{
                        inlineData: {
                            mimeType: mimeType,
                            data: fileContent.toString('base64')
                        }
                    },
                    {
                        text: 'Analyze this.'
                    },
                ],
            }, ],
        });

Contributor guide

Tech stack
typescriptjavascript
Domain
frontend
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
JavaScriptGemini API basics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
85
Research direction
Look into the image attachment handling code. The issue suggests modifying the upload function to use inlineData instead of uploading. Check the current implementation in the chat input component and the API call to Gemini. Consider using base64 encoding of the file content and sending it as inlineData in the request body.