Chatbot

This is a simple chatbot. You can pick which model to use.

Prerequisite

install Genkit (npm i -g genkit)
Google Cloud project with Vertex AI API enabled (https://pantheon.corp.google.com/apis/library/aiplatform.googleapis.com)
gcloud CLI installed (https://cloud.google.com/sdk/docs/install-sdk)
to use Llama 3.1 405b enable it in the Vertex AI Model Garden

The sample is using Vertex AI, so you'll need to auth:

gcloud auth login
gcloud auth application-default login --project YOUR_PROJECT

Clone this code

git clone https://github.com/firebase/genkit
cd genkit/samples/chatbot

Install deps and run the chatbot app

npm run setup
npm start

Point your browser to http://localhost:4200/

Inspect runs in http://localhost:4000/