Agentic AI – Exploring Oracle’s Generative AI Agents
Early this morning, I got a chance to explore the newly released Oracle Generative AI Agent platform. Below are some of the early setups I was playing around with.
Before you get into the nitty-gritty of the platform, a few thoughts: The best part is that it is easy to develop or build, offers a pleasant user experience, and covers wider data sources.
The OCI Generative AI Agents platform is an enterprise-ready service that empowers businesses to quickly create, deploy, and oversee AI agents. With it, you can develop virtual assistants/chatbots that deliver personalized, relevant, and engaging interactions. There are a few features to highlight
-
Pre-built tools: comes with ready-to-use tools for agents to address everyday organization needs:
- RAG (Retrieval Augmented Generation): chat with unstructured enterprise data using natural language.
- SQL: chat with structured enterprise data using natural language.
-
Custom tools support: extends agent’s functionality with custom tools:
- Function calling: create callable functions – the agent identifies which function to invoke and passes appropriate parameters.
- API endpoint calling (limited availability): define tools that interact with external APIs – the agent executes the tool and returns the final result (e.g., content generation, data retrieval, or system interaction).
Let’s start…
Login into your Oracle Tenancy and go to Analytics & Tools > Generative AI Agents
Select Create Agent
Here, you need to enter basic details like name, welcome message, etc.
After following, you will see this below page and select Create tool.
Now you have to select the prebuilt tool, what you want to use,
- RAG
- SQL
- Custom Tool
RAG: The pre-built RAG (Retrieval-Augmented Generation) tool, part of the Agent’s platform, has enhanced how users retrieve and generate information from vast knowledge sources.
SQL: Introducing the pre-built NL2SQL tool as part of the Agent’s platform experience. This tool changes how users interact with structured organization data by enabling data retrieval and analysis through natural language.
Custom Tool: It extends the agent’s functionality with custom tools
Select RAG as you are going to create an HR Policy agent
Also, create a knowledge base for the documents you will pass on to this RAG agent. These are the policy documents in PDF format.
You have three options for the Knowledge base:
- Object Storage – OCI Object storage
- OCI OpenSearch – You must have documents chunked to files with less than 512 tokens each, and you must have ingested and indexed those documents in OpenSearch before you continue
- Oracle AI Vector Search – This option is for data in Oracle Database 23ai.
After the tools setup is done, you now need to move to create a Setup Agent Endpoint
Here, you can see different options for:
- Human in the loop
- and Guardrails
- Content moderation
Prompt (PI) injections
Personal Identifiable Information (PII) protection
Move next to the setup.
You will accept the Llama 3 license agreement and submit
you can see your agent is being created
Once this creation process is complete, you can access the chat function and chat with your Agent.
If you need to have SQL as a Tool in the Agent
I will leave this to next week to cover; we will create the sample data on an autonomous database and use this SQL agent.
Call for Action:
Try it out yourself. Enter your OCI Tenancy and head to the OCI Generative AI Agent platform. Share your experience of exploring this.