Skip to main content

Generative AI Components

🧠 Introduction

Generative AI is transforming how businesses operate, from chatbots to automation and decision-making systems. But behind every AI tool lies a set of core components working together.

This guide breaks down all major Generative AI concepts in a way that anyone can understand—no technical background required.

We’ll also map these concepts across four major platforms:

  • AWS Bedrock

  • Microsoft Copilot Studio

  • Google Vertex AI (Gemini)

  • OpenAI (ChatGPT & APIs)

🌐 The Big Picture: How Generative AI Works

At a high level, every AI system follows this flow:

  1. User asks a question (Prompt)

  2. System finds relevant information (Retrieval)

  3. AI processes the request (Inference)

  4. AI generates a response (Output)

Behind the scenes, multiple components make this possible.


🧩 Core Components of Generative AI


1. 🧠 Large Language Model (LLM)

What it is:
The “brain” of the AI that understands and generates text.

Simple analogy:
A highly intelligent person who has read millions of books.

Examples:

  • GPT models (OpenAI)

  • Claude (AWS)

  • Gemini (Google)

2. 💬 Prompt

What it is:
The question or instruction you give to the AI.

Example:

  • “Summarize this document”

  • “Explain home loans in simple terms”


3. 🧾 Prompt Engineering

What it is:
The art of writing better prompts to get better answers.

Example:

  • Basic: “Explain AI”

  • Better: “Explain AI in 3 bullet points for beginners”


4. 🔢 Tokens & Context Window

Tokens: Small pieces of text the AI processes
Context Window: Maximum amount of text the AI can “remember”

Why it matters:

  • Affects cost

  • Affects performance

  • Limits how much data AI can process


5. ⚙️ Inference

What it is:
The process where AI generates an answer from your input.

Analogy:
You ask a chef for a dish → chef cooks → gives food
Cooking = inference


6. 🧱 Chunking

What it is:
Breaking large documents into smaller pieces.

Example:

  • 100-page PDF → split into smaller sections

Why important:

  • AI cannot process large documents at once

  • Improves accuracy


7. 🔢 Embeddings

What it is:
Converting text into numbers so AI can understand meaning.

Analogy:
Turning words into coordinates on a map.

Example:

  • “Dog” and “puppy” are close together

  • “Car” is far away


8. 📦 Vector Database

What it is:
A database that stores embeddings (numbers).

Analogy:
Google Maps for ideas—finds closest meaning.


9. 🔍 Retrieval

What it is:
Finding relevant information from stored data.

Example:
User asks: “What is refund policy?”
System finds relevant document chunks


10. 🔗 RAG (Retrieval Augmented Generation)

What it is:
Combining retrieved data with AI-generated responses.

Analogy:
Open-book exam:

  • First find answer in book

  • Then explain it

Why important:

  • Reduces incorrect answers (hallucinations)


11. 📚 Knowledge Base

What it is:
A collection of your data used by AI.

Examples:

  • PDFs

  • Websites

  • Company documents


12. 🔄 Orchestration / Workflow

What it is:
The process that connects all components.

Example flow:

  1. User asks question

  2. Retrieve data

  3. Send to AI

  4. Generate response


13. 🤖 Agents

What they are:
AI systems that can take actions, not just answer questions.

Examples:

  • Book a meeting

  • Send email

  • Query database


14. 🛠️ Tool Use (Function Calling)

What it is:
AI calling external systems or APIs.

Example:

  • “Check my order status”

  • AI calls backend system


15. 🧠 Memory

Short-term: Current conversation
Long-term: Stored preferences/data


16. 🎛️ Model Controls

  • Temperature → creativity

  • Top-K / Top-P → randomness

  • Max Tokens → response size


17. 🛡️ Guardrails & Safety

What it is:
Rules to control AI behavior.

Examples:

  • Block harmful content

  • Prevent data leaks


18. 📊 Monitoring & Optimization

  • Logging → track usage

  • Evaluation → measure quality

  • Feedback loop → improve system


🆚 Platform Comparison (Simple View)

AWS Bedrock

  • Full control

  • Requires technical expertise

  • Best for custom enterprise solutions


Microsoft Copilot Studio

  • No-code / low-code

  • Easy for business users

  • Limited customization


Google Vertex AI

  • Strong search capabilities

  • Best for data-heavy applications

  • Excellent multimodal support


OpenAI

  • Easiest to start

  • Powerful models

  • Requires building your own system around it


🧠 End-to-End Example

User asks:
“Summarize my HR policy”

System flow:

  1. Document is chunked

  2. Converted into embeddings

  3. Stored in vector database

  4. Query is embedded

  5. Relevant chunks retrieved

  6. Sent to LLM

  7. AI generates response


🔥 Key Insights

If you remember only three things:

  1. RAG (Retrieval) determines accuracy

  2. Prompt quality determines clarity

  3. Data quality determines usefulness


🚀 Final Thoughts

Generative AI may seem complex, but it’s built on a simple idea:

👉 Combine data + search + reasoning

All platforms—AWS, Microsoft, Google, and OpenAI—use the same building blocks.

The only difference is:

  • How much control you get

  • How much the platform does for you


📌 Quick Summary

  • LLM = Brain

  • Prompt = Question

  • Embeddings = Meaning in numbers

  • Vector DB = Memory

  • Retrieval = Search

  • RAG = Smart answering

  • Inference = Thinking


🎯 What’s Next?

To truly master Generative AI:

  • Build a simple chatbot

  • Experiment with prompts

  • Try RAG with your own data


Generative AI is not magic — it’s a system. Once you understand the components, you can build anything.


Comments

Popular posts from this blog

MySQL InnoDB cluster troubleshooting | commands

Cluster Validation: select * from performance_schema.replication_group_members; All members should be online. select instance_name, mysql_server_uuid, addresses from  mysql_innodb_cluster_metadata.instances; All instances should return same value for mysql_server_uuid SELECT @@GTID_EXECUTED; All nodes should return same value Frequently use commands: mysql> SET SQL_LOG_BIN = 0;  mysql> stop group_replication; mysql> set global super_read_only=0; mysql> drop database mysql_innodb_cluster_metadata; mysql> RESET MASTER; mysql> RESET SLAVE ALL; JS > var cluster = dba.getCluster() JS > var cluster = dba.getCluster("<Cluster_name>") JS > var cluster = dba.createCluster('name') JS > cluster.removeInstance('root@<IP_Address>:<Port_No>',{force: true}) JS > cluster.addInstance('root@<IP add>,:<port>') JS > cluster.addInstance('root@ <IP add>,:<port> ') JS > dba.getC...

Amazon RDS | Amzon Redshift | Big Data | Boost Performance with Amazon ElastiCache

Amazon RDS with Amazon ElastiCache for Performance: Amazon RDS supports - Oracle, MS SQL server, MySQL, Maria DB and PostgreSQL. It is a managed service offered by the Amazon.  Couple of customers have observed the performance issues during their journey with Amazon RDS with Oracle, MS SQL Server, MySQL, Maria DB and PostgreSQL. Amazon cloud engineers / database consultants / database architect and Amazon supports worked to-gather to boost the Amazon RDS performance by tuning the RDBMS configuration parameters using Amazon RDS parameter group , and have not achieved the SLA for Amazon RDS .  Amazon RDS with Multi AZ and Read Replica: Some of the the AWS professionals have suggested for vertical scaling of the Amazon RDS . It should works and its absolutely correct. In my opinion, it would be a good idea to think about the Amazon ElastiCache service with Amazon RDS for better performance and cost optimization also rather than vertically scaling the Amazon RDS . I would sug...

Oracle E-Business Suite Password Management using FNDCPASS

Oracle E-Business Suite Password Management: Before changing the APPS password using the FNDCPASS utility: Take backup of table FND_USER and FND_ORACLE_USERID . " alter user " command is not supported and should not be used for changing the apps password in any case. Always use FNDCPASS to change the APPS password. Check FNDCPASS log for any kind of error. If there is any error in the FNDCPASS log, then DO NOT run autoconfig or try to change configuration file manually. Until and unless FNDCPASS log has no error,  do not run autoconfig as you will get problem while logging in oracle application. If there is and error in the FNDCPASS log, then either restore table  FND_USER and FND_ORACLE_USERID to log into Applications or open SR to support with the FNDCPASS log. If you are on Oracle E-Business Suite Release 12.1 or 12.2 , ensure that your sqlnet_ifile.ora has the line SQLNET.ALLOWED_LOGON_VERSION_SERVER = 8 (if the initialization parameter SEC_CASE_SEN...