The Quick Guide to Prompt Engineering

2The Role of Prompts in Generative AI

Table of Contents

• How Did Prompts Originate
• How Can You Provide Data Input to an AI System
• Making AI Accessible to Everyone
• How Prompts Guide the AI's Response
  • What Is behind the Prompt
    • Neural Architectures
    • Tokenization and Vectorization
    • Attention Mechanisms
    • Generative Capability
    • Adaptive Learning
    • Bias and Ethical Considerations
  • How Do Generative AI Systems Understand Input and Provide Output
  • What Goes behind the Scenes in a Generative AI System
    • Training on Massive Datasets
    • Tokenization
    • Embedding and Vector Representation
    • Processing via Neural Networks
    • Attention Mechanisms
    • Output Generation
    • Decoding Strategies
    • Regularization and Optimization
  • The Importance of Carefully Engineering Prompts
    • The Need to Prepare an AI System with Information and Data
    • The Need to Create Prompts to Receive the Best Output
    • How Do Carefully Engineered Prompts Create a Good Output

How Did Prompts Originate

Prompts, in the simplest terms, are the initial stimuli or cues provided to a system to elicit a particular response. The idea of using prompts is not novel and dates back to the early days of computing and AI.

The genesis of prompts can be traced back to rule-based systems, where specific inputs led to predefined outputs. These were systems that operated on strict logic and deterministic patterns. If you asked them a question or gave them an instruction, they responded precisely in the way they were programmed to.

As we moved into the ...