Prompt Engineering Roadmap

Step by step guide to learning Prompt Engineering.

Learn Prompt Engineering

Introduction to Prompt Engineering and Prompt Engineering techniques.

Prompt Engineering Guide

Guides, papers, lecture, notebooks and resources for prompt engineering.

Prompt Engineering 101

Prompt Engineering guide by Xavi.

Prompt Engineering 101

Prompt Engineering guide by Raza Habib & Sinan Ozdemir.

Prompt Engineering Guide

Prompt Engineering guide by Sudalai Rajkumar.

How to generate text: using different decoding methods for language generation with Transformers

A guide to decoding methods for language generation with Transformers.

The Illustrated Transformer

A visual guide to transformers, the core model used in GPT.

Reddit's r/aipromptprogramming Tutorials Collection

A collection of tutorials for prompt engineering.

Prompt Engineering Guide

A comprehensive guide that contains all the latest papers, learning resources, and developments in the field of prompt engineering.

How to Communicate with ChatGPT – A Guide to Prompt Engineering

A guide that explains what prompt engineering is and how you can use it to improve your communication with AI tools.

A Beginner's Guide to ChatGPT Prompt Engineering

A beginner-friendly guide that delves into the art and science of Prompt Engineering.

A Complete Introduction to Prompt Engineering for Large Language Models

Prompt Engineering Guide: How to Engineer the Perfect Prompts

Best practices for prompt engineering with OpenAI API

A guide by OpenAI that provides best practices for prompt engineering.

ChatGPT Prompt Engineering for Developers

A short course on prompt engineering by deeplearning.ai.

Natural Language Processing

Coursera specialization focusing on NLP.

Learn Prompting

A Free, Open Source Course on Communicating with AI.

Deep Learning Specialization

Coursera specialization by Andrew Ng, which includes a course on Sequence Models.

OpenAI Cookbook

OpenAI's cookbook includes examples of prompt engineering.

Tokens and Tokenization: Understanding Cost, Speed, and Limits with OpenAI's APIs

Everything tokens and tokenization. How to control costs/performance, how to handle Max Token limits, and a real-world example on how you can make your prompts more efficient.

How OpenAI Parameters Actuallly Work

How to use OpenAI's parameters to experiment with prompts and get better outputs.

A Beginner's Guide on Embeddings and Their Impact on Prompts

A Beginner's Guide on Embeddings and Their Impact on Prompts.

Prompt Engineering for Vision Models

A beginner's guide to prompting vision models from DeepLearningAI.

Few Shot Learning

Everything you need to know about Few-Shot Learning.

Zero Shot Learning

Large Language Models are Zero-Shot Reasoners.

Chain of Thought

Encourages the LLM to explain its reasoning to improve its accuracy.

Zero Shot Chain of Thought

Enable Chain of Thought with only a few words.

Tree of Thoughts

Tree of Thoughts: Deliberate Problem Solving. with Large Language Models.

Multi Persona Collaboration

Prompt the LLM to dynamically generate personas to collaborate to solve a task.

Reddit's r/aipromptprogramming Tutorials Collection

A collection of tutorials for prompt engineering.

Prompting GPT-3 To Be Reliable

Prompting GPT-3 To Be Reliable.

Decomposed Prompting

A Modular Approach for Solving Complex Tasks.

AutoPrompt

Eliciting Knowledge from Language Models with Automatically Generated Prompts.

LangChain Github Repository

Building applications with LLMs through composability.

Embedchain Github Repository

Framework to create ChatGPT-like bots over your dataset.

FlowGPT

FlowGPT is the largest open source prompt community.

awesomegptprompts.com

Explore hundreds of the best ChatGPT Prompts.

fka/awesome-chatgpt-prompts

Dataset of awesome chatgpt prompts.

f/awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better. .

PromptHub

Full stack prompt management tool designed to be usable by technical and non-technical team members. Test, version, collaborate, deploy, and monitor, all from one place.

ShowGPT.co

Best Data Science ChatGPT Prompts

A collection of useful prompts for data scientists using ChatGPT.

Ignacio Velásquez Prompt Templates

500+ ChatGPT Prompt Templates.

PromptPal

A collection of prompts for GPT-3 and other language models.

Hero GPT

AI Prompt Library.

Reddit's ChatGPT Prompts

Snack Prompt

GPT prompts collection, has a a Chrome extension.

ShareGPT

Share your prompts and your entire conversations.

Prompt Search

a search engine for AI Prompts.

PromptBase

The largest prompts marketplace on the web.

The Ultimate 5 ChatGPT Prompts

Simplify Your AI Experience.

The Prompt Index

A vast collection of carefully curated prompts, stimulating imagination and fueling creative endeavours.

PromptDen

A growing list of thousands of prompts for both text and image generation. Free to explore, add your own, save your favorites and even create a profile page for prompt engineering.

God Tier Prompts

Discover the best prompts. A community-driven leaderboard where the best prompts rise to the top.

Attention Is All You Need

Transformer introduction paper.

Language Models are Few-Shot Learners

GPT-3 introduction paper by OpenAI.

Fine-Tuning Language Models from Human Preferences

Important paper on fine-tuning language models by OpenAI.

The Prompt Report

A systematic survey of prompting techniques.

The Power of Scale for Parameter-Efficient Prompt Tuning

Explores the benefits of "prompt tuning" for robust task performance.

Deep Attentive Learning for Stock Movement Prediction From Social Media Text and Company Correlations

Introduces an architecture for accurate stock forecasting using financial data and social media signals.

A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT

Hard Prompts Made Easy

Gradient-Based Discrete Optimization for Prompt Tuning and Discovery.

Synthetic Prompting

Generating Chain-of-Thought Demonstrations for Large Language Models.

Progressive Prompts

Continual Learning for Language Models.

Batch Prompting

Efficient Inference with LLM APIs.

Successive Prompting for Decompleting Complex Questions

Structured Prompting

Scaling In-Context Learning to 1,000 Examples.

Large Language Models Are Human-Level Prompt Engineers

LLM auto-generates and selects instructions — beats human prompts

Ask Me Anything

A simple strategy for prompting language models.

PromptChainer

Chaining Large Language Model Prompts through Visual Programming.

Reframing Instructional Prompts to GPTk's Language

Prompt Programming for Large Language Models

Beyond the Few-Shot Paradigm.

Prefix-Tuning: Optimizing Continuous Prompts for Generation

Multimodal Chain-of-Thought Reasoning in Language Models

by Amazon Web Service et al., 2023 - The model outperform GPT-3.5 by 16% on the ScienceQA benchmark. This work is the first to study CoT reasoning in different modalities, language (text) and vision (images). Unfortunately, they never provide ablation study on how much of that performance gain was…

On Second Thought, Let's Not Think Step by Step!

Bias and Toxicity in Zero-Shot Reasoning.

ReAct: Synergizing Reasoning and Acting in Language Models

The foundational paper defining the Thought/Action/Observation loop structure that underlies virtually every agent harness. Required reading for understanding why the loop is structured the way it is and where each harness component maps onto the reasoning-acting cycle.

Language Models Are Greedy Reasoners

A Systematic Formal Analysis of Chain-of-Thought.

On the Advance of Making Language Models Better Reasoners

Large Language Models are Zero-Shot Reasoners

"Let's think step by step" — zero-shot CoT milestone

Reasoning Like Program Executors

Self-Consistency Improves Chain of Thought Reasoning in Language Models

Multi-path sampling + majority vote: GSM8K 57% → 74%

Chain of Thought Prompting Elicits Reasoning in Large Language Models

foundational result; intermediate reasoning steps improve performance.

Generated Knowledge Prompting for Commonsense Reasoning

Large Language Models Can Be Easily Distracted by Irrelevant Context

by Google Research et al., 2023 - Adding the instruction "Feel free to ignore irrelevant information given in the questions." consistently improves robustness to irrelevant context.

Constitutional AI: Harmlessness from AI Feedback

A method for training helpful and harmless AI assistants using written principles.

The ChatGPT Prompt Book

A book dedicated to ChatGPT prompts.

You Look Like a Thing and I Love You

A book about AI with a focus on language models.

OpenAI Discord Server

The official OpenAI Discord server.

Attention Architects

Prompt Engineering expert & open source community.

ChatGPT Prompt Engineering Discord Server

A Discord server dedicated to prompt engineering.

r/MachineLearning

The Machine Learning subreddit often has discussions on GPT and other language models.

Hugging Face Forum

A forum for discussing Hugging Face's transformer models, including GPT.

ChatGPT Community Discord Server

A Discord server dedicated to ChatGPT.

Reddit's ChatGPT Discord Server

r/chatgpt Discord server.

PromptsLab Discord

Knowledge sharing community for Generative Models, Prompt Engineering, LLMs.

Learn Prompting

A Discord server dedicated to learning about prompts.

Official OpenAI Playground

Explore resources, tutorials, API docs, and dynamic examples.

llm

Use any LLM from the command line, easily.

Nat.Dev

Multiple Chat AI Playground & Comparer.

Poe.com

All in one playground: GPT4, Sage, Claude+, Dragonfly, and more...

Ora.sh GPT-4 Chatbots

Better ChatGPT

A web app with a better UI for exploring OpenAI's ChatGPT API.

LMQL.AI

A programming language and platform for language models.

Vercel Ai Playground

One prompt, multiple Models (including GPT-4).

Conju.ai

A visual prompt chaining app.

Voiceflow

Professional collaborative visual prompt-chaining tool.

Opik

Evaluate, test, and ship LLM applications across your dev and production lifecycles.

Rhesis AI

OSS Platform & SDK. Collaborative agent testing for teams.

Rival

AI model comparison and multi-model Prompt Lab. Test prompts across 200+ models side-by-side with blind preference voting and open datasets.

Promptify

Automatically improve your prompt.

Fusion

Elevate your output with Fusion's smart prompts.

Bumble-Prompts

Let AI Write your bumble prompt.

ChatGPT Prompt Generator

Generates ChatGPT prompts based on a BART model.

PromptPerfect

Prompt optimizer.

Hero GPT

AI Prompt Library.

TubePrompter

Converts YouTube, TikTok, and Instagram videos into AI-ready prompts for Sora, Midjourney, and Runway using computer vision analysis.

LMQL

Query language for programming large language models.

OpenPromptStudio

BossGPT

Auto-GPT Official Repo

An experimental open-source attempt to make GPT-4 fully autonomous.

Auto-GPT God Mode

OpenAIMaster's Guide to Auto-GPT

How does Auto-GPT work, an AI tool to create full projects.

AgentGPT

GPT agents in browser.

DemoGPT

🧩 DemoGPT enables you to create quick demos by just using prompts.

Understanding Prompt Injections and What You Can Do About Them

An introduction to prompt injections with examples and tactics you can use to mitigate potential risks in your application.

Learn Prompting's Prompt Injection guide

A guide to prompt injections with examples.

Prompt injection: What's the worst that can happen?

General overview of Prompt Injection attacks, part of a series.

Prompt injections are bad, mkay?

Interactive playground for testing prompt injections.

ChatGPT plugins

OpenAI Official Page.

Plug-in example code in Python

Example code for creating a ChatGPT plug-in in Python.

Surfer Plug-in source code

Security

(PAID) Create, deploy, monitor and secure LLM Plugins.

Prompt-Talent

Prompt Engineering job offers.

llm

Use any LLM from the command line, easily.

FuturePedia

The Largest AI Tools Directory Updated Daily.

Theresanaiforthat

The biggest AI aggregator.

Awesome-Prompt-Engineering

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGP…

AiTreasureBox

EwingYangs Awesome-open-gpt

In Chinese – Open Source Projects Related to GPT.

KennethanCeyer Awesome-llmops

KennethanCeyer awesome-llm

tensorchord Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers.

Price Per Token

Compare LLM API pricing across 300+ models with benchmarks and cost calculators.