Artificial Intelligence (AI)

Artificial General Intelligence (AGI) vs Narrow AI

Rule-based systems

Machine learning (ML)

Deep learning (DL) with deep artificial neural network (NN)

Generative AI (GenAI)

Non-Generative AI

Natural Language Processing

Neural Language Modeling

Transformers

Foundation Model (such as Large Language Model - LLM)

Foundation models are 1) large deep learning neural networks that are 2) trained on massive unlabeled datasets and 3) could perform a wide range of general tasks such as understanding language, generating text and images, and conversing in natural language. These models are starting point.

Adaptation / Fine-tuning

AI alignment:

  • instruction-following: the ability to follow instructions

GenAI system

external

  • access to tools
  • access to external knowledge, such as your documents and the Internet

Computer Vision

Diffusion Models

Open-source vs closed source

AI Ethics: Starting topics

  • Transparency
  • Accountability