Key Points

Jargon Busting


  • “AI” is a term people use to refer to a very large variety of different things.
  • Different people have different perspectives on the technology, and these perspectives are sometimes associated with strong feelings.
  • It helps to share what you know and don’t know about.

Large Language Models


  • Large language models generate text output based on patterns in its training data and the context it stores about the task or project.
  • The development of a model includes training on a large volume of data and fine tuning of the resulting weights. The responses produced by a chatbot are also influenced by a fixed system prompt and the contents of the model’s context window.

Output and Uncertainty


  • LLM outputs are generated from tokens randomly selected based on probabilities calculated by the model. The same prompt provided multiple times will usually produce different results even if the starting conditions are identical.
  • Bear this randomness in mind as you work with chatbots: responses that appear authoritative, from tools whose responses are often accurate and helpful, can include inaccuracies.