Tag:llm-qualitative-evals

All the articles with the tag "llm-qualitative-evals".

• Contrasting Sam Altman and Paul Graham's ideas on doing great work, with LLMs

  July 13, 2023 |  at 03:22 PM

  Comparing their worldviews, "fairly", using a language model.

• Questions for large LLM labs they'll probably not want to answer

  May 30, 2023 |  at 03:22 PM

  But good to build a list centrally of what people are asking.

• Evaluating GPT-4 through literally one summarization, but deeply and systematically

  May 30, 2023 |  at 03:22 PM

  In this post, I evaluate GPT-4 through summarizing a YouTube video.

• Asking GPT-4 to create a table of contents

  June 3, 2023 |  at 03:22 PM

  In this post, I ask GPT-4 to create a table of contents of a YouTube video from it's transcript.

• Q&A-ing a book with Claude 100k

  June 8, 2023 |  at 12:00 AM

  and comparing it to retrieve-then-read results via Llama Index and GPT-3.