May 7, 2024
In the past month, we saw a blizzard of new language models. It’s almost hard to consider this news, though Microsoft’s open (but maybe not open source) Phi-3 is certainly worth a look. We’ve also seen promising work on reducing the resources required to do inference. While this may lead to larger models, it should also lead to reduced power use for small and midsized models.
Artificial Intelligence
- Microsoft’s Phi-3-mini is yet another freely available language model. It is small enough to run locally on phones and laptops. Its performance is similar to GPT-3.5 and Mixtral 8x7B.
- Google’s Infini-attention is a new inference technique that allows large language models to offer infinite context.
- Companies are increasingly adding AI bots to their boards as observers. The bots are there to plan strategy, help analyze financials, and report on compliance.
- OutSystems offers a low-code toolkit for building AI agents, unsurprisingly named the AI Agent Builder.
- Ethan Mollick’s Prompt Library is worth checking out. It collects most of the prompts from his book and his blog; most are Creative Commons, requiring only attribution. Anthropic has also published a prompt library for use with Claude, but which probably works with other LLMs.
- There are many solutions for people who want to run large language models locally. They range from desktop apps to APIs. Here’s a list.
- Meta ...
Get Radar Trends to Watch: May 2024 now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
