October 2026
Intermediate to advanced
236 pages
6h 1m
English
Content preview from Evals for AI Engineers
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
References
-
[Tufte 2006] Edward R. Tufte (2006). Beautiful Evidence. Graphics Press, LLC.
-
[Rein 2024] Rein, David and Hou, Betty Li and Stickland, Asa Cooper and Petty, Jackson and Pang, Richard Yuanzhe and Dirani, Julien and Michael, Julian and Bowman, Samuel R (2024). Gpqa: A graduate-level google-proof q&a benchmark. In First Conference on Language Modeling.
-
[Jain 2025] Naman Jain and King Han and Alex Gu and Wen-Ding Li and Fanjia Yan and Tianjun Zhang and Sida Wang and Armando Solar-Lezama and Koushik Sen and Ion Stoica (2025). LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code. In The Thirteenth International Conference on Learning Representations. link
-
[Patil 2024] Patil, Shishir G and Zhang, Tianjun and Fang, Vivian and Huang, Roy and Hao, Aaron and Casado, Martin and Gonzalez, Joseph E and Popa, Raluca Ada and Stoica, Ion and others (2024). Goex: Perspectives and designs towards a runtime for autonomous LLM applications. arXiv preprint arXiv:2404.06921.
-
[Parameswaran 2024] Aditya G. Parameswaran and Shreya Shankar and Parth Asawa and Naman Jain and Yujie Wang (2024). Revisiting Prompt Engineering via Declarative Crowdsourcing. In 14th Conference on Innovative Data Systems Research, CIDR 2024, Chaminade, HI, USA, January 14-17, 2024. link
-
[Clavié 2024] Benjamin Clavié (2024). rerankers: A Lightweight Python Library to Unify Ranking Methods. arXiv preprint arXiv:2408.17344. link
-
[Clavié 2025] Benjamin Clavié (2025). ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.