Skip to Content
Windows Server Inside Out: Updated for Windows Server 2025
book

Windows Server Inside Out: Updated for Windows Server 2025

by Orin Thomas
December 2025
Beginner to intermediate
865 pages
22h 42m
English
Microsoft Press
Content preview from Windows Server Inside Out: Updated for Windows Server 2025

Chapter 26

Hosting large language models on Windows Server

Ollama on Windows Server

Azure Foundry Local on Windows Server

Large language models (LLMs) function as the back end for modern AI chatbots. While you can subscribe to LLMs from various vendors like OpenAI, Anthropic, Google, and x.AI for a monthly fee or run LLMs in an environment like Azure Foundry with a monthly subscription, there’s a large and healthy ecosystem of freely available open-source LLM models that can be run locally on an appropriately spec’ed machine. The free LLM models aren’t as competent as the cutting edge models, but it isn’t unusual for the free open models to achieve the same benchmark scores on problem-solving and reasoning within 12 to 18 months.

Computer hardware ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Windows Server 2019 Inside Out

Windows Server 2019 Inside Out

Orin Thomas

Publisher Resources

ISBN: 9780135345863