February 2025
Intermediate
376 pages
9h 25m
Japanese
Content preview from 仕組みからわかる大規模言語モデル 生成AI時代のソフトウェア開発入門
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
していることを確認できるはずです。また、同様の手順をあと数回繰り返すことで、最終的に
最小値付近に収束していることがわかります。
2.5.2
学習率の役割と影響
学習率は、パラメータ更新の大きさを調整するハイパーパラメータです。学習率が大きいほ
ど、1回の更新で大きくパラメータが変化します。逆に、学習率が小さいほど1回の更新での
パラメータの変化は小さくなります。
先ほどの2.5.1 の例では学習率を0.4 としてパラメータを更新しましたが、学習率を変更す
ると更新の速さが変わることがわかります。例として、学習率を1にした結果を図 2.5.3 に示
します。この場合、学習率が大きすぎるため、損失関数の最小値を飛び越してしまい、収束し
ていません。一方、学習率が小さすぎると、収束に時間がかかってしまいます。適切な学習率
を設定することが、効果的な学習のために重要です。一般的には、学習の初期段階では大きな
学習率を設定し、徐々に学習率を減少させていくという手法がよく用いられます。2.5.4では
それらの手法についても言及します。
図2.5.3
2.5.3
勾配降下法によるパラメータ更新
勾配降下法によるパラメータ更新の手順をまとめると、次のようになります。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.