August 2024
Beginner to intermediate
640 pages
14h 53m
Korean
Content preview from AI를 위한 필수 수학
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
309
Chapter 7 -
자연어 처리와 금융 인공지능: 벡터화와 시계열 분석
7
다음 데이터 샘플을 한 번에 한 토큰씩 신경망에 주입하고 동일한 작업을 다시 수행한다.
8
신경망의 가중치를 업데이트하는 방법은
Chapter
4
에서 했던 것과 정확히 같다. 경사 하강 기반 알고리즘
을 사용해 손실 함수를 최소화하고 필요한 경사 (네트워크의 모든 가중치에 대한 미분 )를 계산해 역전파하
여 신경망의 가중치를 업데이트한다. 방금 말했듯이
Chapter
4
에서 배운 역전파 수학과 완전히 동일하지
만 이번에는 시간을 통해 역전파한다고 볼 수 있다.
금융 분야나 역학 및 피드백 제어 분야에서는 이 프로세스를
ARMA
AutoRegressive
Moving
Average
175
모델이라고도 한다.
순환 신경망을 훈련시키는 것은 연산 비용이 많이 드는 작업이다. 특히
10
개 이상의 토큰을 가
진 데이터 샘플이라면 더욱 그렇다. 학습해야 할 가중치의 수가 데이터 샘플의 토큰 수와 직접
적으로 관련이 있기 때문이다. 조금만 생각해보면 토큰이 많을수록 순환 신경망의 시간적 깊이
가 깊어진다는 사실을 눈치챌 수 있다. 연산 비용 외에도 시간적 깊이가 깊어지면 일반적인 순
전파 신경망의 계층에서 흔히 겪는 문제인 기울기 소실 또는 폭발이 나타난다. 특히 수백 개의
토큰을 가진 데이터 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.