February 2024
Intermediate to advanced
649 pages
9h 58m
Chinese
Content preview from Python和NLTK实现自然语言处理
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
附录A 宾州treebank词性标签
以下是使用NLTK分类在treebank语料库中出现的所有词性标签表。可以使用下面的代码获得下表。
>>> from nltk.probability import FreqDist
>>> from nltk.corpus import treebank
>>> fd = FreqDist()
>>> for word, tag in treebank.tagged_words():
... fd[tag] += 1
>>> fd.items()FreqDist fd包含了在treebank语料库中对于每个标签在此处显示的所有计数。可以通过使用fd[tag]，单独检查每个标签数，例如，fd['DT']。这里也显示了一些标点符号标签，以及一些特殊的标签（如-NONE-），-NONE-意味着词性标签是未知的。在upenn网站中，可以找到大部分标签的描述。
|
词性标签 |
出现频次 |
|---|---|
|
# |
16 |
|
$ |
724 |
|
'' |
694 |
|
, |
4886 |
|
-LRB- |
120 |
|
-NONE- |
6592 |
|
-RRB- |
126 |
|
. |
384 |
|
: |
563 |
|
'' |
712 |
|
CC |
2265 |
|
CD |
3546 |
|
DT |
8165 |
|
EX |
88 |
|
FW |
4 |
|
IN |
9857 |
|
JJ |
5834 |
|
JJR |
381 |
|
JJS |
182 |
|
LS |
13 |
|
MD |
927 |
|
NN |
13166 |
|
NNP |
9410 |
|
NNPS |
244 |
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.