August 2022
Intermediate to advanced
441 pages
11h 26m
Chinese
Content preview from Python文本分析
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
文本摘要
｜
285
9.6
案例：使用机器学习生成文本摘要
可能很多人都参与过在线论坛，讨论有关旅行计划、编程等主题。这些
平台上的用户以话题的形式进行交流。任何人都可以发起一个话题，而
其他成员则可以回复这个话题。话题可能会变得很长，而关键信息也可能会丢失。
在这个案例中，我们将使用从某个旅行论坛中提取的数据（来自一篇研究论文）
注
2
，
其中包含某个话题中的所有帖子的文本，以及话题的摘要，如图
9-4
所示。
图 9-4：来自某个旅行论坛的某个话题的帖子以及相应的摘要
在这个案例中，我们打算使用机器学习，帮助我们自动识别整个话题中最重要的且
能够准确地总结整个话题的帖子。首先我们使用人工创建的摘要，为数据集库创建
目标标签；接着，我们生成特征，并通过特征判断某个帖子是否应该出现在摘要中；
最后训练模型，并评估其准确性。这个任务与文本分类非常相似，只不过是在帖子
的级别上进行。
注 2： Sansiri Tarnpradab 等，“Toward Extractive Summarization of Online ForumDiscussions
via Hierarchical Attention Networks”，
https://arxiv.org/abs/1805.10390
。有关数据集
（
.zip
），请参见
https://oreil.ly/cqU_O
。
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.