Add dataset: royal_society_corpus
@shamikbose 已经在做这个了。
开始于 2022年7月12日。
评估
这个 Issue 还没有评估数据。
描述
A URL for this dataset
https://fedora.clarin-d.uni-saarland.de/rsc/
Dataset description
The Royal Society Corpus (RSC) is based on the first two centuries of the Philosophical Transactions of the Royal Society of London from its beginning in 1665 to 1869. It includes all publications of the journal written mainly in English and containing running text. The Philosophical Transactions was the first periodical of scientific writing in England. Founded in 1665 by Henry Oldenburg, the first secretary of the Royal Society, it initially contained excerpts of letters of his scientific correspondence, reviews and summaries of recently-published books, and accounts of observations and experiments.
This offers an interesting dataset of text from the scientific domain across a long time period (1665-1869). Additionaly the dataset contains a range of annotations:
The corpus is tokenized and linguistically annotated for lemma and part-of-speech using TreeTagger (Schmid 1994, Schmid 1995). For spelling normalization we use a trained model of VARD (Baron and Rayson 2008). As a special feature, we encode with each unit (word token) its average surprisal, i.e. the average amount of information it encodes in number of bits, with words as units and trigram as contexts [cf. Genzel and Charniak 2002).
Detailed information on the linguistic and structural annotation of the RSC can be found here.
The RSC consists of approximately 35 million token and is encoded for text type (abstracts, articles), author, year of publication. Information about decade and 50-year periods are also available allowing for a diachronic analysis of different granularity. Token sizes of the different subcorpora and other corpus statistics can be found here.
Dataset modality
Text
Dataset licence
Creative Commons Attribution Non Commercial Share Alike 4.0 International
Other licence
No response
How can you access this data
As a download from a repository/website
Confirm the dataset has an open licence
- To the best of my knowledge, this dataset is accessible via an open licence
Contact details for data custodian
- 主要语言
- 没有语言数据
- 星标
- 91
- 派生
- 8
- PR 合并指标
- 30 天内没有已合并 PR
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南，环境需要你自己搭建：先看它的 README，通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
bigscience-workshop/lam 的其他 Issue
-
dataset good first issue
难度 2/5 1-3 小时 新手友好度 68/100
bigscience-workshop/lam#86 · 1 条评论 ·
-
dataset
难度 2/5 1-3 小时 新手友好度 68/100
bigscience-workshop/lam#65 · 1 条评论 ·
-
candidate-dataset
难度 2/5 1-3 小时 新手友好度 35/100
bigscience-workshop/lam#92 · 1 条评论 ·
-
dataset
难度 2/5 1-3 小时 新手友好度 35/100
bigscience-workshop/lam#87 ·
-
dataset
难度 4/5 3-5 天 新手友好度 42/100
bigscience-workshop/lam#85 · 1 个 reaction ·