Low quality PDFs in https://huggingface.co/datasets/databricks/officeqa-pro-v2

オープン
#57 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る

まだ誰も着手していません。

評価

難易度
3/5
見積もり時間
1〜2日
初心者へのやさしさ
45/100
issue の種類
バグ
明瞭さ
おおむね明確
活発さ
活発
技術スタック
huggingface
領域
data

調査の方向性

Hugging Face の officeqa-pro-v2 データセットから始め、報告された画像および OCR と照合しながら、combined_statement__historical__cs-1942.pdf、特に 7 ページを調査します。データセット作成時にリリースされた PDF がダウンスケールされていたかどうかを判断します。影響を受けた PDF が修正され、7 ページが読みやすくなり、OfficeQA v2 の結果を再現できれば完了です。

索引モデルが issue の本文から書いたものです。

説明

Hi!

I noticed some data quality issues in the PDFs for the released dataset https://huggingface.co/datasets/databricks/officeqa-pro-v2.
As an example, in combined_statement__historical__cs-1942.pdf, page 7, the image is unreadable; yet, the OCR reports readable text.

We assume that the PDFs may have been downscaled by accident when creating the HuggingFace dataset, which hinders reproducing the reported results in the officeqa v2 paper.

Image
SUMMARY—RECEIPTS, EXPENDITURES, AND BALANCES

7

SUMMARY OF RECEIPTS, EXPENDITURES, AND BALANCES, FISCAL YEAR 1942*

RECEIPTS

<table><tr><td>General fund balance, June 30, 1941</td><td></td><td>$2,597,537,894.77</td></tr><tr><td>General accounts</td><td>$13,604,928,705.41</td><td></td></tr><tr><td>Special accounts</td><td>195,244,390.51</td><td></td></tr><tr><td></td><td>13,700,173,095.92</td><td></td></tr><tr><td>Trust accounts (excluding corporate funds)</td><td>2,315,101,909.41</td><td>16,015,275,005.33</td></tr><tr><td>Public-debt receipts</td><td></td><td>337,220,909,061.64</td></tr><tr><td>Total</td><td></td><td>55,833,721,961.74</td></tr></table>

EXPENDITURES

<table><tr><td>General and special accounts (checks-issued)</td><td>$33,385,613,309.64</td><td></td></tr><tr><td>Net deductions</td><td>4829,032.79</td><td></td></tr><tr><td></td><td></td><td>$33,384,784,276.85</td></tr><tr><td>Trust accounts (checks-issued)</td><td>2,964,533,376.74</td><td></td></tr><tr><td>Net additions</td><td>5126,848,852.65</td><td></td></tr><tr><td></td><td></td><td>3,091,382,229.39</td></tr><tr><td>Expenditures (net checks-issued) in checking accounts of government agencies</td><td>63,649,049,944.08</td><td></td></tr><tr><td>Net deductions</td><td>742,311,003.00</td><td></td></tr><tr><td></td><td></td><td>3,606,738,941.08</td></tr><tr><td>Increase in outstanding checks (deduct)</td><td></td><td>572,385,743.44</td></tr><tr><td>Public-debt expenditures payable from permanent indefinite appropriations (exclusive of $94,417,650.00 included under general and special accounts above)</td><td></td><td>13,610,227,937.22</td></tr><tr><td>General fund balance, June 30, 1942</td><td></td><td>2,712,974,320.64</td></tr><tr><td>Total</td><td></td><td>55,833,721,961.74</td></tr></table>

*Figures in this statement adjusted to the basis of the Daily Treasury Statement (revised).
1 Excludes $1,171,268.44 receipts, account of Farm Credit Administration revolving funds used as credits to (deductions from) expenditures in Daily Treasury Statement.
2 Includes $78,237,996.10 deposited in special deposit accounts for National Service Life Insurance Fund and U. S. Government Life Insurance Fund. Also includes $438,616.59 transfers to trust accounts, National Service Life Insurance Fund, reflected on the books of the Treasurer of the United States in fiscal year 1942 counter-entered in fiscal year 1943.
3 Includes $271,285,436.49 unclassified sales of United States Savings Bonds.
4 Deduct:
(1) Funds credited on the books of Division of Bookkeeping and Warrants as receipts and appropriated, but reflected in the Daily Treasury Statement as credits to (deductions from) expenditures----$1,171,268.44
(2) Funds credited to expenditures on the books of Division of Bookkeeping and Warrants during fiscal year 1941 not reflected as credits on books of Treasurer of the United States until fiscal year 1942----312,454.18
(3) Funds credited to expenditures on the books of Division of Bookkeeping and Warrants during the fiscal year 1943, credited on books of Treasurer of the United States during fiscal year 1942----793,111.87

486320 O - 43 - 2

Add:

<table><tr><td>(1)</td><td>Funds credited to expenditures on the books of Division of Bookkeeping and Warrants during fiscal year 1942 not reflected as credits on books of Treasurer of the United States until fiscal year 1943</td><td>$839,351.49</td></tr><tr><td>(2)</td><td>Adjustment of prior year receipts credited direct to appropriations</td><td>9.15</td></tr><tr><td>(3)</td><td>Funds transferred to trust accounts from general accounts by transfer appropriation warrant</td><td>608,441.06</td></tr></table>

5 Add:

<table><tr><td>(1)</td><td>Funds transferred to trust from general accounts through checking accounts</td><td>$126,208,000.00</td></tr><tr><td>(2)</td><td>Funds credited to expenditures in this report but treated as receipts on the books of the Treasurer of the United States</td><td>2,397,933.34</td></tr></table>

Deduct:

<table><tr><td>(1) Funds deposited in special deposit accounts not credited on books of the Treasurer of the United States until fiscal year 1943</td><td>1,757,080.69</td></tr></table>

6 Includes transactions involving funds acquired through sale of obligations in the market. 7 Funds credited on the books of Division of Bookkeeping and Warrants as receipts and appropriated, but reflected in the Daily Treasury Statement as credits to (deductions from) 
```expenditures.
主要言語
Jupyter Notebook
スター
205
フォーク
17
PR マージ指標
30日以内にマージされた PR はありません

環境構築

このプロジェクトには開発コンテナ、Dockerfile、コントリビューションガイドがありません。まず README を読み、一般的な手順ははじめてのコントリビューションガイドを参照してください。

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

databricks/officeqa のほかの issue

databricks/officeqa の issue をすべて見る

似ている issue

Data Engineering の issue をもっと見る

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。