Issue with Downloading Large Views from Tableau Server to CSV
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 4/5
- Tempo stimato
- 3-5 giorni
- Idoneità per principianti
- 42/100
Direzione di ricerca
Start with server.views.populate_csv and the subsequent view.csv handling shown in the report, then reproduce the behavior using a large Tableau view with Python 3.9 and TSC 0.30. Trace where the large response stops progressing or is retained, and compare it with the reported successful small-file path. Done means the large CSV is written successfully, or the limitation and required handling are clearly documented.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Describe the bug
I'm encountering an issue when trying to download a view that is around 200 MB in size. My script works perfectly for smaller files (5 MB or 10 MB), but it keeps running indefinitely and doesn't write data into the CSV file for the larger view.
The script successfully logs "CSV populated," indicating that server.views.populate_csv completes, but the file is not written for larger views.
Here's the code I'm using:
def download_file(client, server, content_url, output_file, region):
# NOTE: Monkey patched TSC.RequestOptions.Field class
# since the contentUrl filter parameter was not supported
setattr(TSC.RequestOptions.Field, 'ContentURL', 'contentUrl')
req_option = TSC.RequestOptions()
req_option.filter.add(TSC.Filter(TSC.RequestOptions.Field.ContentURL,
TSC.RequestOptions.Operator.Equals,
content_url))
logger.info('Fetching views...')
views, pagination_item = server.views.get(req_option)
logger.info(f'Views fetched: {len(views)}')
if len(views) == 1:
only_matched_index = 0
view = views[only_matched_index]
logger.info('Populating CSV...')
server.views.populate_csv(view, TSC.CSVRequestOptions(maxage = 5))
logger.info('CSV populated.')
with open(output_file, 'wb') as f:
f.write(b''.join(view.csv))
logger.info(f"CSV DATA WRITTEN TO the {output_file}")
OUTPUT:
INFO:main:Fetching views...
INFO:main:Views fetched: 1
INFO:main:Populating CSV...
INFO:main:CSV populated.
Could anyone suggest what might be going wrong with handling larger views? Are there any additional steps or considerations when dealing with larger files in Tableau Server that I might be missing?
Any insights or suggestions would be greatly appreciated!
Thank you!
Versions
Details of your environment, including:
- Python version:3.9
- TSC library version:0.30
- Lingua principale
- Python
- Stelle
- 716
- Fork
- 446
- Merge medio
- 8g 8h
- PR unite (30g)
- 2
Guida per i contributori
Apri la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di tableau/server-client-python
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
tableau/server-client-python#1865 ·
-
in-progress
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
tableau/server-client-python#1829 · 1 commento ·
-
enhancement gap needs investigation
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
tableau/server-client-python#1322 · 1 commento ·
-
[Type2] Allow Incremental Refresh type schedules to be added via `server.schedules.add_to_schedule` Apertahelp wanted Server-Side Enhancement ui-exists
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
tableau/server-client-python#1101 · 3 commenti ·
-
enhancement good first issue
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
tableau/server-client-python#783 · 5 commenti ·
Tutte le issue di tableau/server-client-python
Issue simili
-
bug
Difficoltà 2/5 1-3 ore Idoneità per principianti 90/100
learningequality/ricecooker#747 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
BSData/horus-heresy-3rd-edition#3171 ·
-
enhancement
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
run-llama/llama_index#23199 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 84/100
KhronosGroup/glTF-Blender-IO#2769 ·