piskvorky/smart_open
View on GitHub[wasb/wasbs/abfs/abfss] Support for Azure blob file system
Open
#755 opened on Jan 10, 2023
help wanted
Repository metrics
- Stars
- (3,448 stars)
- PR merge metrics
- (PR metrics pending)
Description
Problem description
When trying to run the below code:
smart_open.open("wasb://someContainer/test.csv", transport_params={...})
or
smart_open.open("wasbs://someContainer/test.csv", transport_params={...})
Output
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/tati/Code/astro-sdk-new/astro-sdk/sql-cli/.nox/test-3-8-airflow-2-5/lib/python3.8/site-packages/smart_open/smart_open_lib.py", line 224, in open
binary = _open_binary_stream(uri, binary_mode, transport_params)
File "/home/tati/Code/astro-sdk-new/astro-sdk/sql-cli/.nox/test-3-8-airflow-2-5/lib/python3.8/site-packages/smart_open/smart_open_lib.py", line 399, in _open_binary_stream
submodule = transport.get_transport(scheme)
File "/home/tati/Code/astro-sdk-new/astro-sdk/sql-cli/.nox/test-3-8-airflow-2-5/lib/python3.8/site-packages/smart_open/transport.py", line 93, in get_transport
raise NotImplementedError(message)
NotImplementedError: Unable to handle scheme 'wasb', expected one of ('', 'azure', 'file', 'gs', 'hdfs', 'http', 'https', 's3', 's3a', 's3n', 's3u', 'scp', 'sftp', 'ssh', 'viewfs', 'webhdfs'). Extra dependencies required by 'wasb' may be missing. See <https://github.com/RaRe-Technologies/smart_open/blob/master/README.rst> for details.
ref: https://datacadamia.com/azure/wasb