Owner

sparklyr

1 indexed repository · View on GitHub

sparklyr
R interface for Apache Spark

R · 971 stars

Beginner friendly Everything

Open All

`spark_apply(columns = )` rejects the named vector its documentation promises; only an undocumented DDL string works Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

sparklyr/sparklyr#3529 · 1 comment · Opened Aug 20, 2026
"Subscript out of bounds" when attempting to run collected data from `sdf_sql()` to Databricks Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

sparklyr/sparklyr#3524 · Opened Jun 30, 2026
sql_render error Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

sparklyr/sparklyr#3522 · Opened Jun 22, 2026
Databricks temporary tables Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

sparklyr/sparklyr#3520 · Opened Jun 22, 2026
Update "Connect from Databricks" documentation to specify required scopes for PATs Open

documentation

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

sparklyr/sparklyr#3515 · 1 comment · Opened May 22, 2026
Delare system requirements on java runtime in package DESCRIPTION file? Open

Difficulty 2/5 1-3 hours Newbie friendliness 64/100

sparklyr/sparklyr#3512 · Opened Mar 24, 2026
spark_write_table() fails with TABLE_OR_VIEW_NOT_FOUND when attempting to append data to a non-existent table, Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

sparklyr/sparklyr#3507 · Opened Nov 18, 2025
Unable to connect `sparklyr` to remote Kubernetes Spark cluster (EMR on EKS) Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

sparklyr/sparklyr#3506 · Opened Oct 10, 2025
`ft_dplyr_transformer()` does not work with sampled data in Spark 4.0.1 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3504 · Opened Oct 2, 2025
ml_load() throws java.lang.IllegalArgumentException: Cannot access the UC Volume path Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

sparklyr/sparklyr#3501 · 1 comment · Opened Sep 15, 2025
ml_save causes error org.apache.spark.SparkException: Job aborted Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

sparklyr/sparklyr#3499 · 3 comments · Opened Aug 5, 2025
AttributeError: 'SparkSession' object has no attribute '%>%' Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 32/100

sparklyr/sparklyr#3495 · 4 comments · Opened Jul 23, 2025
Support for 2 and 3 part table id in spark_read_table() Open

databricks enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3484 · Opened Apr 15, 2025
Unexpected results using `filter(is.na(...))` Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3477 · Opened Feb 13, 2025
Issue with SQL translation for ARRAY type spark SQL function args Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

sparklyr/sparklyr#3476 · Opened Feb 10, 2025
USE CATALOG and USE (schema) throw error when interfacing with databricks Open

bug databricks

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3474 · 7 comments · Opened Nov 5, 2024
can't use spark_apply() on sparklyr Open

databricks

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3472 · 1 comment · Opened Oct 31, 2024
spark_read_source does not support non-file paths Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

sparklyr/sparklyr#3471 · Opened Oct 29, 2024
Cannot call spark_read_source with a NULL path Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

sparklyr/sparklyr#3469 · 1 comment · Opened Oct 28, 2024
Error displayed when connecting to Databricks from Databricks pane Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3467 · Opened Oct 10, 2024
src_databases(sc) has argument error when connecting to databricks Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

sparklyr/sparklyr#3465 · 1 comment · Opened Sep 19, 2024
`T` is mistakenly translated to a SQL identifier for a `case_when` inside a callback. Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

sparklyr/sparklyr#3464 · Opened Sep 16, 2024
spark_connect leads to "LINK : fatal error LNK1181: cannot open input file 'R.lib'" Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

sparklyr/sparklyr#3463 · Opened Sep 11, 2024
Tidymodels on Azure Databricks Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3457 · Opened Sep 3, 2024
Date Data type is shown as char and formatted to epoch time in Sparklyr Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3453 · Opened Aug 15, 2024
spark_read_jdbc() with missing column information using Azure Databricks Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

sparklyr/sparklyr#3452 · Opened Aug 7, 2024
spark overwrite with sparklyr(Livy-> aws emr) not working as expected Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3450 · Opened Jul 29, 2024
spark_read_parquet deletes Unity Catalogue table in Databricks Open

databricks

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3447 · Opened Jul 16, 2024
Use multiple sdf as input parameter for spark_apply Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

sparklyr/sparklyr#3446 · 2 comments · Opened Jun 26, 2024
On connecting to Azure Databricks get "Failed to fetch data error" + assignement operator error on query Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3445 · 3 comments · Opened Jun 20, 2024
Error when using spark_apply method Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3444 · 3 comments · Opened Jun 17, 2024
add time series modeling support Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

sparklyr/sparklyr#3442 · 1 comment · Opened May 25, 2024
Error:Object multihash is not exported by 'namespace:openssl' when install sparklyr Open

Difficulty 4/5 3-5 days Newbie friendliness 15/100

sparklyr/sparklyr#3441 · Opened May 22, 2024
partial list of columns in spark_read_x produces unexpected behaviors Open

better-engineering

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3421 · Opened Feb 8, 2024
as.raw type conversion in mutate doesn't seem to translate to spark sql properly. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3420 · Opened Feb 7, 2024
sdf_pivot_longer breaks when using names_sep or names_pattern (multiple names_to) Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

sparklyr/sparklyr#3417 · Opened Feb 1, 2024
spark_apply() error, "Can't query fields" Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3416 · Opened Jan 23, 2024
possible bug in sparklyr logical planner (selections pushed down too far) Open

blocked bug dbplyr

Difficulty 4/5 3-5 days Newbie friendliness 42/100

sparklyr/sparklyr#3413 · 1 reaction · Opened Jan 9, 2024
Incompatible types error for joins not occurring. Open

Difficulty 4/5 3-5 days Newbie friendliness 32/100

sparklyr/sparklyr#3403 · Opened Nov 27, 2023
arrange desc cause error Open

databricks

Difficulty 3/5 1-2 days Newbie friendliness 35/100

sparklyr/sparklyr#3402 · 3 comments · Opened Nov 17, 2023
Cannot write dataframe to Databricks Unity Catalog table Open

databricks

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3397 · 10 comments · Opened Nov 1, 2023
Cluster State Not Being Recognized Open

databricks

Difficulty 4/5 3-5 days Newbie friendliness 28/100

sparklyr/sparklyr#3392 · 3 comments · Opened Oct 26, 2023
Repeated calls to `mutate` and other functions take increasingly long to return Open

dbplyr

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3385 · 1 comment · Opened Oct 11, 2023
Can't connect to dataproc cluster with SOCKS proxy Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3380 · Opened Sep 20, 2023
Spark standalone write permissions failure. Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3376 · 2 comments · Opened Sep 7, 2023
Posit Workbench keeps crashing when connecting to Spark in local mode Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

sparklyr/sparklyr#3374 · 5 comments · Opened Aug 30, 2023
sparklyr arrange behavior is different than dplyr arrange - order null values after non-null values Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

sparklyr/sparklyr#3368 · Opened Aug 22, 2023
sparklyr::sdf_bind_cols not great for lots of columns that are generated from another table Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

sparklyr/sparklyr#3365 · Opened Aug 18, 2023
sparklyr invocation chooses incorrect overloaded method Open

databricks

Difficulty 4/5 3-5 days Newbie friendliness 42/100

sparklyr/sparklyr#3360 · 6 comments · Opened Aug 1, 2023
Investigate test issue Open

bug tests

sparklyr/sparklyr#3341 · 1 assignee · Opened Jun 20, 2023

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

sparklyr

Showing the newest 100

Get new issues in your inbox