meta-issue: frameless-ml
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 20/100
- Issue type
- Feature
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- scala, spark
- Domain
- machine-learning
Research direction
Start with the Spark ML guide linked in the issue and choose one unchecked abstraction, transformer, estimator, or evaluator. The issue names no files, tests, or entry points, so first locate the existing typed implementations for completed items and their test structure. Done means implementing the selected Spark ML equivalent and updating this checklist.
Written by the indexing model from the issue text.
Description
Meta-issue to list what has been done in frameless-ml and what remains to be done.
Spark ML docs: https://spark.apache.org/docs/latest/ml-guide.html
Abstractions
-
TypedTransformer, the type-safe equivalent of Spark ML Transformer -
TypedEstimator, the type-safe equivalent of Spark ML Estimator -
TypedPipeline, the type-safe equivalent of Spark ML Pipeline -
TypedEvaluator, the type-safe equivalent of Spark ML Evaluator
Typed transformers
- TF-IDF
- Word2Vec
- CountVectorizer
- Tokenizer
- StopWordsRemover
- nn-gram
- Binarizer
- PCA
- PolynomialExpansion
- Discrete Cosine Transform (DCT)
- StringIndexer
- IndexToString
- OneHotEncoder
- VectorIndexer
- Interaction
- Normalizer
- StandardScaler
- MinMaxScaler
- MaxAbsScaler
- Bucketizer
- ElementwiseProduct
- SQLTransformer
- VectorAssembler
- QuantileDiscretizer
- Imputer
- Feature Selectors
- VectorSlicer
- RFormula
- ChiSqSelector
- Locality Sensitive Hashing
- LSH Operations
- Approximate Similarity Join
- Approximate Nearest Neighbor Search
- LSH Algorithms
- Bucketed Random Projection for Euclidean Distance
- MinHash for Jaccard Distance
Typed estimators
- Binomial logistic regression
- Multinomial logistic regression
- Decision tree classifier
- Random forest classifier
- Gradient-boosted tree classifier
- Multilayer perceptron classifier
- Linear Support Vector Machine
- One-vs-Rest classifier (a.k.a. One-vs-All)
- Naive Bayes
- Linear regression
- Generalized linear regression
- Available families
- Decision tree regression
- Random forest regression
- Gradient-boosted tree regression
- Survival regression
- Isotonic regression
- K-means
- Latent Dirichlet allocation (LDA)
- Bisecting k-means
- Gaussian Mixture Model (GMM)
- ALS
- FP-Growth
- CrossValidator
- TrainValidationSplit
Typed evaluators
- RegressionEvaluator
- BinaryClassificationEvaluator
- MulticlassClassificationEvaluator
- Dominant language
- Scala
- Stars
- 896
- Forks
- 135
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from typelevel/frameless
-
Scala 3 buildsOpenenhancement feature help wanted
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
-
enhancement feature
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
All issues in typelevel/frameless
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Maintainers usually reply within 1 day
-
good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
Fix Math.ceilDiv wrong result for exact positive divisionsPossibly taken @pamod-madubashana claimed this 1 day ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
scala-native/scala-native#5094 ·
Maintainers usually reply within 1 day
-
dependencies tech-debt
Difficulty 1/5 Under an hour Newbie friendliness 85/100
Maintainers usually reply within 2 days
-
"Show threat" doesn't show the evaluation of the threatPossibly taken @Zinkelburger claimed this 2 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
lichess-org/lila#22008 · 2 comments ·
Maintainers usually reply within 1 day