go-v.orgdoi

Extending Spark Machine Learning Pipelines

Holden Karau · TIB AV-Portal · 2018

  • DOI 10.5446/42011
  • Publisher Technische Informationsbibliothek (TIB)
  • Type other
  • Issued 2018

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

TIB AV-Portal · Technische Informationsbibliothek (TIB) · other · 2018

Abstract

Apache Spark is one of the most popular new "big data" technologies, and nowhas a sci-kit-learn inspired pipeline API. This talk looks at how the pipelineAPI works as well as how to add your own custom algorithms to Apache Spark. Apache Spark is one of the most popular new "big data" technologies, and nowhas a sci-kit-learn inspired pipeline API. This talk looks at how the pipelineAPI works as well as how to add your own custom algorithms to Apache Spark.The talk will be focused in Scala, but the same techniques can be used in Javaor with other JVM languages.

Sadly extending the pipeline API can notcurrently be done in non-JVM languages, but the information on how to use thepipeline API will be useful to Python and R users as well.

Open the resolved locator · 10.5446/42011

Metadata licence: OpenAlex metadata (CC0)

Registry
OpenAlex DOI index + API
Fetched
2026-11-20 01:40 UTC
Cache state
not cached yet (bulk-index+openalex)
Locator
https://av.tib.eu/media/42011
Metadata licence
OpenAlex metadata (CC0)
Scope
Metadata as returned by the resolver; abstracts are never generated here.