Skip to content

kuhushukla/spark-rapids-tools

This branch is 407 commits behind NVIDIA/spark-rapids-tools:dev.

Folders and files

NameName
Last commit message
Last commit date
Sep 7, 2023
Oct 23, 2023
Oct 18, 2023
Oct 27, 2023
Aug 30, 2023
Oct 9, 2023
Aug 10, 2023
Dec 12, 2022
May 12, 2023
Jan 18, 2023
May 12, 2023
Feb 9, 2023
Nov 4, 2022

Repository files navigation

RAPIDS Accelerator for Apache Spark Tools

This repo provides the tools to use RAPIDS Accelerator for Apache Spark.

Catalog

  • RAPIDS core tools: Tools that help developers getting the most out of their Apache Spark applications without any code change:
    • Report acceleration potential of RAPIDS Accelerator for Apache Spark on a set of Spark applications.
    • Generate comprehensive profiling analysis for Apache Sparks executing on accelerated GPU instances. This information can be used to further tune and optimize the application.
  • spark-rapids-user-tools: A simple wrapper process around cloud service providers to run RAPIDS core tools across multiple cloud platforms. In addition, the output educates the users on the cost savings and acceleration potential of RAPIDS Accelerator for Apache Spark and makes recommendations to tune the application performance based on the cluster shape.

About

User tools for Spark RAPIDS

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 52.1%
  • Python 37.7%
  • JavaScript 5.7%
  • HTML 2.3%
  • Shell 1.9%
  • CSS 0.2%
  • MAXScript 0.1%