Skip to content

Commit

Permalink
template
Browse files Browse the repository at this point in the history
  • Loading branch information
kathweinschenkprophecy committed Jan 3, 2025
1 parent 6cbb503 commit 7b9e64f
Show file tree
Hide file tree
Showing 2 changed files with 34 additions and 0 deletions.
22 changes: 22 additions & 0 deletions docs/Spark/gems/_gem-requirements.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,28 @@ export default function Requirements(props) {
</tr>
</tbody>
</table>
<table style={{ width: "auto", tableLayout: "auto" }}>
<thead>
<tr>
<th>UC Shared Cluster Version</th>
<th>Minimum Package Version</th>
</tr>
</thead>
<tbody>
<tr>
<td>12.2</td>
<td>{props.packageversion12}</td>
</tr>
<tr>
<td>14.3</td>
<td>{props.packageversion14}</td>
</tr>
<tr>
<td>15.4</td>
<td>{props.packageversion15}</td>
</tr>
</tbody>
</table>
</div>
);
}
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,8 @@ tags:
- generator
---

import Requirements from "../../../\_gem-requirements.mdx"

<h3><span class="badge">Spark Gem</span></h3>

Generate synthetic data with this special kind of Source Gem.
Expand All @@ -23,6 +25,16 @@ A wide range of synthetic data can be created using any column name and an array

Follow the steps below to generate your own mock data using the Data Generator Gem.

<Requirements
packagename="ProphecySparkBasicsPython"
packageversion="0.2.36"
scalalib="8.5.0"
pythonlib="1.9.24"
packageversion122="2.2.2"
packageversion143="Not Supported"
packageversion154="Not Supported"
/>

## Cluster requirements

Create a Fabric and configure the [Job Size](/docs/Spark/fabrics/databricks.md) as below, or log into an existing Spark cluster UI. Here we use Databricks as an example.
Expand Down

0 comments on commit 7b9e64f

Please sign in to comment.