Skip to content

Commit

Permalink
A couple fixes to PROTOCOL and README page (delta-io#288)
Browse files Browse the repository at this point in the history
* add decimal support in protocol

* add link

* note
  • Loading branch information
linzhou-db authored Apr 5, 2023
1 parent c5585be commit 7f01260
Show file tree
Hide file tree
Showing 2 changed files with 28 additions and 17 deletions.
1 change: 1 addition & 0 deletions PROTOCOL.md
Original file line number Diff line number Diff line change
Expand Up @@ -2558,6 +2558,7 @@ boolean | `true` or `false`
binary | A sequence of binary data
date | A calendar date, represented as a `year-month-day` triple without a timezone
timestamp | Microsecond precision timestamp without a timezone
decimal | signed decimal number with fixed precision (maximum number of digits) and scale (number of digits on right side of dot). The precision and scale can be up to 38.

#### Array Type

Expand Down
44 changes: 27 additions & 17 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -224,6 +224,8 @@ val df = spark.read.format("deltaSharing")
### Streaming
Starting from release 0.6.0, Delta Sharing table can be used as a data source for [Spark Structured Streaming](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html).
Once the provider shares a table with history, the recipient can perform a streaming query on the table.

Note: Trigger.AvailableNow is not supported in delta sharing streaming because it's supported since spark 3.3.0, while delta sharing is still using spark 3.1.1.
```scala
val tablePath = "<profile-file-path>#<share-name>.<schema-name>.<table-name>"
val df = spark.readStream.format("deltaSharing")
Expand Down Expand Up @@ -252,7 +254,7 @@ val df = spark.readStream.format("deltaSharing")
<td>Power BI</td>
<td>Databricks owned</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Node.js</td>
Expand All @@ -261,7 +263,7 @@ val df = spark.readStream.format("deltaSharing")
[goodwillpunning/nodejs-sharing-client](https://github.com/goodwillpunning/nodejs-sharing-client)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Java</td>
Expand All @@ -270,7 +272,7 @@ val df = spark.readStream.format("deltaSharing")
[databrickslabs/delta-sharing-java-connector](https://github.com/databrickslabs/delta-sharing-java-connector)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Arcuate</td>
Expand All @@ -279,7 +281,7 @@ val df = spark.readStream.format("deltaSharing")
[databrickslabs/arcuate](https://github.com/databrickslabs/arcuate)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Rust</td>
Expand All @@ -288,7 +290,7 @@ val df = spark.readStream.format("deltaSharing")
[r3stl355/delta-sharing-rust-client](https://github.com/r3stl355/delta-sharing-rust-client)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Go</td>
Expand All @@ -297,7 +299,7 @@ val df = spark.readStream.format("deltaSharing")
[magpierre/delta-sharing](https://github.com/magpierre/delta-sharing/tree/golangdev/golang/delta_sharing_go)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>C++</td>
Expand All @@ -306,7 +308,25 @@ val df = spark.readStream.format("deltaSharing")
[magpierre/delta-sharing](https://github.com/magpierre/delta-sharing/tree/cppdev/cpp/DeltaSharingClient)
</td>
<td>Released</td>
<td>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
<td>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>R</td>
<td>

[zacdav-db/delta-sharing-r](https://github.com/zacdav-db/delta-sharing-r)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Google Spreadsheet</td>
<td>

[delta-incubator/delta-sharing-connectors]( https://github.com/delta-incubator/delta-sharing-connectors/tree/main/google_workspace_add_on)
</td>
<td>Beta</td>
<td>QueryTableVersion<br>QueryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>
<tr>
<td>Airflow</td>
Expand All @@ -326,16 +346,6 @@ val df = spark.readStream.format("deltaSharing")
<td>limited-release</td>
<td>N/A</td>
</tr>
<tr>
<td>R</td>
<td>

[zacdav-db/delta-sharing-r](https://github.com/zacdav-db/delta-sharing-r)
</td>
<td>Released</td>
<td>QueryTableVersion<br>QeuryTableMetadata<br>QueryTableLatestSnapshot</td>
</tr>

<tr>
<td>Lakehouse Sharing</td>
<td>
Expand Down

0 comments on commit 7f01260

Please sign in to comment.