Skip to content

Commit

Permalink
Merge remote-tracking branch 'refs/remotes/origin/gcs-api-metrics-3-0…
Browse files Browse the repository at this point in the history
…' into gcs-api-metrics-3-0
  • Loading branch information
arunkumarchacko committed Jul 15, 2024
2 parents 8d98e71 + d9c81e1 commit 137fc17
Show file tree
Hide file tree
Showing 36 changed files with 1,821 additions and 476 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ To add a dependency on Cloud Storage connector using Maven, use the following:
<dependency>
<groupId>com.google.cloud.bigdataoss</groupId>
<artifactId>gcs-connector</artifactId>
<version>3.0.0</version>
<version>3.0.1</version>
</dependency>
```

Expand Down
4 changes: 2 additions & 2 deletions coverage/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -21,11 +21,11 @@
<parent>
<groupId>com.google.cloud.bigdataoss</groupId>
<artifactId>bigdataoss-parent</artifactId>
<version>3.0.1-SNAPSHOT</version>
<version>3.0.2-SNAPSHOT</version>
</parent>

<artifactId>coverage</artifactId>
<version>3.0.1-SNAPSHOT</version>
<version>3.0.2-SNAPSHOT</version>
<packaging>pom</packaging>

<profiles>
Expand Down
4 changes: 4 additions & 0 deletions gcs/CHANGES.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,12 @@
# Release Notes

## Next

## 3.0.1 - 2024-07-10
1. Add readVectored API implementation.

1. Add gRPC configuration documentation.


## 3.0.0 - 2023-12-03

Expand Down
27 changes: 27 additions & 0 deletions gcs/CONFIGURATION.md
Original file line number Diff line number Diff line change
Expand Up @@ -457,6 +457,33 @@ Knobs configure the vectoredRead API
Minimum size in bytes of the read range for Cloud Storage request when
opening a new stream to read an object.
### grpc configuration
gRPC is an optimized way to connect with gcs backend. It offers
better latency and increased bandwidth. Currently supported only for read/write operations.
* `fs.gs.client.type` (default: `HTTP_API_CLIENT`)
Valid values:
* `HTTP_API_CLIENT` uses json api to connect to gcs backend. Uses http
over cloudpath.
* `STORAGE_CLIENT` uses Java-storage client to connect to gcs backend. Uses
gRPC.
* `fs.gs.grpc.write.enable` (default: `false`)
Is effective only of if `STORAGE_CLIENT` is selected. Enables write to go over
grpc.
* `fs.gs.client.upload.type` (default: `CHUNK_UPLOAD`)
This is only effective if `STORAGE_CLIENT` is selected.
Valid values:
* `CHUNK_UPLOAD` uploads file in chunks, size of chunks are configurable via
`fs.gs.outputstream.upload.chunk.size`
### Performance cache configuration
* `fs.gs.performance.cache.enable` (default: `false`)
Expand Down
4 changes: 2 additions & 2 deletions gcs/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@
<parent>
<groupId>com.google.cloud.bigdataoss</groupId>
<artifactId>bigdataoss-parent</artifactId>
<version>3.0.1-SNAPSHOT</version>
<version>3.0.2-SNAPSHOT</version>
<relativePath>../pom.xml</relativePath>
</parent>

Expand All @@ -31,7 +31,7 @@
</description>

<artifactId>gcs-connector</artifactId>
<version>3.0.1-SNAPSHOT</version>
<version>3.0.2-SNAPSHOT</version>

<profiles>
<profile>
Expand Down
Loading

0 comments on commit 137fc17

Please sign in to comment.