Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQuery Connector #2532

Closed
wants to merge 26 commits into from
+4,018 −3
Closed

BigQuery Connector #2532

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
291ed16
presto-bigquery initial commit
davidrabinowitz Jan 9, 2020
ef7bdca
fixed error-prone-checks
davidrabinowitz Jan 16, 2020
4a72cb5
Applying @ebyhr comments, apart from main pom.xml
davidrabinowitz Jan 30, 2020
4a46f9b
presto-bigquery initial commit
davidrabinowitz Jan 9, 2020
21e00de
docs update
davidrabinowitz Jan 30, 2020
8474683
Fixing @ebyhr POM comments
davidrabinowitz Jan 30, 2020
192b5cd
fixed TestBigQueryConfig
davidrabinowitz Jan 30, 2020
48cddd3
fixed TestBigQueryConfig - lazy loading default project id
davidrabinowitz Jan 30, 2020
0cd0e98
update version
davidrabinowitz Feb 4, 2020
94246fa
fixing post-merge issues
davidrabinowitz Feb 4, 2020
8e5fbad
Applied @electrum comments
davidrabinowitz Feb 5, 2020
22cc015
resolving coding style issues raised by @electrum
davidrabinowitz Feb 13, 2020
4b4828c
resolving coding style issues raised by @electrum
davidrabinowitz Feb 13, 2020
3a9f790
fixed doc
davidrabinowitz Feb 13, 2020
debd2d2
resolving coding and doc style issues raised by @electrum
davidrabinowitz Feb 13, 2020
ce4e215
fixing cehckstyle issues
davidrabinowitz Feb 13, 2020
78dba25
More fixes, added TestBigQueryIntegrationSmokeTest
davidrabinowitz Feb 15, 2020
c76755b
Resolving @electrum comments, implementing empty projection for count(*)
davidrabinowitz Feb 26, 2020
a013b88
Upgrage to 331-SNAPSHOT, fix style issues
davidrabinowitz Feb 26, 2020
9860640
Fixing https://github.com/prestosql/presto/pull/2532#discussion_r3773…
davidrabinowitz Feb 27, 2020
9e06909
BigQuery datetime is now represented by Presto timestamp, as asked in…
davidrabinowitz Feb 27, 2020
ea18ab7
Supporting tables and datasets with uppper case characters, correct h…
davidrabinowitz Feb 27, 2020
4a92bd0
fixing code format
davidrabinowitz Feb 27, 2020
8415489
Fixing documentation
davidrabinowitz Feb 28, 2020
07d3da5
Fixing documentation
davidrabinowitz Feb 28, 2020
bcdfad9
table type is now correctly shown in the information_schema
davidrabinowitz Feb 28, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,7 @@
<module>presto-elasticsearch</module>
<module>presto-iceberg</module>
<module>presto-google-sheets</module>
<module>presto-bigquery</module>
</modules>

<dependencyManagement>
Expand Down
287 changes: 287 additions & 0 deletions presto-bigquery/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,287 @@
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns="http://maven.apache.org/POM/4.0.0"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>

<parent>
<groupId>io.prestosql</groupId>
<artifactId>presto-root</artifactId>
<version>331-SNAPSHOT</version>
</parent>

<artifactId>presto-bigquery</artifactId>
<description>Presto - BigQuery Connector</description>
<packaging>presto-plugin</packaging>

<properties>
<air.main.basedir>${project.parent.basedir}</air.main.basedir>
<dep.gax.version>1.49.1</dep.gax.version>
<dep.google-auth-library.version>0.18.0</dep.google-auth-library.version>
<dep.google-cloud-core.version>1.91.3</dep.google-cloud-core.version>
</properties>

<dependencyManagement>
<dependencies>
<dependency>
<groupId>com.google.api.grpc</groupId>
<artifactId>proto-google-common-protos</artifactId>
davidrabinowitz marked this conversation as resolved.
Show resolved Hide resolved
<version>1.17.0</version>
</dependency>

<dependency>
<groupId>io.grpc</groupId>
<artifactId>grpc-bom</artifactId>
<version>1.24.1</version>
<type>pom</type>
<scope>import</scope>
</dependency>
</dependencies>
</dependencyManagement>

<dependencies>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>configuration</artifactId>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>bootstrap</artifactId>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>json</artifactId>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>log</artifactId>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>log-manager</artifactId>
</dependency>

<dependency>
<groupId>com.google.api</groupId>
<artifactId>gax</artifactId>
<version>${dep.gax.version}</version>
</dependency>

<dependency>
<groupId>com.google.api</groupId>
<artifactId>gax-grpc</artifactId>
<version>${dep.gax.version}</version>
</dependency>

<dependency>
<groupId>io.grpc</groupId>
<artifactId>grpc-api</artifactId>
</dependency>

<dependency>
<groupId>com.google.auth</groupId>
<artifactId>google-auth-library-credentials</artifactId>
<version>${dep.google-auth-library.version}</version>
</dependency>

<dependency>
<groupId>com.google.auth</groupId>
<artifactId>google-auth-library-oauth2-http</artifactId>
<version>${dep.google-auth-library.version}</version>
</dependency>

<dependency>
<groupId>com.google.cloud</groupId>
<artifactId>google-cloud-core</artifactId>
<version>${dep.google-cloud-core.version}</version>
</dependency>

<dependency>
<groupId>com.google.cloud</groupId>
<artifactId>google-cloud-core-http</artifactId>
<version>${dep.google-cloud-core.version}</version>
</dependency>

<dependency>
<groupId>com.google.http-client</groupId>
<artifactId>google-http-client</artifactId>
<version>1.32.1</version>
<exclusions>
<exclusion>
<groupId>commons-logging</groupId>
<artifactId>commons-logging</artifactId>
</exclusion>
</exclusions>
</dependency>

<dependency>
<groupId>com.google.api.grpc</groupId>
<artifactId>proto-google-cloud-bigquerystorage-v1beta1</artifactId>
<version>0.84.0</version>
</dependency>

<dependency>
<groupId>com.google.cloud</groupId>
<artifactId>google-cloud-bigquery</artifactId>
<version>1.101.0</version>
<exclusions>
<exclusion>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
<exclusion>
<groupId>commons-logging</groupId>
<artifactId>commons-logging</artifactId>
</exclusion>
</exclusions>
</dependency>

<dependency>
<groupId>com.google.cloud</groupId>
<artifactId>google-cloud-bigquerystorage</artifactId>
<version>0.119.0-beta</version>
<exclusions>
<exclusion>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</exclusion>

<exclusion>
<groupId>commons-logging</groupId>
<artifactId>commons-logging</artifactId>
</exclusion>
</exclusions>
</dependency>

<dependency>
<groupId>com.google.protobuf</groupId>
<artifactId>protobuf-java</artifactId>
<version>3.10.0</version>
</dependency>

<dependency>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</dependency>

<dependency>
<groupId>com.google.inject</groupId>
<artifactId>guice</artifactId>
</dependency>

<dependency>
<groupId>javax.validation</groupId>
<artifactId>validation-api</artifactId>
</dependency>

<dependency>
<groupId>javax.inject</groupId>
<artifactId>javax.inject</artifactId>
</dependency>

<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro</artifactId>
</dependency>

<!-- Presto SPI -->
<dependency>
<groupId>io.prestosql</groupId>
<artifactId>presto-spi</artifactId>
<scope>provided</scope>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>slice</artifactId>
<scope>provided</scope>
</dependency>

<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
<scope>provided</scope>
</dependency>

<!-- for testing -->
<dependency>
<groupId>org.testng</groupId>
<artifactId>testng</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>org.assertj</groupId>
<artifactId>assertj-core</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>org.mockito</groupId>
<artifactId>mockito-core</artifactId>
<version>3.2.4</version>
<scope>test</scope>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>testing</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>io.prestosql</groupId>
<artifactId>presto-main</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>io.prestosql</groupId>
<artifactId>presto-tpch</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>io.prestosql</groupId>
<artifactId>presto-testing</artifactId>
<scope>test</scope>
</dependency>

<dependency>
<groupId>io.prestosql</groupId>
<artifactId>presto-tests</artifactId>
<scope>test</scope>
</dependency>

<dependency>
davidrabinowitz marked this conversation as resolved.
Show resolved Hide resolved
<groupId>io.prestosql</groupId>
<artifactId>presto-client</artifactId>
<scope>test</scope>
</dependency>
</dependencies>

<build>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-plugin</artifactId>
<configuration>
<excludes>
<!--Run this after uncommenting properties below-->
<exclude>**/TestBigQueryIntegrationSmokeTest.java</exclude>
</excludes>
</configuration>
</plugin>
</plugins>
</build>

</project>
Loading