9. BigQuery
9.1. Connection Options
9.1.1. Authentication
Property
Description
AuthScheme
The type of authentication to use when connecting to Google BigQuery.
ProjectId
The ProjectId used to resolve unqualified tables.
DatasetId
The DatasetId of the dataset you wish to connect to and view tables of.
BillingProjectId
The ProjectId of the billing project for executing jobs.
9.1.2. BigQuery
Property
Description
AllowLargeResultSets
Whether or not to allow large datasets to be stored in temporary tables for large datasets.
DestinationTable
This property determines where query results are stored in Google BigQuery.
UseQueryCache
Specifies whether to use Google BigQuery's built-in query cache.
PageSize
The number of results to return per page from Google BigQuery.
PollingInterval
This determines how long to wait in seconds, between checks to see if a job has completed.
AllowUpdatesWithoutKey
Whether or not to allow update without primary keys.
FilterColumns
Please set `AllowUpdatesWithoutKey` to true before you could use this property.
UseLegacySQL
Specifies whether to use BigQuery's legacy SQL dialect for this query. By default, Standard SQL will be used.
9.1.3. Storage API
Property
Description
UseStorageAPI
Specifies whether to use BigQuery's Storage API for bulk data reads.
UseArrowFormat
Specifies whether to use the Arrow format with BigQuery's Storage API.
StorageThreshold
The minimum number of rows a query must return to invoke the Storage API.
StoragePageSize
Specifies the page size to use for Storage API queries.
9.1.4. Uploading
Property
Description
InsertMode
Specifies what kind of method to use when inserting data. By default streaming inserts are used.
WaitForBatchResults
Whether to wait for the job to complete when using the bulk upload API. Only active when InsertMode is set to Upload.
GCSBucket
Specifies the name of a GCS bucket to upload bulk data for staging.
GCSBucketFolder
Specifies the name of the folder in GCSBucket to upload bulk data for staging.
TempTableDataset
The prefix of the dataset that will contain temporary tables when performing bulk UPDATE or DELETE operations.
9.1.5. OAuth
Property
Description
InitiateOAuth
Set this property to initiate the process to obtain or refresh the OAuth access token when you connect.
OAuthClientId
The client ID assigned when you register your application with an OAuth authorization server.
OAuthClientSecret
The client secret assigned when you register your application with an OAuth authorization server.
OAuthAccessToken
The access token for connecting using OAuth.
OAuthSettingsLocation
The location of the settings file where OAuth values are saved when InitiateOAuth is set to GETANDREFRESH or REFRESH. Alternatively, this can be held in memory by specifying a value starting with memory://.
Scope
Identifies the Google API access that your application is requesting. Scopes are space-delimited.
OAuthVerifier
The verifier code returned from the OAuth authorization URL.
OAuthRefreshToken
The OAuth refresh token for the corresponding OAuth access token.
OAuthExpiresIn
The lifetime in seconds of the OAuth AccessToken.
OAuthTokenTimestamp
The Unix epoch timestamp in milliseconds when the current Access Token was created.
9.1.6. JWT OAuth
Property
Description
OAuthJWTCert
The JWT Certificate store.
OAuthJWTCertType
The type of key store containing the JWT Certificate.
OAuthJWTCertPassword
The password for the OAuth JWT certificate.
OAuthJWTCertSubject
The subject of the OAuth JWT certificate.
OAuthJWTIssuer
The issuer of the Java Web Token.
OAuthJWTSubject
The user subject for which the application is requesting delegated access.
9.1.7. SSL
Property
Description
SSLServerCert
The certificate to be accepted from the server when connecting using TLS/SSL.
9.1.8. Firewall
Property
Description
FirewallType
The protocol used by a proxy-based firewall.
FirewallServer
The name or IP address of a proxy-based firewall.
FirewallPort
The TCP port for a proxy-based firewall.
FirewallUser
The user name to use to authenticate with a proxy-based firewall.
FirewallPassword
A password used to authenticate to a proxy-based firewall.
9.1.9. Proxy
Property
Description
ProxyAutoDetect
This indicates whether to use the system proxy settings or not. This takes precedence over other proxy settings, so you'll need to set ProxyAutoDetect to FALSE in order use custom proxy settings.
ProxyServer
The hostname or IP address of a proxy to route HTTP traffic through.
ProxyPort
The TCP port the ProxyServer proxy is running on.
ProxyAuthScheme
The authentication type to use to authenticate to the ProxyServer proxy.
ProxyUser
A user name to be used to authenticate to the ProxyServer proxy.
ProxyPassword
A password to be used to authenticate to the ProxyServer proxy.
ProxySSLType
The SSL type to use when connecting to the ProxyServer proxy.
ProxyExceptions
A semicolon separated list of destination hostnames or IPs that are exempt from connecting through the ProxyServer .
9.1.10. Logging
Property
Description
Logfile
A filepath which designates the name and location of the log file.
Verbosity
The verbosity level that determines the amount of detail included in the log file.
LogModules
Core modules to be included in the log file.
MaxLogFileSize
A string specifying the maximum size in bytes for a log file (for example, 10 MB).
MaxLogFileCount
A string specifying the maximum file count of log files.
9.1.11. Schema
Property
Description
Location
A path to the directory that contains the schema files defining tables, views, and stored procedures.
BrowsableSchemas
This property restricts the schemas reported to a subset of the available schemas. For example, BrowsableSchemas=SchemaA,SchemaB,SchemaC.
Tables
This property restricts the tables reported to a subset of the available tables. For example, Tables=TableA,TableB,TableC.
Views
Restricts the views reported to a subset of the available tables. For example, Views=ViewA,ViewB,ViewC.
RefreshViewSchemas
Allows the provider to determine up-to-date view schemas automatically.
ShowTableDescriptions
Controls whether table descriptions are returned via the platform metadata APIs and sys_tables / sys_views.
PrimaryKeyIdentifiers
Set this property to define primary keys.
AllowedTableTypes
Specifies what kinds of tables will be visible.
9.1.12. Caching
Property
Description
AutoCache
Automatically caches the results of SELECT queries into a cache database specified by either CacheLocation or both of CacheConnection and CacheProvider .
CacheDriver
The database driver to be used to cache data.
CacheConnection
The connection string for the cache database. This property is always used in conjunction with CacheProvider . Setting both properties will override the value set for CacheLocation for caching data.
CacheLocation
Specifies the path to the cache when caching to a file.
CacheTolerance
The tolerance for stale data in the cache specified in seconds when using AutoCache .
Offline
Use offline mode to get the data from the cache instead of the live source.
CacheMetadata
This property determines whether or not to cache the table metadata to a file store.
9.1.13. Miscellaneous
Property
Description
StorageTimeout
How long a Storage API connection must remain idle before the provider reconnects.
AllowAggregateParameters
Allows raw aggregates to be used in parameters when QueryPassthrough is enabled.
AuditLimit
The maximum number of rows which will be stored within an audit table.
AuditMode
What provider actions should be recorded to audit tables.
BatchSize
The maximum size of each batch operation to submit.
BigQueryOptions
A comma separated list of Google BigQuery options.
ConnectionLifeTime
The maximum lifetime of a connection in seconds. Once the time has elapsed, the connection object is disposed.
ConnectOnOpen
This property species whether to connect to the Google BigQuery when the connection is opened.
GenerateSchemaFiles
Indicates the user preference as to when schemas should be generated and saved.
MaximumBillingTier
The MaximumBillingTier is a positive integer that serves as a multiplier of the basic price per TB. For example, if you set MaximumBillingTier to 2, the maximum cost for that query will be 2x basic price per TB.
MaximumBytesBilled
Limits how many bytes BigQuery will allow a job to consume before it is cancelled.
MaxRows
Limits the number of rows returned rows when no aggregation or group by is used in the query. This helps avoid performance issues at design time.
Other
These hidden properties are used only in specific use cases.
PoolIdleTimeout
The allowed idle time for a connection before it is closed.
PoolMaxSize
The maximum connections in the pool.
PoolMinSize
The minimum number of connections in the pool.
PoolWaitTime
The max seconds to wait for an available connection.
PseudoColumns
This property indicates whether or not to include pseudo columns as columns to the table.
QueryPassthrough
This option passes the query to the Google BigQuery server as is.
Readonly
You can use this property to enforce read-only access to Google BigQuery from the provider.
RTK
The runtime key used for licensing.
TableSamplePercent
This determines what percent of a table is sampled with the TABLESAMPLE operator.
Timeout
The value in seconds until the timeout error is thrown, canceling the operation.
UseConnectionPooling
This property enables connection pooling.