BigQuery

1. Connecting
   1. CLI
   2. Environment Variables
   3. Python API
2. Format
   1. URLs
   2. Paths
3. Type Conversion
4. Limitations and Constraints

Connecting

CLI

recap add my_bq bigquery://

Environment Variables

export RECAP_SYSTEM__MY_BQ=bigquery://

Python API

from recap.clients import create_client

with create_client("bigquery://") as client:
    client.ls("my_project")

Format

URLs

Recap’s BigQuery URL format:

bigquery://<project>

Paths

Recap’s BigQuery paths are formatted as:

[system]/[project]/[dataset]/[table]

The BigQueryClient class is used to read BigQuery table schemas as Recap schemas.

Type Conversion

This table shows the corresponding Recap types for each BigQuery type, along with the associated attributes:

BigQuery Type	Recap Type
STRING, JSON	StringType (bytes <= 65_536)
BYTES	BytesType (bytes <= 65_536)
INT64, INTEGER, INT, SMALLINT, TINYINT, BYTEINT	IntType (bits=64, signed=True)
FLOAT, FLOAT64	FloatType (bits=64)
BOOLEAN	BoolType
TIMESTAMP, DATETIME	IntType (logical=”build.recap.Timestamp”, bits=64, unit=”microsecond”)
TIME	IntType (logical=”build.recap.Time”, bits=32, unit=”microsecond”)
DATE	IntType (logical=”build.recap.Date”, bits=32, unit=”day”)
RECORD, STRUCT	StructType
NUMERIC, DECIMAL	BytesType (logical=”build.recap.Decimal”, bytes=16, variable=False, precision <= 38, scale <= 0)
BIGNUMERIC, BIGDECIMAL	BytesType (logical=”build.recap.Decimal”, bytes=32, variable=False, precision <= 76, scale <= 0)

Limitations and Constraints

The conversion functions raise a ValueError exception if the conversion is not possible.