PostgreSQL table function
BETA
¶The Tinybird postgresql()
table function is currently in public beta.
The Tinybird postgresql()
table function allows you to read data from your existing PostgreSQL database into Tinybird, then schedule a regular Copy Pipe to orchestrate synchronization. You can load full tables, and every run performs a full replace on the Data Source.
To use it, define a node using standard SQL and the postgresql
function keyword, then publish the node as a Copy Pipe that does a sync on every run. See Table functions for general information and tips.
Syntax¶
Create a new Pipe Node. Call the postgresql
table function and pass the hostname and port, database, table, user, and password:
Example query logic
SELECT * FROM postgresql( 'aws-0-eu-central-1.TODO.com:3866', 'postgres', 'orders', {{tb_secret('pg_username')}}, {{tb_secret('pg_password')}}, )
Publish this node as a Copy Pipe. You can choose to append only new data or replace all data.
Type support and inference¶
Here's a detailed conversion table:
PostgreSQL data type | Tinybird data type |
---|---|
BOOLEAN | UInt8 or Bool |
SMALLINT | Int16 |
INTEGER | Int32 |
BIGINT | Int64 |
REAL | Float32 |
DOUBLE PRECISION | Float64 |
NUMERIC or DECIMAL | Decimal(p, s) |
CHAR(n) | FixedString(n) |
VARCHAR (n) | String |
TEXT | String |
BYTEA | String |
TIMESTAMP | DateTime |
TIMESTAMP WITH TIME ZONE | DateTime (with appropriate timezone handling) |
DATE | Date |
TIME | String (since there is no direct TIME type) |
TIME WITH TIME ZONE | String |
INTERVAL | String |
UUID | UUID |
ARRAY | Array(T) where T is the array element type |
JSON | String or JSON |
JSONB | String |
INET | String |
CIDR | String |
MACADDR | String |
ENUM | Enum8 or Enum16 |
GEOMETRY | String |
Considerations¶
The following considerations apply to the postgresql()
table function:
- Tinybird doesn't support all PostgreSQL types directly, so some types are mapped to String in Tinybird, which is the most flexible type for arbitrary data.
- For the
NUMERIC
andDECIMAL
types,Decimal(p, s)
in Tinybird requires specifying precision (p) and scale (s). - Time zone support in Tinybird's
DateTime
can be managed via additional functions or by ensuring consistent storage and retrieval time zones. - Some types like
INTERVAL
don't have a direct equivalent in Tinybird and are usually stored as String or decomposed into separate fields.