Kafka Sinks

BETA

¶

Kafka Sinks are now private beta! Tinybird's Kafka Sink allows you to push the results of a query to a Kafka topic either on-demand or on a schedule.

Pro and Enterprise customers can email support@tinybird.co to request access.

Check the Kafka Sinks documentation for more information.

PostgreSQL Table Function available in all GCP regions¶

The PostgreSQL Table Function is now available in all GCP shared regions. Read the PostgreSQL Table Function docs to learn more!

%
SELECT *
FROM
  postgresql(
    'awesome_postgres.supabase.com:5432',
    'database',
    'table',
    {{tb_secret('pg_username')}},
    {{tb_secret('pg_password')}},
  )
  -- WHERE ... (apply an optional push down filter!)

S3 Connector improvements¶

• Added an optional parameter to only ingest files created after a point in time. You can now provide a datetime in UTC ISO format to avoid ingesting files created before this time. This is supported both in the UI and the CLI.
• Cleaned up the error logs for on-demand executions in datasources_ops_log, so that errors unequivocally mean an ingestion failure.
• Improved docs, adding a Monitoring section and specific examples for wildcard matching, see the S3 Connector documentation.

Charts v0.2.0¶

Version 0.2.0 of @tinybirdco/charts includes several improvements for BarList:

• Style customization: You can now fully customize the BarList appearance using CSS variables.
• Custom components: You can now pass custom components to the BarList to customize the appearance of the bars, labels and values.

For more information, check the documentation.

Bug fixes and improvements¶

• Added support to append new data from a CSV to Data Sources with JSONPaths.
• sql_and template directive now supports gte and lte operations. See the advanced templates docs.
• Grafana integration guide updated to use the Infinity plugin recommended by Grafana Labs, which also supports alerting.
• X-DB-Exception-Code header is now returned on errored API Endpoint or Query API calls. This header contains the exception code returned by the database, which can be useful for debugging. Check the API documentation for more information.
• The processing size of Materialized Views is now visible in the list of Pipes in the Workspace, and in the Organization page.
• Organization admins can now remove members from their organization. This feature is available in the Member view of the Organization dashboard.