October 25, 2024

Tags in Service Data Sources

You can now assign tags to your Pipes and Data Sources and use them when querying data from your Service Data Sources using the new resource_tags column.

Image

Kafka CA certificate support

If your Kafka cluster uses a CA certificate, you can now add it when creating a Kafka connection from the UI or using the CLI with the --ssl-ca-pem path/to/ca.pem argument in the tb connection create kafka command, or by defining the KAFKA_SSL_CA_PEM setting in your .datasource files.

Image

DynamoDB Connector improvements

  • Improved overall performance, enabling the processing of DynamoDB tables up to 500 GB. Larger tables can be still processed but require dedicated infrastructure.
  • Added a new _old_record column that gets populated with the previous version of the records when DynamoDB Stream is configured with the NEW_AND_OLD_IMAGES view type.
  • Better error handling when processing table updates. Common errors, such as permission issues and DynamoDB Stream not existing, are recovered when the conditions are met.
  • Reduced the number of DescribeStream API requests.

Playground from explain

You can now use the generated SQL query from the explain page to create a new playground from it.

Image

Improvements

  • Tinybird has a new Compliance doc that lists all the certifications such as SOC 2 Type II and HIPAA.
  • Added support for Array(Nullable(Date)) type and nullable values in map types Map(*, Nullable(*)).

Bug fixes

  • Several fixes regarding "Unsynced changes" in the UI.
  • Fixed a couple of internal errors when working with the DynamoDB connector.
  • Now users can create a new Data Source with an associated Token from the UI.
  • Fixed the autocomplete and split view in pipes and playgrounds when clicking a Materialized View Data Source.
View previous update