Distributed Lock for Iceberg in ChangoEverytime iceberg table is committed, many files will be created like data files, metadata files, and snapshots. Even if iceberg supports…Aug 17, 2024Aug 17, 2024
Query Audit in ChangoAll the queries executed by query engines like Chango Trino Gateway, Chango Spark Thrift Server and Chango Spark SQL Runner in Chango will…Aug 8, 2024Aug 8, 2024
Run Spark SQL ETL Jobs with Azkaban in ChangoTrino ETL queries can be run through REST simply with Chango Query Exec in Chango as I mentioned in the previous article. In addition…Aug 8, 2024Aug 8, 2024
Run Trino ETL Jobs with Azkaban in ChangoTrino ETL queries can be sent to Chango Query Exec through REST to run ETL query jobs in trino with ease. So Chango Query Exec is more…Jul 29, 2024Jul 29, 2024
Resource Groups in Chango Trino GatewayResource Groups is used to limit resources of trino cluster with the configurations like maximum number of running queries and queued…Jul 28, 2024Jul 28, 2024
Automatic Iceberg Table Maintenance in ChangoEverytime data committed to iceberg tables, many files will be created like data files, snapshots, metadata files which should be…Jun 21, 2024Jun 21, 2024
Published inDev GeniusLoad Files to Iceberg Table using SQL in ChangoIt is not easy to load files to iceberg tables. In order to load such as files to iceberg tables, for example, you need to develop spark…Jun 12, 2024Jun 12, 2024
Hidden Partitioned Iceberg Table in ChangoThere are some ways to create hidden partitioned iceberg tables in Chango. You can create them with trino, but trino does not support all…May 31, 2024May 31, 2024
Maintain Iceberg Tables in ChangoEverytime committing data to iceberg tables, many files will be created like metadata, snapshots which need to be maintained, for example…Apr 25, 2024Apr 25, 2024
Published inTowards DevData Transformation using Chango Query ExecIf you want to transform data in data lakehouses, you may use query engines such as trino. For example, you can move table data from…Dec 29, 2023Dec 29, 2023