Add Turso

[andrewm4894]

This pull request introduces several updates and improvements, including support for Turso databases, enhancements to SQLite functionalities, and updates to documentation and configuration files. The most important changes are summarized below:

Support for Turso Databases:

• Added Turso-related environment variables in .example.env and updated the README.md to include Turso as a supported database. [1] [2] [3]

Enhancements to SQLite Functionalities:

• Refactored sqlite.py to include retry logic, context management, and support for Turso connections. Introduced functions such as get_sqlite_path, get_conn, with_sqlite_retry, sqlite_connection, infer_sqlite_type, and generate_create_table_sql. [1] [2]
• Added a new utility function generate_insert_sql in anomstack/df/utils.py to generate SQL DDL and batched DML from a DataFrame.

Documentation and Configuration Updates:

• Updated the default database type to SQLite in metrics/defaults/defaults.yaml and modified the SQL query in metrics/defaults/sql/train.sql to include specific columns. [1] [2]
• Added libsql-experimental to requirements.compile to support new SQLite functionalities.

Utility Enhancements:

• Introduced a new utility function get_columns_from_sql in anomstack/sql/utils.py to extract columns from a SQL query.

These changes collectively enhance the database support and functionality, particularly for SQLite and Turso, while also improving the overall codebase and documentation.

[github-actions]

Your pull request is automatically being deployed to Dagster Cloud.

Location	Status	Link	Updated
anomstack		View in Cloud	Jan 26, 2025 at 12:58 AM (UTC)