Splitgraph

Latest version: v0.3.12

Safety actively analyzes 631044 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 7

0.3.0

Fleshing out the `splitgraph.yml` (aka `repositories.yml`) format that defines a Splitgraph Cloud "project" (datasets, their sources and metadata).

Existing users of `repositories.yml` don't need to change anything, though note that `sgr cloud` commands using the YAML format will now default to `splitgraph.yml` unless explicitly set to `repositories.yml`.

New `sgr cloud` commands

See https://github.com/splitgraph/sgr/pull/582 and https://github.com/splitgraph/sgr/pull/587

These let users manipulate Splitgraph Cloud and ingestion jobs from the CLI:

* `sgr cloud status`: view the status of ingestion jobs in the current project
* `sgr cloud logs`: view job logs
* `sgr cloud upload`: upload a CSV file to Splitgraph Cloud (without using the engine)
* `sgr cloud sync`: trigger a one-off load of a dataset
* `sgr cloud stub`: generate a `splitgraph.yml` file
* `sgr cloud seed`: generate a Splitgraph Cloud project with a `splitgraph.yml`, GitHub Actions, dbt etc
* `sgr cloud validate`: merge multiple project files and output the result (like `docker-compose config`)
* `sgr cloud download`: download a query result from Splitgraph Cloud as a CSV file, bypassing time/query size limits.

`splitgraph.yml`

Change various commands that use `repositories.yml` to default to `splitgraph.yml` instead. Allow "mixing in" multiple `.yml` files Docker Compose-style, useful for splitting credentials (and not checking them in) and data settings.

Temporary location for the new full documentation on `splitgraph.yml`: https://github.com/splitgraph/sgr.com/blob/f7ac524cb5023091832e8bf51b277991c435f241/content/docs/0900_splitgraph-cloud/0500_splitgraph-yml.mdx

Miscellaneous

* Initial backend support for "transforming" Splitgraph plugins, including dbt (https://github.com/splitgraph/sgr/pull/574)
* Dump scheduled ingestion/transformation jobs with `sgr cloud dump` (https://github.com/splitgraph/sgr/pull/577)

Full set of changes: [`v0.2.18...v0.3.0`](https://github.com/splitgraph/sgr/compare/v0.2.18...v0.3.0)

0.2.18

* Splitfile speedups (https://github.com/splitgraph/sgr/pull/567)
* Various query speedups (https://github.com/splitgraph/sgr/pull/563, https://github.com/splitgraph/sgr/pull/561)
* More robust CSV querying (https://github.com/splitgraph/sgr/pull/562)

Full set of changes: [`v0.2.17...v0.2.18`](https://github.com/splitgraph/sgr/compare/v0.2.17...v0.2.18)

0.2.17

* Code refactor / optimizations (https://github.com/splitgraph/sgr/pull/531)
* Support for pluggable authorization logic (https://github.com/splitgraph/sgr/pull/542, https://github.com/splitgraph/sgr/pull/549)
* FDW JSONSchema fixes (https://github.com/splitgraph/sgr/pull/545)
* Upgrade pglast to 3.4 to fix issues with Splitfile validation (https://github.com/splitgraph/sgr/pull/534)
* Speed up Splitfile builds (https://github.com/splitgraph/sgr/pull/550)

Full set of changes: [`v0.2.16...v0.2.17`](https://github.com/splitgraph/sgr/compare/v0.2.16...v0.2.17)

0.2.16

* Various Airbyte ingestion improvements and support for different normalization modes, including a custom dbt model (https://github.com/splitgraph/sgr/pull/510, https://github.com/splitgraph/sgr/pull/513, https://github.com/splitgraph/sgr/pull/514)
* Fix mount for data source with empty credentials schema (https://github.com/splitgraph/sgr/pull/515)
* Fix `sgr cloud load`/`dump` (https://github.com/splitgraph/sgr/pull/520)

Full set of changes: [`v0.2.15...v0.2.16`](https://github.com/splitgraph/sgr/compare/v0.2.15...v0.2.16)

0.2.15

* API functionality to get the raw URL for a data source (https://github.com/splitgraph/sgr/pull/457)
* LQ scan / filtering simplification to speed up writes / Singer loads (https://github.com/splitgraph/sgr/pull/464, https://github.com/splitgraph/sgr/pull/489)
* API functionality for Airbyte support (`AirbyteDataSource` class, https://github.com/splitgraph/sgr/pull/493)
* Speed up `sgr cloud load` by bulk API calls (https://github.com/splitgraph/sgr/pull/500)

Full set of changes: [`v0.2.14...v0.2.15`](https://github.com/splitgraph/sgr/compare/v0.2.14...v0.2.15)

0.2.14

* Functionality to dump and load a Splitgraph catalog to/from a special `repositories.yml` format (https://github.com/splitgraph/sgr/pull/445)

Full set of changes: [`v0.2.13...v0.2.14`](https://github.com/splitgraph/sgr/compare/v0.2.13...v0.2.14)

Page 3 of 7

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.