Starwhale

🧭 What's Changed
* (model): add hugging face transformer textattack/albert-base-v2-ag-news example (1783) anda-ren
* bug(client): fix local wheel package unexpected freezing issue (1799) tianweidut
* bug(controller): modify image resolve behavior (1818) anda-ren
* chore(cli): add `--no-cache` flag for runtime lock command (1801) tianweidut
* chore(client): Add Dockerfile for assistance broker (1839) xuchuan
* chore(client): tune gradio import to slove slow import issue (1759) tianweidut
* chore(client): tune import with TYPE_CHECKING flag (1769) tianweidut
* chore(controller): online eval resource pool implementation (1761) jialeicui
* chore(controller): online eval rtt optimization (1763) jialeicui
* chore(controller): optimize swagger annotations of api (1768) dreamlandliu
* chore(deploy): remove image pull policy config (1762) jialeicui
* chore(doc): update doc registry with the available address (1803) tianweidut
* chore(doc):update tutorials' doc (1771) goldenxinxing
* chore(e2e): ignore controller service check command non-zero exit for e2e script (1847) tianweidut
* chore(example): refactor example makefile for the seperated prepare phases (1841) tianweidut
* chore(example): use the latest starwhale version in pytorch runtime (1755) jialeicui
* chore(install): remove useless internal pypi mirror address (1796) tianweidut
* chore(server):remove redundant module and files (1732) goldenxinxing
* chore(test): fix dataset test for unexpected .dataset_tmp dir in the code tree (1788) tianweidut
* chore(test): remove proxy in E2E test before client test (1822) anda-ren
* doc(helm): update cloud install docs for docker registry (1773) tianweidut
* enhance(cli): make copy command compatible with no `cloud://` prefix uri (1804) tianweidut
* enhance(install) tune helm charts for minikube mode (1823) tianweidut
* example(dataset): add cityscapes 3dbox dataset (1779) anda-ren
* example(dataset): add cityscapes_disparity dataset (1780) anda-ren
* example(dataset): add kitti lane dataset (1778) anda-ren
* example(dataset): add kitti-object-birds dataset example (1781) anda-ren
* example(dataset): add sintel dataset; add NumpyBinary in sw (1782) anda-ren
* example(dataset): modify jupyter example (1800) anda-ren
* example(dataset): update example datasets for new dataset format (1777) anda-ren
* example(model): add hugging face transformer Ahmed9275/Vit-Cifar100 example (1784) anda-ren
* example(runtime): remove example and doc for the unsupported pre/post runtime hook (1802) tianweidut
* feat(client): online eval handler support example (1752) jialeicui
* feat(client): support remote assistance (1827) xuchuan
* feat(console): auto fill runtime if possible in online eval page (1809) jialeicui
* feat(controller): populate pypi/docker startup envs to system setting (1817) anda-ren
* feat(controller): support collecting resource events (1831) jialeicui
* feat(datestore): naive version implementation, add records timestamp (1807) xuchuan
* fix(client): dataset/model upload failed (1829) goldenxinxing
* fix(client): do not wait for stdin so that the remote side can stop immediately when the command quits (1844) xuchuan
* fix(client): improve ut stability by prolonging the time gap (1835) xuchuan
* fix(client):unified the dataset table name when copy (1772) goldenxinxing
* fix(console): fix import issues (1794) jialeicui
* fix(console): image data empty when cros error (1848) waynelwz
* fix(controller): file pull support using project id (1764) jialeicui
* fix(controller): prevent closing input in aliyun oss (1791) jialeicui
* fix(controller): remove headers from model download api (1797) goldenxinxing
* fix(controller):datastore api return empty results when query multi times for type of bytes (1813) goldenxinxing
* fix(controller):step entity without name (1787) goldenxinxing
* fix(controller):unified paths to use project id (1815) goldenxinxing
* fix(dataset): fix user local fs data can't be fetched by server instance (1793) anda-ren
* fix(datastore): lazy to init table name for eval & replace name with id (1840) goldenxinxing
* optimize(console): normalize most of basic components and moved to starwhale/ui (1767) waynelwz
* optimize(console): search bar with dynamic search keyword & evaluation support order by with api (1816) waynelwz
* refactor(console): table components, change to full grid table, support row scroll cache, add inline query (1833) waynelwz
* refactor(controller): move mapper xml to annotation (1758) dreamlandliu
* refactor(dataset): take equal treatment to dataset data and annotation (1705) anda-ren
* update(console): add panel query api, optimize in view load status (1838) waynelwz
* update(console): use projectId for table query (1845) waynelwz
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut, waynelwz and xuchuan

🧭 What's Changed
* chore(ci): add UnusedImports rule for controller (1710) jialeicui
* chore(client): make sure model.yaml exists when use custom config file (1703) jialeicui
* chore(client): optimize model build when no model serving api (1689) jialeicui
* chore(console): support model switching in online eval (1717) jialeicui
* chore(controller): application configuration use snake case (1697) jialeicui
* chore(controller): model serving api refactor (1693) jialeicui
* chore(controller): reuse model serving entries and workloads (1694) jialeicui
* chore(doc): add example doc for ucf101 (1730) goldenxinxing
* chore(doc): add server admin config to sidebar (1714) jialeicui
* chore(docker): support building with gradio (1701) jialeicui
* chore(example): add serve handler for speech command (1718) jialeicui
* chore(example): serving handler for ag news (1722) jialeicui
* chore(example): serving handler for cifar10 (1719) jialeicui
* chore(example): serving handler for nmt (1721) jialeicui
* chore(example): serving handler for ucf101 (1723) jialeicui
* chore(sdk): hijack submit on premises (1690) jialeicui
* chore(sdk): refine hijacked js when using gradio (1698) jialeicui
* doc(example): fix wrong link addr in nmt (1720) jialeicui
* example(dataset): add jupyter notebook for dataset sdk (1691) tianweidut
* feat(client): add filter params for model/dataset/runtime list command (1672) dreamlandliu
* feat(console): support resource request in online eval page (1713) jialeicui
* feat(controller): online eval support gc (1695) jialeicui
* feat(controller): online eval support resource params (1709) jialeicui
* feat: gradio intergration (1692) waynelwz
* feat: replace link auth file to link auth config (1682) anda-ren
* fix(ci): remove useless import (1715) jialeicui
* fix(client): datastore loss data on multithread (1708) goldenxinxing
* fix(client): fix js compatible with multi args in online eval (1728) jialeicui
* fix(client): fix pip cache dir (1727) jialeicui
* fix(client): runtime restore use enable_pre=false by default (1688) goldenxinxing
* fix(console): search bar be smoother, and bugs when sync config (1733) waynelwz
* fix(console): dataset missing records (1754) waynelwz
* fix(controller): tune job to use datastore (1662) goldenxinxing
* fix(datastore): fix end_inclusive error when only one row in parquet file (1712) anda-ren
* fix(docker): fix release workflows when building console with gradio (1753) jialeicui
* fix(e2e): fix console building issue (1707) jialeicui
* refactor(console): use search bar as default filter, support version, config relevant to dynamic ui (1716) waynelwz
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut and waynelwz

🧭 What's Changed
* chore(client): model serving support model uri and runtime uri (1628) jialeicui
* chore(client): rename svc.yaml to svc.json for console usage (1685) jialeicui
* chore(client): runtime building support no-cache option (1640) jialeicui
* chore(controller): return 502 instead of 500 when online eval service is unavailable (1681) jialeicui
* chore(example): model serving demo for pfp (1684) jialeicui
* chore(sdk): add swagger ui for model serving apis (1635) jialeicui
* chore(sdk): support base uri for serving behind controller gateway (1659) jialeicui
* chore(test): fix dataset loader test unstable issue (1680) tianweidut
* chore(test): fix tensoflow ut for numpy 1.24.0 version upgration (1630) tianweidut
* chore(test): make dataset sdk test stable for the parallel setitem case (1634) tianweidut
* chore(ut): fix dataset flush test unstable issue (1673) tianweidut
* chore: add starwhale.Line type; use starwhale.Line in culane dataset (1674) anda-ren
* enhance(sdk): tune dataloader performance with data prefetch (1633) tianweidut
* example(dataset): add GTSRB dataset (1649) anda-ren
* example(dataset): add LFW dataset (1651) anda-ren
* example(dataset): add SVHN dataset (1658) anda-ren
* example(dataset): add caltech-101 dataset (1631) anda-ren
* example(dataset): add celeba-align example & tune summary.rows when building with icode (1639) anda-ren
* example(dataset): add cityscapes_fine dataset (1670) anda-ren
* example(dataset): add cityscapes_person dataset (1669) anda-ren
* example(dataset): add country211 dataset (1641) anda-ren
* example(dataset): add culane dataset (1626) anda-ren
* example(dataset): add dtd dataset (1642) anda-ren
* example(dataset): add eurosat dataset (1643) anda-ren
* example(dataset): add fer2013 dataset (1644) anda-ren
* example(dataset): add flickr8k dataset (1648) anda-ren
* example(dataset): add iNaturalist dataset (1654) anda-ren
* example(dataset): add image net dataset (1625) anda-ren
* example(dataset): add oxfordIIITPet dataset (1664) anda-ren
* example(dataset): add sbd dataset (1666) anda-ren
* example(dataset): add stanford_cars dataset (1660) anda-ren
* example(dataset): add viewer support for coco dataset (1652) anda-ren
* example(dataset): add wider face dataset (1665) anda-ren
* feat(console): dataset refactor & panel full tables by default (1661) waynelwz
* feat(console): add model viewer (1627) waynelwz
* feat(console): model serving ui (1657) jialeicui
* feat(console): support model diff (1632) waynelwz
* feat(console): support trash / panel download, panel reload (1667) waynelwz
* feat(controller): add filter params to controller list apis (1683) dreamlandliu
* feat(controller): support deploying serving model workload (1608) jialeicui
* feat(controller): support proxying to the serving model workload (1647) jialeicui
* feat(dataset): support user custom info for dataset (1622) tianweidut
* feat(sdk): support batch for ppl (1624) goldenxinxing
* feat(sdk): use gradio as server (1677) jialeicui
* feat: add support for controller to get http uri content (1653) anda-ren
* fix(controller): internal exception when the project does not exist (1655) dreamlandliu
* fix(controller): return 404 when the resource is not found for all of api (1621) dreamlandliu
* fix(controller):tune consumption default value to false for param 'isSerial' (1629) goldenxinxing
* fix(datastore): add limit for datastore query api (1663) goldenxinxing
* fix(example): speech error (1679) goldenxinxing
* fix(example): speech example dim bug (1678) goldenxinxing
* fix: typo in storage path(citycapes -> cityscapes) (1675) anda-ren
* refactor(console): evalution list/compare/results by only datastore api (1676) waynelwz
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut and waynelwz

🧭 What's Changed
* bug(docker): fix sw-docker-entrypoint typo for python3.11 (1617) tianweidut
* bug(sdk): fix dataset create cache issue from existed dataset (1595) tianweidut
* bug: fix E2E fail occasionally with s3 client creation error (1593) anda-ren
* chore(ci): disable useless git lfs config (1582) tianweidut
* chore(ci): fix python3.10-3.11 pip install issue (1589) tianweidut
* chore(ci): remove useless lfs for ci (1586) tianweidut
* chore(client): detect starwhale version when build runtime (1604) jialeicui
* chore(client): update python require for client (1620) tianweidut
* chore(docker): install the correct starwhale version when startup (1607) jialeicui
* chore(docker): upgrade docker base image for python3.11 (1588) tianweidut
* chore(e2e test): make data preparation in sequence (1583) anda-ren
* chore: add remove e2e test script (1587) anda-ren
* deps(client): client/sdk supports python3.11 (1584) tianweidut
* feat(cli): add http backend for dataset storeage (1619) anda-ren
* feat(cli): model eval command support use-docker flag (1610) anda-ren
* feat(client): add model diff for client (1605) goldenxinxing
* feat(client): support owner:project instead of project name in uri (1618) dreamlandliu
* feat(console): support interactive filter bar cascaded with router (1615) waynelwz
* feat(controller): table query support multiple param for operand of 'AND','OR' (1611) goldenxinxing
* feat(model): add model diff api for server (1591) goldenxinxing
* feat(model): split model file from tar to dir (1573) goldenxinxing
* feat(runtime): support render runtime.yaml in the build runtime progress (1613) tianweidut
* feat(sdk): expand first level of annotations (1612) anda-ren
* feat(sdk): support cloud remote dataset build by dataset sdk (1606) tianweidut
* feat(sdk): support convert starwhale dataset to pytorch dataset (1570) tianweidut
* feat(sdk): support generating openAPI spec (1590) jialeicui
* feat(sdk): support to conver starwhale dataset to tensorflow dataset (1594) tianweidut
* feat: add export api to datastore query api (1576) anda-ren
* fix(ci): make test of dataset stable (1592) jialeicui
* fix(client): add default value to is_default field which is not required in controller api (1597) dreamlandliu
* fix(model): file desc typo (1623) goldenxinxing
* optimize(console): dataset layout & fullscreen (1585) waynelwz
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut and waynelwz

🧭 What's Changed
* bug(SDK): fix model ppl unexpected index error (1553) tianweidut
* bug: fix job should fail but ready error (1542) anda-ren
* chore(ci): replace docker.io with ghcr.io (1541) tianweidut
* chore(ci): upgrade mypy, prevent numpy lint error in python ver 3.10.7+ (1574) jialeicui
* chore(datastore): remove wal log append wait interval (1546) xuchuan
* chore(datastore): return Iterator in MemoryTable.query (1548) xuchuan
* chore(datastore): return Iterator in MemoryTable.scan (1545) xuchuan
* chore(example): fix pfp example workaround for 0.3.2 sdk id changed issue (1551) tianweidut
* chore(sdk): fix dataset sdk test more stable (1580) tianweidut
* chore: add dependency for example (1581) anda-ren
* chore: fix e2e not fail (1560) anda-ren
* chore: multiple logs for task (1556) anda-ren
* chore: rename exit hook function (1561) anda-ren
* ci: e2e support all examples (1552) anda-ren
* enhance(datastore): support column prefix in scan (1540) xuchuan
* enhance(datastore): support server side flush (1549) xuchuan
* enhancement(console): add widget framework (1550) waynelwz
* feat(console): support dynamic vars & form columns field (1562) waynelwz
* feat(controller): merge migration sql files (1547) dreamlandliu
* feat(controller):extract model tar file&remove dataProvider Container (1539) goldenxinxing
* feat(dataset): add `swcli dataset head` command (1538) tianweidut
* feat(sdk): allow json like dict passed as dataset annotation (1569) anda-ren
* feat(sdk): support online serving (1565) jialeicui
* feat(sdk): support pythonic dataset sdk (1554) tianweidut
* fix(client): prevent module confliction when build multiple artifact (1572) jialeicui
* fix(controller): e2e test for remove/recover trash and fix bug (1571) dreamlandliu
* fix(controller): fix bug in flyway sql (1555) dreamlandliu
* fix(controller): refactor and fix bugs for job-dataset version (1563) dreamlandliu
* fix(controller): temporarily remove e2e test for the modified api (1557) dreamlandliu
* fix(datastore): failed to write empty list/map values to parquet files (1544) xuchuan
* fix(sdk): confusion matrix problem (1558) goldenxinxing
* fix(sdk): metric roc_aoc log error (1564) goldenxinxing
* fix(server): lock ut error (1579) goldenxinxing
* fix: make load job fail unblocking (1543) anda-ren
* optimize(console): support dnd list, panel chart responsive etc (1568) waynelwz
* optimize(console): support panel remove, fullscreen, etc (1578) waynelwz
* refactor: project/user/role mapper/entity/converter (1559) dreamlandliu
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut, waynelwz and xuchuan

🧭 What's Changed
* bug(console): remove encode for offset/size (1491) anda-ren
* chore(ci): tag latest image (1505) anda-ren
* chore(client): rich print null when table have too many cols (1534) goldenxinxing
* chore(controller): remove tip() method from SwValidationException & SwProcessException (1481) xuchuan
* chore(datastore): use StorageAccessService directly insteadof ObjectStore (1483) xuchuan
* chore(e2e):remove useless mnist dataset train data for e2e test (1495) tianweidut
* chore(example):support multiple dataset for custom example (1533) goldenxinxing
* chore: change init container registry (1498) anda-ren
* chore: reverse e2e tag (1537) anda-ren
* doc: add heterogeneous devices part (1528) jialeicui
* enhance(ci): make client test to run in parallel mode (1536) tianweidut
* enhance(dataset): refactor dataset annotations with SwObj (1474) tianweidut
* enhance(datastore): add map type support (1486) xuchuan
* enhance(datastore): add parquet read/write support for memory table (1467) xuchuan
* enhance(datastore): add tuple type support (1484) xuchuan
* enhance(datastore): memory table support saving and loading data from the storage service (1469) xuchuan
* enhance(sdk): add map type support (1499) xuchuan
* enhance(sdk): add tuple type support (1494) xuchuan
* enhance(sdk): tune get http file performance with buffer (1532) tianweidut
* example: add coco dataset (1449) anda-ren
* example: update pfp example dataset for data_store type (1507) tianweidut
* feat(client): copy dataset/model/runtime with user specific resource name (1509) tianweidut
* feat(client): support console URL from the browser when parsing URI (1525) jialeicui
* feat(console): add simple video viewer (1489) waynelwz
* feat(console): support copy resource url for cli usage in version list page (1527) jialeicui
* feat(controller): add namespace to projectUrl (1479) dreamlandliu
* feat(controller): add temporary token for task (1468) anda-ren
* feat(controller): support panel api (1458) jialeicui
* feat(controller): support plugin assets serving (1518) jialeicui
* feat(controller): version urls support latest (1523) dreamlandliu
* feat(dataset): sign data uris in batch (1516) anda-ren
* feat(dataset): support link type in dataset annotations (1490) tianweidut
* feat(evaluation): support multi datasets (1502) goldenxinxing
* feat(example): add video type & example (1473) goldenxinxing
* feat: remove auth file in dataset copy process (1480) anda-ren
* feature(datastore): support snapshot (1475) xuchuan
* fix(client): support version only copy (1531) jialeicui
* fix(console): fetch enough users to select (1504) jialeicui
* fix(controller): resuming job sometimes fails (1526) anda-ren
* fix(docker): broken python module yq in entrypoint (1515) jialeicui
* fix(docker): yq in entrypoint can not find after global py version changes (1503) jialeicui
* fix(example): fix missing images2dict (1487) jialeicui
* fix(example): opencv missing libGL bug (1522) goldenxinxing
* fix(sdk): correct object type table schema representation (1476) xuchuan
* fix(storage): aliyun, s3 and fs put error (1500) xuchuan
* fix(test): subprocess use bug in test (1517) goldenxinxing
* fix(ut): occasional unit test failure in ParquetReadWriteTest (1520) xuchuan
* hotfix(console): layout not work when build (1493) waynelwz
* refactor(client): refactor resource version without common string parts (1535) tianweidut
* refactor(client): uri refactor (1482) jialeicui
⚙️ Who Contributes
anda-ren, dreamlandliu, goldenxinxing, jialeicui, tianweidut, waynelwz and xuchuan