Determined

48ef6af build: separate symlinks from tools run server step
add3db8 build: fixes for flake8 update
1ee3ee6 build: remove parallel support for make all
aed76c7 docs: edit guide on using trained checkpoints
01c8b82 ci: add AWS CLI install to docs publishing
76e2d1e ci: publish the try-now template separately
3f833aa fix: resize the Ace editor when an error pops up
18e0f37 docs: update `CONTRIBUTING.md` for recent changes
91015ac chore: remove hasura from cli
74f0e23 chore: remove hasura from checkpoint list
f6b8847 build: add temp db support to run-server
7baae45 docs: revise data access tutorial
beb82b8 refactor: simplify implementation of updateTasks and updateAgents in scheduler
a7140a9 refactor: avoid dependending on pointer equality in scheduler test
c86899b chore: remove hasura from integration tests
2099060 build: rely on goreleaser LDFLAGS
3a9d984 ci: fix CircleCI release
5b467ab ci: cleanup e2e pytest calls
222bd16 build: clean tools dir on root level clean
68b9aa1 fix: format agent tools file
be4943c fix: enable go modules for root get deps
c065695 build: support parallel test target
6036321 build: support parallel fmt target
186fb38 build: support parallel check target
64eb8ee build: support parallel clean target
e240cc5 build: set root all target to build
ea297fa build: remove unused VERSION variable in root Makefile
49a6b6e build: support parallel builds
4d2d8c1 ci: use 3.x-slim-buster images for CLI tests
1594a52 ci: cleanup branch filters
72f9709 chore: remove agent install target
68d036a build: reduce deploy build target output
2a0fc77 ci: fix Go cache
ab270e9 ci: e2e tests using Go binaries
fb6a49e build: remove master install target
026865c build: remove python-get-deps target
b691005 build: remove go-get-deps target
42e89f6 build: clean up master build dir
607e71d docs: minor fixes for dtrain documentation
d478f81 feat: support different master host between agent and container
875df52 chore: ignore build dir in tools dir
2d1adc9 chore: suppress output of tools run target
6a5f039 fix: symlink subproject build dirs to local run
1fdf383 build: add local cluster mode for developement
24b23a0 build: add agent build process to root Makefile
dc8bc08 build: add local builds for the master
572722e fix: clean up agent build artifacts properly
cf34eea chore: remove agent test coverage report
f48a1a4 build: add build target for agent
0827ae2 docs: make Sphinx default to not highlighting code blocks
8e1c0dd docs: make miscellaneous edits
1e1d696 docs: remove non-ASCII quotes
6c9c551 docs: use Sphinx's ability to show only the base of a code name
111554b build: clean up master goreleaser file
8d17998 ci: separate tf1 and tf2 tests
ab02af1 feat: add support for "det master config" in CLI
43dd6f3 feat: support "det m" as an alias for "det master" in the cli
2f41d8a build: remove master builds from root Makefile
87abdb7 build: clean up docs deploy Makefile
50f6e35 chore: use an available Go constant over 301 status code
d75f958 perf: remove an unnecessary redirect from the webui root
32246c1 build: clean up elm make file
2d2e118 ci: clean up Python venv creation
e75c84b build: clean up react Makefile
bdbd58a chore: remove unused env vars from webui tests
82890c3 build: clean docs build in CircleCI
07b854d build: clean up docs Makefile
f2694c5 build: add examples Makefile
8b90a2a ci: fix node cache install logic
ca2c4e2 ci: fix e2e_tests splitting paths
ba12073 chore: move master buildtools to tools.go
905c88d chore: remove component env var from master Makefile
9ec3fec chore: clean up master ldflags config
a0b567c chore: remove dependency on internal goimports
44d04d9 chore: remove gotest dependency
3894766 chore: remove ldflag requirements for master go test
7005aac ci: bump wait_for_master time to five minutes
43a3518 chore: isolate agent build system
fe65f27 docs: improvements to AWS, GCP install docs
53952ae ci: update docker executors and use determinedai/cimg-base
9d35de5 fix: pin docutils version to avoid dependency version conflict
a42c55c fix: add ssh extra docker dependency to det-deploy
20bd785 chore: simplify commons Makefile
c28bff5 ci: update login/out to wait on requests and cookie set/get
de4bb24 chore: simplify det-deploy Makefile
386b1da chore: simplify harness Makefile
2b9d131 chore: remove version dep from python packages
a4a2204 chore: simplify cli Makefile
7c1ee8d chore: remove unused script
638f2ce ci: use python:3.6.9 for deploy step
89c5427 ci: upgrade to new vm image that has Docker 19.03
22bb3f1 ci: use remote docker save/load for local tests
60258fe fix: avoid crash in PyTorch trial when debug mode is on
5b0c0fb chore: simplify agent build tools
df2b90e test: add a test for tf.dataset with tf.keras native api
0e12cd2 fix: add missing dep in build-docker target
40d1579 refactor: fix links to new dynamic agents docs
9745349 refactor: reorganize the doc structure for dynamic agents
62a77c2 docs: add elastic infrastructure topic guide
7fb21ab refactor: remove the old dynamic agents overview
3bed89e docs: describe usage of `nvidia-container-toolkit` on Docker 19.03
136b07a feat: make `det-deploy` work with `nvidia-container-toolkit`
1d95731 feat: make the provisioner work with `nvidia-container-toolkit`
d746cab feat: make the agent work with `nvidia-container-toolkit`
416ff5a test: intercept and wait for requests in login before moving on
cdf6568 chore: avoid hardcoding the test username in test units
4df0cd8 chore: remove old mailmap file
064c90b chore: bump circleci cache
e58bea7 chore: combine root requirements files
cd431f5 chore: remove references to release docs
e4f6f18 build: remove release-requirements.txt
26e7220 build: move bump2version to be a dev-dependency
76b963b build: move docs-requirements.txt to docs/requirements.txt
2bff674 build: remove unused python configs
5400fa8 chore: remove unused dockerignore file
80184a6 chore: move phony targets to respective targets
d39b74b chore: remove unused root build target
db749a6 chore: move commit linter to check target
9465a59 ci: store docs artifacts
e0dd3e5 chore: merge build docker targets in root makefile
109b8d0 chore: remove unused PHONY targets
d3b8465 chore: removed unused makefile variables
95aa9e5 chore: fix references to Apple's OS, which is currently called macOS
b45fe4c ci: allow manual approvals to be provided immediately
4aba004 docs: reorganize a few docs
a259c0b test: move tests under their respective component directories
0247760 chore: move commit message linter to new step
a98cf2d fix: exit out of non-chief containers gracefully
0ba3386 chore: remove unused PHONY target
c088405 chore: clean webui root make targets
29a1a31 ci: pull cypress docker image in dependency set up step
319b6dd fix: salt and hash password before posting
5614bb6 docs: add agent config reference
530fd3b chore: remove unused agent build target
a8463e7 test: add a convergence test for cifar10_cnn_pytorch
8695b6e fix: have cifar10_cnn_pytorch use training set
e6745e1 docs: fix subtle math bug in cifar10_cnn_pytorch example
659ea23 chore: add a minimum validation period to cifar10_cnn_pytorch
201291b test: add a mnist_pytorch_multi_output capability test to nightly
3df2892 refactor: remove graphql from elm
a25c962 chore: remove publish phase
96d0e09 chore: remove bump version target
567ed07 build: remove unused Python dependencies
54a183d build: simplify Python requirements management by removing pip-tools
b932068 build: simplify Python linting by configuring per-package
ffa1bd2 test: update tests to use fitting requirements
d5f5ee5 feat: support fitting requirements in scheduler
5c431ea feat: move webui authentication to React and remove auto login
aa0443f chore: remove unused utility module
2f50401 feat: lower session duration to 7 days
bf09c9c docs: document trial __init__ functions
612d465 refactor: remove graphql dependency from trials
1e18781 test: output logs during wait_for_experiment_state
675117e chore: remove unused ci logic
7f3f805 fix: prevent multi-gpu trials from hanging
9a58154 ci: only download aws logs on failure
569168d feat: set an expiration date for auth cookie
7a210ac ci: bump cache version
9d03448 chore: improve isort configuration
b8d6d4e ci: decouple det-deploy local and integration tests
21cbecf ci: move e2e docker-compose file under .circleci
289b208 ci: move wait_for_master script to .circleci/scripts
3102d5c ci: download aws cluster logs for aws tests
06d5301 ci: cleanup CircleCI workflows
ca78fa8 ci: release with CircleCI
0708b46 feat: support us-east-1 with det-deploy
7b1f2b1 docs: add copy button to code snippets
c4a2369 chore: remove unused master integration test targets
d89d0e2 feat: add checkpoint export by uuid methods
4ae2086 ci: set slack user id for failed pr-merge tests
0ee2fa0 chore: reintroduce old experiment queries
1162141 docs: minor fixes for master config file docs
4e371b3 fix: fix bbox bug in object detection example
c3a8f5e test: remove default shared_fs checkpoint storage for framework fixtures
da68bb1 ci: set default max dynamic agents to 1
11c6d1e ci: clean up CircleCI config
06b0f3e feat: be more lenient about errors in running `nvidia-smi`
c557a21 feat: enable overriding nested package dependencies
18dfe03 ci: remove Jenkins integration tests
3634513 chore: set default Aurora serverless capacity to 8
5c63ed1 ci: skip insecure test
7783034 ci: add GPU tests and run on-merge and when manually triggered
77e045c feat: update favicons dynamically to show activity
6604394 docs: various improvements
3da2ccb refactor: migrate trial logs away from graphql
23d24f0 chore: add stdout and stderr to integration logs
3cfd702 docs: make TF Keras Native and Trial examples use same model
235c989 chore: explain the constraint of callbacks
ec7536c chore: use a better message in WaitForInstructionsCallback
a920850 refactor: set logger for Native API
deb64dc chore: update environment for notebook fix
518f1e2 feat: add documentation for experiment level checkpoint export CLI command
8d1c9db docs: add a topic guide about the Native API
9840425 feat: support GCP static agent instances in det-deploy

Release Notes
[0.31.0](https://github.com/determined-ai/determined/blob/0.31.0/docs/release-notes.rst)

Changelog
* 583e0c3d3 chore: bump version: 0.31.0-rc7 -> 0.31.0
* 29574c4f1 docs: add release notes for 0.31.0 (9159)
* 40c34cbcc chore: bump version: 0.31.0-rc6 -> 0.31.0-rc7
* 75b7e43cc fix: louden server errors coming from deleteCheckpoints (9184)
* 44503bb4f chore: bump version: 0.31.0-rc5 -> 0.31.0-rc6
* 956df4059 fix: fix docs and wording (9179)
* dae548dc6 fix: report errors from deletecheckpoints endpoint + improve feedback (9178)
* 592280d4a chore: style fix for helm tls (9163)
* 7565447bb chore: bump version: 0.31.0-rc4 -> 0.31.0-rc5
* 2daa1fc54 fix: TensorBoard visualization from batch actions. (9156)
* 4bbc20de8 fix: fix disable button condition in launch jupyter notebook modal (9155)
* ac15a8623 chore: bump version: 0.31.0-rc3 -> 0.31.0-rc4
* 990fbfb1e feat: add helm master level config for tcd startup hooks (9135)
* a6ae2aa4b ci: publish-docs installs awscli into user space (9153)
* d5deffbd1 chore: bump version: 0.31.0-rc2 -> 0.31.0-rc3
* 7f7d2bfa9 fix: fix docs for log retention (9149)
* 776c5c3ac fix: ensure all columns have widths (9136)
* e8b4fd712 chore: bump version: 0.31.0-rc1 -> 0.31.0-rc2
* 691d190cd test: fix test_logging typehint syntax error (9142)
* 61999f435 docs: revert helm values change for multirm (9145)
* be36ecdb6 chore: bump version: 0.31.0-rc0 -> 0.31.0-rc1
* f78ccf8d2 docs: revert-multiRM-mc-doc (9144)
* 3014dba9e chore: bump version: 0.31.0-dev0 -> 0.31.0-rc0
* 828532afb chore: lock api state for backward compatibility check
* 0547f7f78 chore: bump version: 0.30.1-dev0 -> 0.31.0-dev0
* 55ef649b6 chore: change multirm log messages to trace level [RM-151] (9138)
* 1bb2fe496 feat: expose `hyperparameters` in experiments api to avoid using deprecated `config` property for experiment (9012)
* 5a588e0f0 chore: lock published urls to preserve redirects
* f46bc6916 chore: lock api state for backward compatibility check
* 28b3affc5 feat: add cluster wide startup hook for tasks (9124)
* fe2b61666 docs: Describe pwds default accounts (9137)
* d1c268b89 fix: down migrations (9133)
* f7a526045 chore: update PyPi metadata (8971)
* 2c3ce2934 chore: set the default db storage as docker volume instead of a mount (9127)
* 8b11e3ae4 ci: publish docs without installing awscli (9126)
* 133f83835 fix: prevent table breaking on null columnWidths [ET-161] (9131)
* ec438095c fix: det gcp down doesn't have a det_version argument (9121)
* c89b3dfee fix: reduce time and increase reliability of tests (9125)
* d5f807da0 feat: helm deploys with a password (9113)
* 8a7832a6e fix: unlock mutex for experiment ResourcePool() [RM-152] (9119)
* e70d38e12 docs: add a python sdk example for log following. (8981)
* 3028efb04 docs: add helm doc updates (9122)
* cf2f2be52 fix: fix regression caused by join on trials view (9091)
* bdab9e47e feat: create Searches view (9089)
* 65339d21d chore: PR template again [INFENG-600] (9118)
* 0c6985b97 chore: update github PR template [INFENG-600] (9098)
* f4b04716d docs: add instructions on deploying determined via HPE MLDES [SAAS-1877] (9105)
* c32ac6f49 chore: add test to CODEOWNERS [INFENG-605] (9115)
* 25767b9ce fix: helm value for gke tests (9114)
* a0847b89b fix: match GetJobQueueStats behavior in k8s RM to agent RM [RM-136] (9097)
* 2ef5ab90b chore: better k8s testing with shared gke cluster (9074)
* 7fc8d7a06 chore: add nightly gke cluster cleanup job (9031)
* 5cb792738 chore: bump version: 0.30.0-dev0 -> 0.30.1-dev0
* 7f6577945 chore: add docs dropdown link for new version
* 4ae4075fb docs: add release notes for 0.30.0 (9103)
* 9dce6f03b feat: Add model version streaming (9029)
* 2c6fec7fb test: user-page-models (9084)
* 75b1ff45e feat: det deploy aws adds tags to dynamic agents [RM-140] (9106)
* d6059e974 feat: Create MoveRun endpoint (9001)
* 91d7e0844 feat: Pre-select ws when launching notebook (9109)
* f03a8a8f5 fix: add missing k8s job submission times to allocations (9028)
* b8bf3960d chore: upgrade Bun to fix race condition in tests [DET-10193] (9082)
* bc8c31cab fix: make sure that the genai helm chart services work across namespaces (9102)
* 58cd22b44 ci: INFENG-600 remove single commit legacy validation (9104)
* 943b2cb97 fix: prevent checkpoint modals from closing on their own [ET-116] [ET-120] (9094)
* d4eed0ed1 chore: change RM log message back to Debug level (9093)
* 2af21eebc chore: unshadow more builtins (9092)
* 519d702ec docs: update multiRM docs (9050)
* 3688c3fc9 fix: job queue panic for multirm [RM-123] (9079)
* f78b9aa68 fix: add change in master config to devcluster.yaml (9087)
* 8f02a7f02 fix: fix master config and experiment config for log retention (9075)
* fe1a6bb82 fix: no more shadowing "license" (9085)
* 3f2d6abfe fix: spacing issue with exp list pagination (9067)
* 37abc6ce5 fix: stop showing loading indicator in `queued` state (9081)
* 4050eda43 chore: bumpenvs for jupyter security update. (9077)
* fe66b8625 chore: CODEOWNERS deploy owned by RM not MD (9064)
* 94e5d214f ci: more printing about state of master (9058)
* a3834ac48 chore: change log level for multirm messages [RM-125] (9080)
* 0099f4ec4 chore: update old e-mail address (8944)
* b726cf9eb feat: initialize genai shared_fs permissions to agent group in helm deployment (9065)
* 5031807eb chore: api level check if agent slotstats are pre computed (9073)
* 1a38f0cf5 feat: add /health endpoint [RM-114] (9062)
* 821750873 style: update harness to eliminate I2041 flake8 errors (8960)
* 2c7d2a1dc feat: add new endpoints to change log retention for experiments and trials (8982)
* 6c4bc44c6 fix: slot stats are not filled in everywhere (9070)
* 53bf20e7c fix: fix TestScheduleRetention (9069)
* 1e4591830 fix: remove parent_id from create_experiment (9068)
* 17287f5c8 fix: API migration to improve performance in resource pool page (9056)
* 85bb3c888 feat: add log retention for database logger (8622)
* 8f5de358b fix: remove calls to Pytorch Dataset len (8647)
* d9e1088c9 feat: webui nav sidebar dropdown text changes (9063)
* 06c86ee09 chore: Remove /lore redirect from deployment template (9057)
* 18dd29ea8 docs: Update release notes (9044)
* 8d2a76335 refactor: change GlideTable into a reusable component (ET-25) (8956)
* 93bca2ae0 fix: loading experiments without filterset (9059)
* a07f0fbf8 faster migrations (9060)
* e8dba6d0b feat: add slot stats to /agents endpoints (9048)

Release Notes
[0.30.0](https://github.com/determined-ai/determined/blob/0.30.0/docs/release-notes.rst)

Changelog
* 5a635188f chore: bump version: 0.30.0-rc5 -> 0.30.0
* 97aaa02c6 docs: add release notes for 0.30.0 (9103)
* c10844310 chore: bump version: 0.30.0-rc4 -> 0.30.0-rc5
* 4ce78b202 fix: prevent checkpoint modals from closing on their own [ET-116] [ET-120] (9094)
* 8bcdcc8dc chore: bump version: 0.30.0-rc3 -> 0.30.0-rc4
* e90238a6d chore: bump version: 0.30.0-rc2 -> 0.30.0-rc3
* b8db2e683 fix: slot stats are not filled in everywhere (9070)
* d2e3a5c18 fix: remove parent_id from create_experiment (9068)
* 61958ef8d fix: API migration to improve performance in resource pool page (9056)
* 62d102b06 chore: bump version: 0.30.0-rc1 -> 0.30.0-rc2
* bc241b6fa docs: Update release notes (9044)
* 2e31ece13 fix: loading experiments without filterset (9059)
* 4efaede76 chore: bump version: 0.30.0-rc0 -> 0.30.0-rc1
* d2949d3cc faster migrations (9060)
* 4c6e35c56 feat: add slot stats to /agents endpoints (9048)
* f32dc823b chore: bump version: 0.30.0-dev0 -> 0.30.0-rc0
* 10030a6c0 chore: lock published urls to preserve redirects
* 220f82067 chore: bump version: 0.29.2-dev0 -> 0.30.0-dev0
* 1e6f0f7c6 feat: Use filtered resource pools when creating notebook (9045)
* 74fe16bfb feat: profiling v2 [MD-27] (9032)
* 133d127ba docs: revert multirm docs changes 9016
* 1992c9786 chore: optional DB migrations (9047)
* 84ba68877 fix: docs lint (9052)
* 848b216cf feat: add command det model delete (9039)
* 1202d5c7c refactor: DET-9976 remove agentID type from agentrm (9040)
* 0710c58c7 docs: Describe editorrestricted (9049)
* 02da36f36 chore: mark db-dependent tests as needing to run in integration (9041)
* 6c88e8dbd fix: move experiment SQL error (9042)
* 3fa0df156 Revert "docs: add EditorRestricted role release note (9007)" (9046)
* 60cb00380 test: Jcom/infeng 454/sign in tests (9013)
* f08b40602 ci: tag CI-deployed resources (9043)
* 1868723db build(deps): bump google.golang.org/protobuf from 1.28.0 to 1.33.0 (8996)
* d4ab20bd5 build(deps): bump github.com/docker/docker (9026)
* e4bc377c3 test: playwright config and browser usability (9024)
* f6b9ac845 build(deps): bump github.com/jackc/pgx/v4 from 4.12.0 to 4.18.2 (8987)
* c811947b6 chore: helm for multirm kubeconfig_path (9033)
* 4441d6d4c feat: Add template to py sdk `create_experiment` (8927)
* 5ac1b853c chore: revert helm for multirm kubeconfig_path (9030)
* 6fec24d66 chore: helm for multirm kubeconfig_path (9015)
* 0518785be feat: streaming update code generation for typescript (8988)
* 39afa3c5c docs: add documentation for multirm (9016)
* 7e37c226b chore: add grpc based auth fallback to proxied requests (8980)
* 5e1f2af91 fix: Experiment.await_first_trial exits when Experiment is terminal (9022)
* a603f4cc4 chore: logins return Sessions (8883)
* 93b6aa295 feat: SearchFlatRuns api call for flat runs table support (8852)
* fa43bffdc ci: test-perf uses determined version from github (9019)
* 137bfcd9a feat: add model streaming (8973)
* 8bf280de0 refactor: consolidate experiment list selection state (8860)
* 674cd7302 ci: DRY skip logic and clarity on step name (9002)
* 00d145f8b chore: bump version: 0.29.1-dev0 -> 0.29.2-dev0
* a3ba9e9e4 chore: add docs dropdown link for new version
* e922a414f docs: add release notes for 0.29.1 (9014)
* dfed63d6e chore: reassign ml-sys CODEOWNERship to model-dev (9000)
* eac7ddffe test: document ui e2e with backend test instructions for local (9005)
* bc1b43173 docs: add EditorRestricted role release note (9007)
* f52f43bf3 chore: warn about det deploy det-version mistmach (8994)
* 5b17df323 chore: limit code coverage report to files in src; omit generated files (9003)
* f73fd092e fix: escape regex in `ProjectDeleteModal` (8998)
* 73fd1cdfe feat: Add multi RM name to K8s (8993)
* 978a02e2b ci: Djanicek/infraeng 487/circle test runner (8977)
* 4730d768b chore: ban http.Transport & http.Client; add cleanhttp (8991)
* 52572d437 fix: improved textcell performance for novels (8986)
* 89d470824 docs: add EditorRestricted role to rbac docs (8984)

Release Notes
[0.29.1](https://github.com/determined-ai/determined/blob/0.29.1/docs/release-notes.rst)

Changelog
* 6f0810b25 chore: bump version: 0.29.1-rc2 -> 0.29.1
* d13dfac2b docs: add release notes for 0.29.1 (9014)
* 8093bee50 chore: bump version: 0.29.1-rc1 -> 0.29.1-rc2
* cce4e6bb4 chore: warn about det deploy det-version mistmach (8994)
* a2576bec3 chore: bump version: 0.29.1-rc0 -> 0.29.1-rc1
* 05a75b32a fix: escape regex in `ProjectDeleteModal` (8998)
* de8d02db5 chore: bump version: 0.29.1-dev0 -> 0.29.1-rc0
* 0a2fd2855 chore: change GKE version (8989)
* 055dd8381 docs: Update Deploy on GCP (8985)
* 47cb6fdd1 fix: remove error text in continue trial modal (8923)
* 2f40476c8 chore: bump version: 0.29.0-dev0 -> 0.29.1-dev0
* 84a846e74 chore: add docs dropdown link for new version
* 0fd6b610f docs: add release notes for 0.29.0 (8955)
* 115bf1301 fix: remove duplicate permissions in rbac CLI output (8972)
* cc2e9b4ff chore: Bumpenvs for NGC+ images (8975)
* 1a35e5d4a test: add e2e_tests for multirm k8s [RM-11] (8926)
* 18154f65a chore: add type ResourcePoolName string (8978)
* a22656d8b chore: remove panics from rm initialization (8983)
* 4ae09875a chore: amend contributing doc to point to correct make rule, as of 2892 (8947)
* 26c985c29 fix: Check auth validity before setting isAuthenticated (8967)
* f67c47350 fix: nil deref in ReadPreemptionStatus (8979)
* 6e1acf4f7 chore: multirm unique resource pool config changes [RM-74] (8974)
* ca2987939 chore: add multirm router layer to rm module (8963)
* 2395dcb65 fix: stopping states are not handled in restore properly [RM-69] (8958)
* b06c92347 feat: allow k8srm to connect with a kubeconfig (8953)
* f8f860d48 chore: react-virtuoso LogViewer companion (8862)
* bf2189614 chore: revert multirm refactors (8962)
* 4309f7f85 feat: Display resource managers information (8951)
* 4d538aec4 test: remove last quarantined test (8922)
* 68017dd0d ci: update performance test script for breaking Determined change (8961)
* b2b85d718 chore: [RM-68] improve readability for unit test (8950)
* e1ca24279 feat: Connect ProjectStore with streaming updates (8834)
* 191a14482 fix: don't access agentState when it may be nil (8921)
* dcaa8936b fix: update default aux container limits and instance types (8959)
* c7e5d4399 docs: fix pre_publish check (8957)
* 6ecd81e77 chore: update AMIs - Nvidia minor version bump (8945)
* e108ed708 chore: set CGO_ENABLED=0 (8941)
* 54aa739dd chore: fix multirm unit test flake (8949)
* e8b016541 chore: add resource manager name/metadata to resourcepoolv1 proto (8948)
* a5b425a82 test: Add e2e test for streaming updates python client (8901)
* 77d1ede33 fix: `no data plot` in chart with data (8935)
* f416354a4 test: refactor usage within test_local (8913)
* c3012ff92 chore: add multirm module to ResourceManager (8857)
* d507edd5c test: CLI workflows in CI use new Python images (8943)
* fa856ab9d chore: remove support for Python 3.7; prefer 3.8 (7329)
* c404c8e24 fix: [RM-6] remove global max-slots-per-pod default when multiple RMs… (8938)
* 0d61d1574 build: bump up ci setup_remote_docker version (8942)
* 60436eac6 chore: pin pandas and ray versions for ray tests (8932)
* f997cd890 fix: malformed config with gcp up with --initial-user-password (8936)
* 967e41ff6 build: bump ci cpu image to latest ubuntu 2004 (8940)
* 592a566ba feat: streaming updates python client [MD-246] (8778)
* 2dfc4f208 chore: remove unused constant (8934)
* b99ad9ff6 fix: det deploy gcp down shouldn't check quotas (8931)
* 21fb6d1a5 fix: `det dev curl` support for URLs with curly brackets. (8930)
* 225dba365 fix: specify go1.22.0 (8929)
* 63adae5e9 fix: cli fails when listing providers [DET-10127] (8903)
* 9e8cd68ce fix: slurm launcher authenticates preemption notification (8928)
* acded3267 tc: Add release note 8851 (8864)
* dffda2770 chore: cover and bunify project functions in postgres_experiments.go (8912)
* beac3480b fix: SSO button link target (8925)
* 5367f4f14 chore: add codeowners for resource-mgmt team files (8879)
* feb73de04 tc: Remove broken link (8924)
* cd88bb517 chore: revert pod spec and test changes (8920)
* 1dfd6d958 chore: bump up ebs size to 400gb for genai deployments
* 3a3b668de fix: canonicalize master urls shim code (8919)
* ef49195aa test: fix failing Go TestResourceCreationFailed test (8918)
* 94c7bfe7d chore: minor tweaks as modev takes over streaming updates (8909)
* 392f0542a ci: fix failing nightlies after auth PR (8904)
* ad7d26019 chore: fix mp.pool test_streaming_metrics_api (8917)
* 8af414892 test: upload test results to datadog (8910)
* aab9b42ae test: remove redundant (and brittle) assertion (8894)
* 59385a076 feat: log podspec [DET-9861] (8899)
* 6857ecf20 chore: refactor ResourceManager interface for multirm (8847)
* 9f4060311 test: skip tests that need to get scheduler type (8911)
* 4c506011e chore: upgrade Go from 1.21 -> 1.22 (8914)

Release Notes
[0.29.0](https://github.com/determined-ai/determined/blob/0.29.0/docs/release-notes.rst)

Changelog
* 50795701a chore: bump version: 0.29.0-rc4 -> 0.29.0
* 8fa5b5ab4 docs: add release notes for 0.29.0 (8955)
* fffde7fa2 chore: bump version: 0.29.0-rc3 -> 0.29.0-rc4
* f939a0fe5 fix: `no data plot` in chart with data (8935)
* 5a74e3723 build: bump ci cpu image to latest ubuntu 2004 (8940)
* ad8475987 build: bump up ci setup_remote_docker version (8942)
* f0d9768c4 fix: malformed config with gcp up with --initial-user-password (8936)
* 2a61ab3fb chore: bump version: 0.29.0-rc2 -> 0.29.0-rc3
* 435e90a06 chore: fix mp.pool test_streaming_metrics_api (8917)
* 18e2ea44f chore: bump version: 0.29.0-rc1 -> 0.29.0-rc2
* 799373f10 fix: slurm launcher authenticates preemption notification (8928)
* 641174cc0 tc: Add release note 8851 (8864)
* f275252cc chore: bump up ebs size to 400gb for genai deployments
* 8c855b72c fix: SSO button link target (8925)
* 8d4acd564 tc: Remove broken link (8924)
* 06875df29 fix: canonicalize master urls shim code (8919)
* e5ae86567 chore: bump version: 0.29.0-rc0 -> 0.29.0-rc1
* b847edef6 chore: bump version: 0.29.0-dev0 -> 0.29.0-rc0
* 28c385c3b chore: lock published urls to preserve redirects
* cbfd3c299 chore: lock api state for backward compatibility check
* b30f609b2 chore: bump version: 0.28.2-dev0 -> 0.29.0-dev0
* ad94c1778 fix: return error from websocket handler if socket id is taken (8877)
* 46183898f style: update genai logo on sidebar (8907)
* 8f82087e8 test: fix tensorboard reattach k8s flake [RM-39] (8906)
* d24b19ab4 test: unquarantine deploy-local tests (8896)
* 7c6bec9d5 chore: refactor proto, schema, and jobservice for multiRM (8875)
* ca96da19c fix: Genai helm service fix (8885)
* a89e51e64 fix: trial comparison text overflow bug fix (8869)
* 9817a4dd4 chore: add trigger to abort checkpoint deletion (8878)
* 2689b0b88 chore: delete unused functions [RM-41] (8888)
* 9a6afd263 docs: Organize docs (8898)
* a8ac65767 chore: small build system fixes (8900)
* fa98bf354 fix: add missing ci context to preview cluster
* b15d50863 fix: add deploy last main missing ci context (8892)
* b47b4772a chore: cleanup stray comments (8889)
* ae082656d feat: force default user passwords for all det deploy and CI clusters [RM-28] (8851)
* be1ab8519 fix: unnecessary group related api calls during the initial group page loading (8882)
* f37bc3ed8 fix: move e2e_tests changes for slurm test from EE to OSS (8887)
* 93ced86f8 fix: add missing check for external sessions on exp launch (8859)
* 944732a57 ci: more e2e test fixes (8881)
* ab9505cb2 ci: fix e2e tests in ee (8880)
* 0bc3106b3 docs: Add llm blog link to home page (8874)
* c02932769 docs: add link checker utility (8738)
* e1da47157 chore: api's default retry now session's default retry (8872)
* 7bb9dbcc8 chore: master config updates for multirm [RM-3, RM-4, RM-5, RM-7, RM-29] (8831)
* f101f3d9c chore: add allocation info for cluster ui [DET-10018] (8616) (8876)
* 72d54bea5 chore: canonicalize master urls everywhere [MLG-878] (8670)
* e3709bd7d chore: document internal api errors (8865)
* 27a279e62 fix: e2e CPU tests have wrong maxSlotsPerPod number (8870)
* 03b9b3065 chore: bunify postgres_jobs.go (8858)
* e9ac112d7 build(deps): bump peter-evans/create-or-update-comment from 3 to 4 (8760)
* dc3e41e54 Fix broken links (8825)
* bccdf0c44 fix: stop allowing multi-container allocations to launch in single agent config (8833)
* a1214d7b8 chore: add allocation info for cluster ui [DET-10018] (8616)
* 76ec233d7 chore: refactor a bunch of auth-related python (8347)
* 66b1e6cce chore: bump version: 0.28.1-dev -> 0.28.2-dev0
* f250ad911 chore: add docs dropdown link for new version
* 9d44ca1da docs: add release notes for 0.28.1 (8861)
* ac8c44094 fix: allow experiments to configure k8s sidecars (8854)
* d07ec4091 ci: fix broken ci due to queue version change (8853)
* c656aac75 chore: use npm build for hew (8845)
* 6b637506c feat: add a master API to fetch a trial by external id. (8730)
* e78a4c02a fix: correctly source bucket region when using minio (8850)
* dba5f0ff7 fix: replace `react-window` with `react-virtuoso` in transfer component (8800)
* 2a183dadd ci: fix performance feature branch using wrong db (8835)
* 47061fa42 fix: revert config work from 8765 and 8789 due to feature regressions (8849)
* a5f38cbc7 chore: remove GetAllocationSummary from RM interface (8846)
* de28a571b chore: cover postgres_jobs.go (8841)
* ba8250a8d chore: update backend coverage target (8798)
* 556639d21 fix: show error message from backend API for workspace deletion (8848)
* 08dfa43af fix: job queue test failures (8843)
* 876f9c341 chore: configure agent log level through config file (8819)
* ba0337527 chore: move project id onto runs (8794)

Release Notes
[0.28.1](https://github.com/determined-ai/determined/blob/0.28.1/docs/release-notes.rst)

Changelog
* f6cb624b4 chore: bump version: 0.28.1-rc3 -> 0.28.1
* baaa3bd46 docs: add release notes for 0.28.1 (8861)
* fbf9df4ca chore: bump version: 0.28.1-rc2 -> 0.28.1-rc3
* a965f1506 ci: fix broken ci due to queue version change (8853)
* d91e8b00f chore: bump version: 0.28.1-rc1 -> 0.28.1-rc2
* 3129d339b fix: revert config work from 8765 and 8789 due to feature regressions (8849)
* 1888b90c8 chore: bump version: 0.28.1-rc0 -> 0.28.1-rc1
* c443073cf fix: show error message from backend API for workspace deletion (8848)
* 1fc1496a7 fix: job queue test failures (8843)
* a74685f0a chore: bump version: 0.28.1-dev -> 0.28.1-rc0
* 5b2e32d90 chore: cleanup the last traces of experiment git fields. [MD-258] (8830)
* 92a380f39 feat: Generic task restore (8802)
* b0fa7dc82 feat: generic tasks: support startup hooks (8840)
* ca80022b6 chore: bunify postgres_checkpoints and add tests (8783)
* a4dbc0350 chore: fix error on terminating experiments on restart (8837)
* aa98d8262 chore: agent state wasn't getting deleted and logged error (8838)
* bb469fae0 fix: update hew with bugfixes (8839)
* 393cfde76 Fix broken ref (8836)
* 7a1386331 perf: improve GetExperiments + SearchExperiments counting (8801)
* d8d996568 chore: remove unused SetAllocationName (8829)
* 1946d9a40 docs: Update slurm install (8832)
* 1fd21e7fb fix: Fix small typo in Webhook documentation (8820)
* e341e2785 feat: Generic Tasks (8724)
* fff85e361 fix: handle helm templating in older go template versions (8828)
* f300d9797 chore: hide genai helm values config and fix var name (8821)
* 6206bde27 feat: add streaming updates core functionality and project streaming (8669)
* ed6112186 fix: stop truncating log timestamps to avoid missing logs [WEB-1791] (8815)
* 43d3f2119 fix: check for models before deleting workspace (8804)
* bb59fa24e ci: wait longer for performance test db to startup (8796)
* cfffe96c9 docs: Remove legacy pages (8818)
* 1c3f3c485 fix: mitigate many unnecessary api calls in user management table (8816)
* 4612c41ca fix: agent config precedence (8656)
* 762fcefb4 feat: Deploy GenAI in Helm (8727)
* 8e067d9a0 fix: remove possible hang from ship_logs.py [MLG-1565] (8803)
* 1daf9d3cc docs: remove duplicated note (8813)
* 56e70009c fix: remove extra quotes around IdentifyTask (8792)
* 3805ebd89 chore: add testing for k8s informer panic (8810)
* a35696d57 refactor: condense trial update functions (8808)
* 45c578b9d chore: bump version: 0.28.0-dev0 -> 0.28.1-dev
* 652062900 chore: add docs dropdown link for new version
* ed2136d76 docs: add release notes for 0.28.0 (8807)
* 825856580 chore: bump version: 0.27.2-dev0 -> 0.28.0-dev
* c5afb6c42 fix: fetch experiment in case config data is not contained (8789)
* 4e17ef74d chore: differentiate between programmatic and web page requests (8795)
* a1a6e2074 chore: add ee helm chart changes to oss (8799)
* 65c811c09 docs: Add mention of RPMs to on-prem _index.rst (8773)
* ad765d4e6 docs: adds/corrects EE changes, merges to OSS (8788)
* f1a45aee2 perf: update proto_checkpoint_view to use index (8793)
* abd590dc3 Revert "docs: Update oidc and saml docs (8777)" (8791)
* bb88b01b7 fix: improve trial log request cancelling (8787)
* 17f305f54 ci: make perf tests only alert on failure (8790)
* 422f5aa44 perf: avoid loading model def in experiment model (8742)
* 769845293 perf: improve GetExperiments showTrialData performance (8753)
* e801cfe27 perf: add index to checkpoints_v2 id (8758)
* 71db4e17b perf: add indexes to tasks and allocations (8757)
* e0e6cf0e9 perf: improve get_workspaces query (8751)
* ef656bcc2 perf: improve resource agg performance (8735)
* e873381d2 fix: retry watcher failure causes infinite loop (8786)
* ba2f19053 fix: replace experiment config (8765)
* 85d105306 chore: rename postgres_command_intg_test.go (8785)
* 40a70cf86 test: performance test CI work (8761)
* 36a2e2906 chore: bunify db/postgres_tasks.go (8764)
* 07494cf7a fix: update hew to a version without broken documentcard prompts (8782)
* 950205992 feat: GCS client should retry on `TooManyRequests`. (8780)
* ec850aecd test: add intg tests for db/postgres_tasks.go (8750)
* 9ec2f7d2f chore: update gke version to comply with latest release for e2e tests (8781)
* cefa24213 chore: persist checkpoint storage backend ID (8690)
* 905e449dd chore: migrate db schema trials to runs (8723)
* dfbb926c0 chore: clean up leftover debug print statements (8755)