v0.9.59rc009

What's Changed

• fix build: truss-transfer-cli by @michaelfeil in #1321

Full Changelog: v0.9.59rc007...v0.9.59rc009

v0.9.59rc007

Full Changelog: v0.9.59rc006...v0.9.59rc007

v0.9.59rc006

What's Changed

• Update trusted publishing by @michaelfeil in #1320

Full Changelog: v0.9.59rc004...v0.9.59rc006

v0.9.59rc004

What's Changed

• [truss-transfer] ci + bump truss-transfer version by @michaelfeil in #1318
• bump for truss0.9.59rc004 release by @michaelfeil in #1319

Full Changelog: v0.9.59rc003...v0.9.59rc004

v0.9.59rc003

What's Changed

• Add new health check configuration fields by @spal1 in #1290

Full Changelog: v0.9.59.rc0-013...v0.9.59rc003

v0.9.59.rc0-013

What's Changed

• bump trt-rei-version in context-builder by @michaelfeil in #1304
• Upgrade ruff dependency version by @nnarayen in #1305
• Better typing to avoid fmt directive by @nnarayen in #1306
• better ruff lock by @michaelfeil in #1307
• set poetry min-version 2.0.0 by @michaelfeil in #1308
• Update docker image for TEI deployment by @michaelfeil in #1309
• Remove chains depedendcy on BasetenService. General cleanup. by @marius-baseten in #1310
• Translate RPC timeout error message. by @marius-baseten in #1313
• truss context builder start command by @michaelfeil in #1312
• Include better error when configuration file doesn't exist by @nnarayen in #1314
• Chains mistral example: fix dep and improve output by @marius-baseten in #1316
• add truss transfer by @michaelfeil in #1317

New Contributors

• @nnarayen made their first contribution in #1305

Full Changelog: v0.9.59.rc0...v0.9.59.rc0-013

v0.9.59.rc0

What's Changed

• Client side validation for non fp8 kv cache and fp8 context fmha by @joostinyi in #1302
• Add encoder model support in trt-llm by @michaelfeil in #1294
• Add kv_cache_host_memory_bytes as a configurable runtime setting by @joostinyi in #1303

Full Changelog: v0.9.58...v0.9.59.rc0

v0.9.58

What's Changed

• Update trt_llm_config.py by @pankajroark in #1291
• Add DRAFT_EXTERNAL as a default speculator.speculative_decoding_mode by @joostinyi in #1292
• LazyDataResolver falls back to data dir if no space in cache by @helenlyang in #1293
• Prep for Smoke Tests by @marius-baseten in #1296
• Chains Smoke Tests by @marius-baseten in #1298
• Upgrade CI ubuntu runners to 22.04. by @marius-baseten in #1299
• Sync poetry and python versions with CI by @marius-baseten in #1300
• Release 0.9.58 by @basetenbot in #1301

Full Changelog: v0.9.57...v0.9.58

v0.9.58rc102

What's Changed

• LazyDataResolver falls back to data dir if no space in cache by @helenlyang in #1293
• Prep for Smoke Tests by @marius-baseten in #1296
• Chains Smoke Tests by @marius-baseten in #1298
• Upgrade CI ubuntu runners to 22.04. by @marius-baseten in #1299
• Sync poetry and python versions with CI by @marius-baseten in #1300

Full Changelog: v0.9.58rc2...v0.9.58rc102

v0.9.58rc2

What's Changed

• Add DRAFT_EXTERNAL as a default speculator.speculative_decoding_mode by @joostinyi in #1292

Full Changelog: v0.9.58rc1...v0.9.58rc2