v0.9.61rc001

What's Changed

• Revert back to 0.9.60rc006 after broken release by @nnarayen in #1377
• Various refactors to model wrapper + truss server by @nnarayen in #1379
• update truss transfer by @michaelfeil in #1383
• Mf/v2 truss transfer by @michaelfeil in #1385
• Modify truss release workflow to be more automated by @nnarayen in #1382
• Introduce websocket passthrough for truss server by @nnarayen in #1378

Full Changelog: v0.9.60...v0.9.61rc001

v0.9.60

What's Changed

• Fix integration test for span cleanup by @nnarayen in #1374
• Use hostname for Chains by @tyranitar in #1349
• Release 0.9.60 by @basetenbot in #1376

Full Changelog: v0.60.0...v0.9.60

v0.60.0

What's Changed

• Fix patch behavior for trusses using python DX by @nnarayen in #1337
• Bump truss version to 0.9.60rc001 by @nnarayen in #1345
• adds node count to truss spec by @rcano-baseten in #1344
• bump truss-transfer to 0.0.1 by @michaelfeil in #1342
• Add trace ID logging to failed chainlet RPC log - related BT-13465 by @marius-baseten in #1348
• Add H200 accelerator type by @nnarayen in #1351
• Bug bash improvements to Python DX, better error messages by @nnarayen in #1346
• Better example code for models using chains framework by @nnarayen in #1347
• Update constants.py by @michaelfeil in #1354
• raising ValueError for py38 or less for truss supported version by @sumerjoshi in #1350
• Update pyproject.toml by @michaelfeil in #1356
• update: max num tokens for bei by @michaelfeil in #1357
• add bei specfic user migrations in trt-llm config by @michaelfeil in #1361
• trt-llm: add max gib 16GB by @michaelfeil in #1362
• Use PurePosixPath, to fix usage on Windows. by @squidarth in #1358
• truss-transfer: rename b10cache by @michaelfeil in #1365
• [TaT] Pre-requisites for flexible builds. by @marius-baseten in #1352
• Clean Chains Stack Traces and consolidate logging config. Fixes BT-13465 BT-13378 by @marius-baseten in #1353
• add truss trtllm config by @michaelfeil in #1366
• Add --python-dx flag to truss init by @nnarayen in #1367
• Multinode Cleanup by @rcano-baseten in #1360
• Cleanup init and init_directory usage by @nnarayen in #1368
• Introduce truss server passthrough for OpenAI methods by @nnarayen in #1364
• Fix integration test expectations by @nnarayen in #1370
• Fix streaming for OpenAI clients by @nnarayen in #1371
• Release 0.60.0 by @basetenbot in #1373

New Contributors

• @sumerjoshi made their first contribution in #1350

Full Changelog: v0.9.59...v0.60.0

v0.9.60rc006

What's Changed

• Fix integration test expectations by @nnarayen in #1370
• Fix streaming for OpenAI clients by @nnarayen in #1371

Full Changelog: v0.9.60rc005...v0.9.60rc006

v0.9.60rc005

What's Changed

• add bei specfic user migrations in trt-llm config by @michaelfeil in #1361
• trt-llm: add max gib 16GB by @michaelfeil in #1362
• Use PurePosixPath, to fix usage on Windows. by @squidarth in #1358
• truss-transfer: rename b10cache by @michaelfeil in #1365
• [TaT] Pre-requisites for flexible builds. by @marius-baseten in #1352
• Clean Chains Stack Traces and consolidate logging config. Fixes BT-13465 BT-13378 by @marius-baseten in #1353
• add truss trtllm config by @michaelfeil in #1366
• Add --python-dx flag to truss init by @nnarayen in #1367
• Multinode Cleanup by @rcano-baseten in #1360
• Cleanup init and init_directory usage by @nnarayen in #1368
• Introduce truss server passthrough for OpenAI methods by @nnarayen in #1364

Full Changelog: v0.9.60rc004...v0.9.60rc005

v0.9.60rc004

What's Changed

• update: max num tokens for bei by @michaelfeil in #1357

Full Changelog: v0.9.60rc003...v0.9.60rc004

v0.9.60rc003

What's Changed

• Bug bash improvements to Python DX, better error messages by @nnarayen in #1346
• Better example code for models using chains framework by @nnarayen in #1347
• Update constants.py by @michaelfeil in #1354
• raising ValueError for py38 or less for truss supported version by @sumerjoshi in #1350
• Update pyproject.toml by @michaelfeil in #1356

New Contributors

• @sumerjoshi made their first contribution in #1350

Full Changelog: v0.9.60rc002...v0.9.60rc003

v0.9.60rc002

What's Changed

• adds node count to truss spec by @rcano-baseten in #1344
• bump truss-transfer to 0.0.1 by @michaelfeil in #1342
• Add trace ID logging to failed chainlet RPC log - related BT-13465 by @marius-baseten in #1348
• Add H200 accelerator type by @nnarayen in #1351

Full Changelog: v0.9.60rc001...v0.9.60rc002

v0.9.60rc001

What's Changed

• Fix patch behavior for trusses using python DX by @nnarayen in #1337
• Bump truss version to 0.9.60rc001 by @nnarayen in #1345

Full Changelog: v0.9.59...v0.9.60rc001

v0.9.59

What's Changed

• Client side validation for non fp8 kv cache and fp8 context fmha by @joostinyi in #1302
• Add encoder model support in trt-llm by @michaelfeil in #1294
• Add kv_cache_host_memory_bytes as a configurable runtime setting by @joostinyi in #1303
• bump trt-rei-version in context-builder by @michaelfeil in #1304
• Upgrade ruff dependency version by @nnarayen in #1305
• Better typing to avoid fmt directive by @nnarayen in #1306
• better ruff lock by @michaelfeil in #1307
• set poetry min-version 2.0.0 by @michaelfeil in #1308
• Update docker image for TEI deployment by @michaelfeil in #1309
• Remove chains depedendcy on BasetenService. General cleanup. by @marius-baseten in #1310
• Translate RPC timeout error message. by @marius-baseten in #1313
• truss context builder start command by @michaelfeil in #1312
• Include better error when configuration file doesn't exist by @nnarayen in #1314
• Chains mistral example: fix dep and improve output by @marius-baseten in #1316
• add truss transfer by @michaelfeil in #1317
• Add new health check configuration fields by @spal1 in #1290
• [truss-transfer] ci + bump truss-transfer version by @michaelfeil in #1318
• bump for truss0.9.59rc004 release by @michaelfeil in #1319
• Update trusted publishing by @michaelfeil in #1320
• fix build: truss-transfer-cli by @michaelfeil in #1321
• add truss-transfer symlink support for nested dirs by @michaelfeil in #1324
• refactor-dependencies, truss transfer cli by @michaelfeil in #1326
• Prevent context builder image clobbers by @nnarayen in #1315
• Update image (BEI) by @michaelfeil in #1325
• bump truss to 0.9.59rc011 rc release by @michaelfeil in #1328
• adding truss-transfer in truss by @michaelfeil in #1327
• Update truss-transfer-cli-release.yaml by @michaelfeil in #1330
• Introduce chains-like DX for building traditional truss models by @nnarayen in #1311
• Add overrides for models using chains framework by @nnarayen in #1329
• bump truss-transfer in truss by @michaelfeil in #1331
• enable paged context by default by @michaelfeil in #1332
• Refactor method overriding into shared settings configuration by @nnarayen in #1333
• truss engine builder context fhma by @michaelfeil in #1334
• Ruff configuration change for compact python code by @nnarayen in #1335
• bei truss transfer command by @michaelfeil in #1336
• Upgrade of briton package and truss version ahead of release by @joostinyi in #1322
• Add is_healthy to truss by @spal1 in #1283
• [truss-transfer] verbosity and add missing download by @michaelfeil in #1339
• Bump briton by @bdubayah in #1340
• Bump briton server by @bdubayah in #1341
• Release 0.9.59 by @basetenbot in #1343

New Contributors

• @nnarayen made their first contribution in #1305

Full Changelog: v0.9.58...v0.9.59