Hacker Newsnew | past | comments | ask | show | jobs | submit | chaoyu's submissions login

1. Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TensorRT-LLM, TGI (bentoml.com) 15 points by chaoyu on July 5, 2024 | past | 1 comment 2. Show HN: ML Serving orchestration framework on Kubernetes (github.com/bentoml) 2 points by chaoyu on Oct 26, 2022 | past 3. BentoML: The easiest way to build Machine Learning APIs (github.com/bentoml) 4 points by chaoyu on Sept 25, 2020 | past | 1 comment 4. Vote with Your Feet: SF Art Installation (votewithyourfeet.org) 1 point by chaoyu on Nov 8, 2016 | past

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search: