DISCOVERED IN HACKER NEWS
Server
Server: a product linked in Hacker News recommendation discussions.
Developer tools
1Recommendation signals
1Sources
2024-09-28Latest mention
Why does HN talk about it?
Automatically selected excerpts in their original language. Read the full discussion for context.
By the way, if anyone is struggling with these challenges today, I recommend taking a peek at nvidia's Triton inference server (https://github.com/triton-inference-server/server https://github.com/triton-inference-server/server), which handles a lot of these details for you.Read the full discussion