Show HN: Spinf-serve – inference server for bulk scoring and decisions

Bulk classification and decision inference on one GPU: the content is read once, every question about it is scored in the same pass. OpenAI-compatible, Apache 2.0 - spinfinc/spinf-serve