NVIDIA TensorRT Model Connect Brings Hugging Face Models to Native C++ Inference
NVIDIA has introduced TensorRT Model Connect (TRTMC) in public preview, an open-source project designed to simplify the path from a supported Hugging Face model or local checkpoint to native TensorRT inference. The project aims to remove one of the most familiar steps in traditional model deployment: ONNX export. With TensorRT Model Connect, developers can take … Read more