🐛 Describe the bug import pynvml is invalid in cpu host. Error logs >>> import pynvml Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: No module named pynvml Installation instructions from source Model Packaing N/A config.properties No respo...

Commit 9217c6a daily scheduled CI run failed, please check why

🐛 Describe the bug Wrong string formatting syntax in PredictionException _str_ method. Error logs print(PredictionException('hello','world')) returns "message : error_code" instead of "hello : world" Installation instructions Install torchserve from source: Yes Model Packaing config.properties...

Commit 9217c6a daily scheduled CI run failed, please check why

🚀 The feature Populate exception message Motivation, pitch Currently, if the handler raise some random error, the client will receives only InternalServerException without error/exception details <_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "Predicti...

Commit 4f7caa3 daily scheduled CI run failed, please check why

Commit 4f7caa3 daily scheduled CI run failed, please check why

🚀 The feature A few customers I've chatted with have been confused with a CorruptedFrameException error https://github.com/pytorch/serve/issues?q=CorruptedFrameException The fix is to increase the max_response_size in config.properties so we should probably just print that in warnings Motivation, pi...

🚀 The feature images with Ubuntu 20.04 Motivation, pitch Currently GPU images are hard-coded to ubuntu 18.04. -g: https://github.com/pytorch/serve/blob/master/docker/build_image.sh#L43 -cv: https://github.com/pytorch/serve/blob/master/docker/build_image.sh#L70 if we can have the flexibility to bui...

🐛 Describe the bug Hi the default densnet161 example worked but when I tried to run it with ts/torch_handler/densenet_handler.py it looked like stuck on the request curl http://127.0.0.1:8080/predictions/densenet161 -T examples/image_classifier/kitten.jpg Is this the right way to archive using --han...