SUMMARY.md

Table of contents

• MLServer

• Getting Started

• User Guide

  • Content Types (and Codecs)
  • OpenAPI Support
  • Parallel Inference
  • Adaptive Batching
  • Custom Inference Runtimes
  • Metrics
  • Deployment
    • Seldon Core
    • KServe
  • Streaming

• Inference Runtimes

  • SKLearn
  • XGBoost
  • MLFlow
  • Spark MlLib
  • LightGBM
  • Catboost
  • Alibi-Detect
  • Alibi-Explain
  • HuggingFace
  • Custom

• Reference

  • MLServer Settings
  • Model Settings
  • Python API
    • MLModel
    • Model Settings
    • Types
    • Codecs
      • Codecs — Built-ins
      • Codecs - Interfaces
    • Metrics
    • Types Reference
      • mlserver.types
      • InferenceRequest
      • InferenceErrorResponse
    • Types All

• Examples

  • Serving Scikit-Learn models
  • Serving XGBoost models
  • Serving LightGBM models
  • Serving MLflow models
  • Serving a custom model
  • Serving Alibi-Detect models
  • Serving HuggingFace Transformer Models
  • Multi-Model Serving
  • Model Repository API
  • Content Type Decoding
  • Custom Conda environments in MLServer
  • Serving a custom model with JSON serialization
  • Serving models through Kafka
  • Streaming
  • Deploying a Custom Tensorflow Model with MLServer and Seldon Core

• Changelog

• Release Notes