BatchRequest
No overview available.
Attributes
- requests: List[InferenceRequest]
- List of inference requests.
Constructors
-
Initializes a BatchRequest object.
-
Parameters
- requests: List[InferenceRequest]
- A list of InferenceRequest objects to be included in the batch.
- requests: List[InferenceRequest]