predictbatch(method, model, inputs[; device, context])

Predict targets from a vector of inputs using model by batching them. Optionally apply function device to batch before passing to model and use context instead of the default Inference.