generateStream

open override fun generateStream(prompt: String): Flow<String>(source)

Streaming variant of generate. Default replays the single-shot result as one emission so every existing actual keeps working with zero changes; backends with native token streaming (ML Kit GenAI, MediaPipe) override this directly. CompositeOnDeviceLlm overrides both overloads too, so streaming through it reaches whichever backend it picked, not this default.


open override fun generateStream(parts: List<LlmPart>): Flow<String>(source)