GenerationRequest Struct

Declaration

struct simaai::neat::genai::GenerationRequest { ... }

Included Headers

#include <GenAITypes.h>

Public Member Attributes Index

std::optional< std::string >	prompt
std::optional< std::string >	system_prompt
std::vector< ChatMessage >	messages
ImageList	images
bool	use_cached_images = false
std::optional< Tensor >	audio
std::optional< std::filesystem::path >	audio_file
std::string	language = "auto"
	ASR source language code/name, or auto to detect it. More...
ASRTask	asr_task = ASRTask::Transcribe
	Whisper decoding task. Ignored by non-ASR models. More...
std::uint32_t	max_new_tokens = 0
bool	enable_thinking = false
Json	tools = Json::array()
Json	tool_choice = nullptr

Definition at line 103 of file GenAITypes.h.

Public Member Attributes

asr_task

ASRTask simaai::neat::genai::GenerationRequest::asr_task = ASRTask::Transcribe

Whisper decoding task. Ignored by non-ASR models.

Definition at line 114 of file GenAITypes.h.

audio

std::optional<Tensor> simaai::neat::genai::GenerationRequest::audio

Definition at line 109 of file GenAITypes.h.

audio_file

std::optional<std::filesystem::path> simaai::neat::genai::GenerationRequest::audio_file

Definition at line 110 of file GenAITypes.h.

enable_thinking

bool simaai::neat::genai::GenerationRequest::enable_thinking = false

Definition at line 116 of file GenAITypes.h.

images

ImageList simaai::neat::genai::GenerationRequest::images

Definition at line 107 of file GenAITypes.h.

language

std::string simaai::neat::genai::GenerationRequest::language = "auto"

ASR source language code/name, or auto to detect it.

Definition at line 112 of file GenAITypes.h.

max_new_tokens

std::uint32_t simaai::neat::genai::GenerationRequest::max_new_tokens = 0

Definition at line 115 of file GenAITypes.h.

messages

std::vector<ChatMessage> simaai::neat::genai::GenerationRequest::messages

Definition at line 106 of file GenAITypes.h.

prompt

std::optional<std::string> simaai::neat::genai::GenerationRequest::prompt

Definition at line 104 of file GenAITypes.h.

system_prompt

std::optional<std::string> simaai::neat::genai::GenerationRequest::system_prompt

Definition at line 105 of file GenAITypes.h.

tool_choice

Json simaai::neat::genai::GenerationRequest::tool_choice = nullptr

Definition at line 118 of file GenAITypes.h.

tools

Json simaai::neat::genai::GenerationRequest::tools = Json::array()

Definition at line 117 of file GenAITypes.h.

use_cached_images

bool simaai::neat::genai::GenerationRequest::use_cached_images = false

Definition at line 108 of file GenAITypes.h.

---

The documentation for this struct was generated from the following file:

• GenAITypes.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.9.8.