GenerationRequest Struct

Declaration

struct simaai::neat::genai::GenerationRequest { ... }

Included Headers

#include <GenAITypes.h>

Public Member Attributes Index

std::optional< std::string >	prompt
std::optional< std::string >	system_prompt
std::vector< ChatMessage >	messages
ImageList	images
bool	use_cached_images = false
std::optional< Tensor >	audio
std::optional< std::filesystem::path >	audio_file
std::string	language = "auto"
	ASR source language code/name, or auto to detect it. More...
ASRTask	asr_task = ASRTask::Transcribe
	Whisper decoding task. Ignored by non-ASR models. More...
std::uint32_t	max_new_tokens = 0
bool	enable_thinking = false
Json	tools = Json::array()
Json	tool_choice = nullptr
std::string	reasoning_effort = "low"
	How much the model reasons: low, medium or high. More...

Definition at line 81 of file GenAITypes.h.

Public Member Attributes

asr_task

ASRTask simaai::neat::genai::GenerationRequest::asr_task = ASRTask::Transcribe

Whisper decoding task. Ignored by non-ASR models.

Definition at line 92 of file GenAITypes.h.

audio

std::optional<Tensor> simaai::neat::genai::GenerationRequest::audio

Definition at line 87 of file GenAITypes.h.

audio_file

std::optional<std::filesystem::path> simaai::neat::genai::GenerationRequest::audio_file

Definition at line 88 of file GenAITypes.h.

enable_thinking

bool simaai::neat::genai::GenerationRequest::enable_thinking = false

Definition at line 94 of file GenAITypes.h.

images

ImageList simaai::neat::genai::GenerationRequest::images

Definition at line 85 of file GenAITypes.h.

language

std::string simaai::neat::genai::GenerationRequest::language = "auto"

ASR source language code/name, or auto to detect it.

Definition at line 90 of file GenAITypes.h.

max_new_tokens

std::uint32_t simaai::neat::genai::GenerationRequest::max_new_tokens = 0

Definition at line 93 of file GenAITypes.h.

messages

std::vector<ChatMessage> simaai::neat::genai::GenerationRequest::messages

Definition at line 84 of file GenAITypes.h.

prompt

std::optional<std::string> simaai::neat::genai::GenerationRequest::prompt

Definition at line 82 of file GenAITypes.h.

reasoning_effort

std::string simaai::neat::genai::GenerationRequest::reasoning_effort = "low"

How much the model reasons: low, medium or high.

Independent of enable_thinking, which controls whether reasoning is returned.

Definition at line 99 of file GenAITypes.h.

system_prompt

std::optional<std::string> simaai::neat::genai::GenerationRequest::system_prompt

Definition at line 83 of file GenAITypes.h.

tool_choice

Json simaai::neat::genai::GenerationRequest::tool_choice = nullptr

Definition at line 96 of file GenAITypes.h.

tools

Json simaai::neat::genai::GenerationRequest::tools = Json::array()

Definition at line 95 of file GenAITypes.h.

use_cached_images

bool simaai::neat::genai::GenerationRequest::use_cached_images = false

Definition at line 86 of file GenAITypes.h.

---

The documentation for this struct was generated from the following file:

• GenAITypes.h

---

Generated via doxygen2docusaurus 2.0.0 by Doxygen 1.15.0.