Class ChatFriendli

The ChatFriendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

Hierarchy (view full)

Constructors

constructor

Properties

baseUrl model frequencyPenalty? friendliTeam? friendliToken? maxTokens? modelKwargs? stop? temperature? topP?

Constructors

constructor

Properties

baseUrl

baseUrl: string = "https://inference.friendli.ai"

model

model: string = "meta-llama-3-8b-instruct"

OptionalfrequencyPenalty

frequencyPenalty?: number

OptionalfriendliTeam

friendliTeam?: string

OptionalfriendliToken

friendliToken?: string

OptionalmaxTokens

maxTokens?: number

OptionalmodelKwargs

modelKwargs?: Record<string, unknown>

Optionalstop

stop?: string[]

Optionaltemperature

temperature?: number

OptionaltopP

topP?: number

Settings

Member Visibility

On This Page

Constructors
Properties