Class FallbackManager

FallbackManager - Handles automatic model switching and performance tracking

Index

Constructors

Methods

executeWithFallback getPerformanceMetrics getModelMetrics resetMetrics updateConfig setCostTracker

Constructors

constructor

new FallbackManager(
    config?: GatewayConfig,
    costTracker?: CostTracker,
    debugManager?: DebugManager,
): FallbackManager
Parameters
- config: GatewayConfig = {}
- OptionalcostTracker: CostTracker
- OptionaldebugManager: DebugManager
Returns FallbackManager
- Defined in context/FallbackManager.ts:85

Methods

executeWithFallback

executeWithFallback<T>(
    chainName: string | string[],
    operation: (modelId: string, model: any) => Promise<T>,
    context?: {
        query?: string;
        requirements?: {
            capabilities?: ("text" | "reasoning" | "vision" | "function_calling")[];
            costTier?: "low" | "medium" | "high";
        };
    },
): Promise<FallbackResult<T>>
Execute a function with automatic fallback on failure
Type Parameters
- T
Parameters
- chainName: string | string[]
- operation: (modelId: string, model: any) => Promise<T>
- Optionalcontext: {
      query?: string;
      requirements?: {
          capabilities?: ("text" | "reasoning" | "vision" | "function_calling")[];
          costTier?: "low" | "medium" | "high";
      };
  }
Returns Promise<FallbackResult<T>>
- Defined in context/FallbackManager.ts:111

getPerformanceMetrics

getPerformanceMetrics(): ModelPerformanceMetrics[]
Get current performance metrics

Returns ModelPerformanceMetrics[]
- Defined in context/FallbackManager.ts:601

getModelMetrics

getModelMetrics(modelId: string): ModelPerformanceMetrics
Get metrics for a specific model
Parameters
- modelId: string
Returns ModelPerformanceMetrics
- Defined in context/FallbackManager.ts:608

resetMetrics

resetMetrics(): void
Reset performance metrics

Returns void
- Defined in context/FallbackManager.ts:615

updateConfig

updateConfig(newConfig: Partial<GatewayConfig>): void
Update configuration
Parameters
- newConfig: Partial<GatewayConfig>
Returns void
- Defined in context/FallbackManager.ts:672

setCostTracker

setCostTracker(costTracker: CostTracker): void
Set cost tracker for usage monitoring
Parameters
- costTracker: CostTracker
Returns void
- Defined in context/FallbackManager.ts:680