Files
firebase-ios-sdk/GeminiLanguageModel/Sources/GeminiAPIDataModels/GenerateContent/VideoMetadata.swift
T
Andrew Heard 3796a55fdf feat(ai): add GeminiLanguageModel (#16601)
Implemented `GeminiLanguageModel`, providing an adapter for Google's
Gemini models conforming to Apple's `FoundationModels.LanguageModel`
protocol. This PR includes text to text generation capabilities; other
modalities and Gemini features will be handled in follow-up PRs.

**Note:** The `GeminiLanguageModel` implementation is guarded by the
environment variable `GEMINI_LANGUAGE_MODEL`. By default none of the
`GeminiLanguageModel` implementation is included.

Key additions:
- `GeminiLanguageModel`: Implements `LanguageModel` protocol with
  reasoning capabilities, configuring execution via `ModelResource`
  and `EndpointConfiguration`.
- `GeminiLanguageModelExecutor`: Converts prompt instructions and
  history into Gemini streaming requests, yielding responses as
  `LanguageModelSession.ResponseStream`.
- `GeminiTranscriptTranslator`: Translates Apple `Transcript` entries
  and segments into Gemini `Content` structures while preserving thought
  signatures and validating supported transcript features.
- `GeminiLanguageModel.Error` and `GeminiErrorMapper`: Translates Gemini
  API, HTTP, and network errors into standard `LanguageModelError` cases
  (`rateLimited`, `timeout`, `guardrailViolation`, `refusal`, and
  `unsupportedLanguageOrLocale`) or `GeminiLanguageModel.Error` cases
  (`serviceUnavailable`, `networkFailure`, `modelNotFound`, `apiError`).
  The `APIError` payload is designed for seamless forward compatibility
  with both GenerateContent and the upcoming Interactions API.
- Testing infrastructure: Adds `ConditionTrait.requireFoundationModels`
  to conditionally run Foundation Models tests only on supported
  platforms (macOS 27+, iOS 27+, watchOS 27+, visionOS 27+), along with
  shared test constants, mock fixtures, and comprehensive unit and
  integration test suites.
2026-09-04 18:05:45 -04:00

75 lines
2.5 KiB
Swift

// Copyright 2026 Google LLC
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
import Foundation
/// An internal data model for `VideoMetadata`.
///
/// ### Gemini Developer API
///
/// Type: `GoogleAiGenerativelanguageV1betaVideoMetadata`
///
/// Deprecated: Use `GenerateContentRequest.processing_options` instead. Metadata
/// describes the input video content.
///
/// ### Gemini Enterprise Agent Platform
///
/// Type: `GoogleCloudAiplatformV1beta1VideoMetadata`
///
/// Provides metadata for a video, including the start and end offsets for
/// clipping and the frame rate.
@available(*, deprecated)
package struct VideoMetadata: Codable, Sendable, Equatable, Hashable {
/// Optional. The start offset of the video.
package let startOffset: String?
/// Optional. The end offset of the video.
package let endOffset: String?
/// Optional. The frame rate of the video sent to the model. If not specified, the
///
/// ### Gemini Developer API
///
/// Optional. The frame rate of the video sent to the model. If not specified, the
/// default value will be 1.0.
/// The fps range is (0.0, 24.0].
///
/// ### Gemini Enterprise Agent Platform
///
/// Optional. The frame rate of the video sent to the model. If not specified,
/// the default value is 1.0. The valid range is (0.0, 24.0].
package let fps: Double?
/// Creates a new `VideoMetadata`.
///
/// - Parameters:
/// - startOffset: Optional. The start offset of the video.
/// - endOffset: Optional. The end offset of the video.
/// - fps: Optional. The frame rate of the video sent to the model. If not specified, the (behavior varies by backend). For more details, see ``fps``.
package init(
startOffset: String? = nil,
endOffset: String? = nil,
fps: Double? = nil
) {
self.startOffset = startOffset
self.endOffset = endOffset
self.fps = fps
}
enum CodingKeys: String, CodingKey {
case startOffset = "startOffset"
case endOffset = "endOffset"
case fps = "fps"
}
}