Telemetry & Stats

Monitor and analyze your AI application's performance with FreeToken's simple telemetry and statistics dashboard.

Overview

The FreeToken Console provides real-time telemetry and statistics about your AI operations. This includes usage metrics, error monitoring, and duration of requests. Use these insights to optimize your application and understand user behavior.

Accessing Telemetry Dashboard

Navigate to the FreeToken Console and select Telemetry from the main navigation menu.

Key Metrics

Captured Events

add_message_to_thread: Captures the time it took to add a message to a thread.

create_message_thread: Captures the time it took to create a new message thread.

generate_cloud_chat_completion: Captures the time it took and stats about (tokens used, model used, etc) cloud chat completions.

generate_local_chat_completion: Captures the time it took and stats about (tokens used, model used, etc) local chat completions.

register_device_session: Captures the time it took to register a device session.

run_message_thread_cloud: Captures the overall time it took to run a message thread using a cloud model (including all tool calls, and server requests).

run_message_thread_local: Captures the overall time it took to run a message thread using a local model (including all tool calls, and server requests).

search_documents: Captures the time it took to search documents.

tool_call_agent_run: Captures the time it took to run an agent tool call.

web_search: Captures the time it took to perform a web search.

Filtering Data

You can filter the telemetry data by:

  • App
  • Event Type
  • Success (Whether the event ended in an error in your app)
  • Device Session ID (click the session ID in the table to filter by it)

You can easily reset filters by clicking the "Reset" button.

Total Saved - How it Works

The total saved metrics graph uses the input and output token counts from your local AI runs and calculates what that would have cost you with the same cloud model. This is a great way for you to see how FreeToken is helping you save money by running AI on-device.