Flexprice Collector

​

How It Works

• Inputs read data from various sources (Kafka, webhooks, databases, files)
• Processors validate, transform, and filter data to match Flexprice format
• Outputs send data to Flexprice API with bulk batching and retry logic

​

Key Features

• Automatic Batching: Groups events for bulk ingestion (10 events or 2s by default)
• Smart Routing: Uses /events for single events, /events/bulk for batches
• Retry Logic: Exponential backoff ensures no data loss on network failures
• High Throughput: Configurable batching and output concurrency let you tune ingestion for your workload

​

Ingesting Data into Flexprice

output:
  flexprice:
    api_host: https://us.api.flexprice.io
    api_key: ${FLEXPRICE_API_KEY}
    scheme: https
    batching:
      count: 10
      period: 2s

pipeline:
  processors:
    - mapping: |
        root.event_name = this.event_name
        root.external_customer_id = this.customer_id
        root.properties = this.properties.map_each(p -> p.value.string())
        root.timestamp = this.timestamp.or(now().format_timestamp("2006-01-02T15:04:05Z07:00"))

input:
  kafka:
    addresses: [${KAFKA_BROKERS}]
    topics: [usage-events]
    consumer_group: flexprice-collector

​

Installation

• Binaries from GitHub Releases
• Container images
• Kubernetes deployment (see Get Started guide)

​

Performance & Reliability

• Bulk Ingestion: Configurable batch sizes; the bulk event API accepts up to 1,000 events per request. Set batching.count within this limit
• Automatic Retries: Failed events retry with exponential backoff
• At-Least-Once Delivery: Kafka consumer groups ensure no data loss
• Observability: Prometheus metrics and structured logging