P2C

Samples two random endpoints and picks the one with fewer in-flight requests

Category: Practical
Task: Samples two random endpoints and picks the one with fewer in-flight requests

Prerequisites: The product runtime and any backend services referenced by this configuration.

Run it: Use ghcr.io/praxis-proxy/praxis:0.7.2 and follow the first reverse-proxy tutorial to mount and start the configuration.

This configuration comes from the selected release. The example has not been run here; external services are not bundled.

Download the source file.

# P2C (Power of Two Choices) Load Balancing
#
# Samples two random endpoints and picks the one with fewer
# in-flight requests. O(1) selection with near-optimal load
# distribution. Preferred over least_connections for large
# endpoint pools.
#
listeners:
  - name: default
    address: "127.0.0.1:8080"
    filter_chains:
      - main

filter_chains:
  - name: main
    filters:
      - filter: router
        routes:
          - path_prefix: "/"
            cluster: backend

      - filter: load_balancer
        clusters:
          - name: backend
            load_balancer_strategy: p2c
            endpoints:
              - "127.0.0.1:3001"
              - "127.0.0.1:3002"
              - "127.0.0.1:3003"

insecure_options:
  allow_private_endpoints: true # example proxies to local backends