Using SPICEDB_DATASTORE_READ_REPLICA_CONN_URI and SPICEDB_DATASTORE_CONN_URI environment variables causes duplicate metrics error

[shaafekhan]

What platforms are affected?

linux

What architectures are affected?

amd64

What SpiceDB version are you using?

v1.43.0

Steps to Reproduce

1. Run SpiceDB container with the following environment variables:

• SPICEDB_DATASTORE_READ_REPLICA_CONN_URI=read-replica endpoint (user:password@tcp(read-only-host:3306)/database?tls=skip-verify&parseTime=true
• SPICEDB_DATASTORE_CONN_URI=write endpoint (user:password@tcp(write-host:3306)/database?tls=skip-verify&parseTime=true

2. Our spicedb config:
   containers:
   • args:
     • spicedb
     • serve
     • '--datastore-engine=mysql'
     • '--grpc-enabled=true'
     • '--http-enabled=true'
     • '--dispatch-cluster-enabled=true'
     • '--metrics-enabled=true'
     • '--otel-endpoint=datadog-statsd.monitoring.svc.cluster.local:4318'
     • '--otel-provider=otlphttp'
     • '--dispatch-upstream-addr=kubernetes://spicedb.spicedb:50053'
     • '--log-format=json'
     • '--otel-service-name=spicedb'
     • '--otel-insecure'
   • envs: (besides the datastore environment variables)
     • name: SPICEDB_GRPC_PRESHARED_KEY
       value: grpckey

We are running SpiceDB in EKS v1.31.1-eks-1b3e656

Expected Result

{"level":"info","time":"2025-08-05T08:16:34Z","message":"using mysql datastore engine"}

Actual Result

{"level":"trace","time":"2025-08-03T21:48:27Z","message":"NewMySQLDatastore: unable to instrument connector: unable to register metric: duplicate metrics collector registration attempted"}

{"level":"error","error":"failed to create datastore: NewMySQLDatastore: unable to instrument connector. To view details of this error (that may contain sensitive information), please run with --log-level=trace

[shaafekhan]

Just an addendum to testing, it seems that the following setup also leads to the same error when using a docker compose setup.

services:
  spicedb-engine-migrate:
    image: ghcr.io/authzed/spicedb:v1.43.0 #also tried 1.45.1
    command: migrate head
    environment:
      SPICEDB_GRPC_PRESHARED_KEY: somerandomkey
      SPICEDB_LOG_LEVEL: trace
      SPICEDB_DATASTORE_ENGINE: mysql 
      SPICEDB_DATASTORE_READ_REPLICA_CONN_URI: admin:password@tcp(database-ro.eu-west-1.rds.amazonaws.com:3306)/spicedb?tls=skip-verify&parseTime=true
      SPICEDB_DATASTORE_CONN_URI: admin:password@tcp(database.eu-west-1.rds.amazonaws.com:3306)/spicedb?tls=skip-verify&parseTime=true
  spicedb-engine:
    image: ghcr.io/authzed/spicedb:v1.43.0 #also tried 1.45.1
    restart: always
    ports:
    - "8080:8080"
    depends_on:
     - spicedb-engine-migrate
    command: serve
    environment:
      SPICEDB_GRPC_PRESHARED_KEY: somerandomkey
      SPICEDB_LOG_LEVEL: trace
      SPICEDB_DATASTORE_ENGINE: mysql 
      SPICEDB_DATASTORE_READ_REPLICA_CONN_URI: admin:password@tcp(database-ro.eu-west-1.rds.amazonaws.com:3306)/spicedb?tls=skip-verify&parseTime=true
      SPICEDB_DATASTORE_CONN_URI: admin:password@tcp(database.eu-west-1.rds.amazonaws.com:3306)/spicedb?tls=skip-verify&parseTime=true