How long does it take for the data to appear in Arcadia after the data has entered a Kafka topic?

It is usually a function of the commit interval https://docs.confluent.io/current/ksql/docs/installation/server-config/config-reference.html#ksql-streams-commit-interval-ms
as well as the latency for a request to get from the ksql server to arcadia viz server and then to the user’s web browser.

So in general:

  • the commit-interval as the floor (minimum)
  • in practice commit-interval + epsilon for the other overheads.

Note - If there are aggregations or complex operations there will be some overhead there as well

1 Like