Deploy Streambased A.S.K.

A step by step guide from 0 to 1

Step 1: Prepare a base configuration

Streambased A.S.K. (Analytics Service for Kafka) requires only a single short config file to start. An example can be seen below:

# ---------- Indexing Configuration --------------- #
board.size=1000

field.extractors=transactionsExtractor
sources=default
aggregators=transactionsAggregator

aggregators.transactionsAggregator.topic=transactions
aggregators.transactionsAggregator.source=default
aggregators.transactionsAggregator.aggregate.fields=amount
aggregators.transactionsAggregator.grouping.fields=paymentTermCode

field.extractors.transactionsExtractor.class=io.streambased.index.extractor.JsonValueFieldsExtractor
field.extractors.transactionsExtractor.topic=transactions
field.extractors.transactionsExtractor.source=default
field.extractors.transactionsExtractor.useSchemaRegistry=true

sources.default.bootstrap.servers=localhost:9092
sources.default.schema.registry.schema.registry.url=http://localhost:8081
sources.default.schema.registry.json.fail.invalid.schema=false

For more information on the configuration parameters see configuration

Save this example configuration as client.properties in your environment, make any changes necessary and mount as below.

Step 2: Start Streambased A.S.K.

An indexer can be started with the following command:

docker run -v ${PWD}/client.properties:/etc/streambased/etc/client.properties -p 8080:8080 streambased/streambased-enterprise:latest

Step 3: Connect to Streambased A.S.K.

Streambased exposes an interface that is 100% compatible with that which is exposed by the popular Trino database. This means connectivity can be established using components from the Trino ecosystem including:

• The Trino JDBC driver

• Trino ODBC drivers

• SQL-Alchemy for Trino

Tutorials on connecting your favourite analytical applications to Streambased can be found here.

If you wish to see first hand the performance gains from Streambased acceleration, you can temporarily disable acceleration from your SQL client using the following session variable.

SET SESSION use_streambased = false;

Remember to re-enable after testing.

Step 4: Scale

Streambased A.S.K. can scale alongside your Kafka infrastructure to practically unlimited capability. Please reach out to our team to schedule your free architecture assessment.