This example demonstrates extracting data from a Postgres database and inserting data to TimescaleDB.
The demo starts up said PostgreSQL, TimescaleDB, Tremor and
00_ramps.yaml we pass in a
configuration for an onramp of type
postgres along with typical connection
Additionally, we are required to specify
interval_ms which stands for
frequency of polling that Tremor is performing on Postgres database with the
query. Query will be passed two parameters:
TIMESTAMPTZthat indicates the start time and date for the range
TIMESTAMPTZthat indicates the ending time and date for the range
The initial range is formed by taking
consume_from configuration setting and
the current time and date. This will effectivelly backfill data. From then on,
Tremor will poll in regular
In addition to a
postgres onramp, we also utilize a
crononome onramp. The
intention is to demonstrate intermediate record format which is accepted by
We have two pipelines.
postgres.tricklefor data coming from a PostgreSQL database
crononome.tricklefor events coming from the
crononomeonramp at a regular interval of
Command line testing during logic development
$ docker-compose up
... lots of logs ...
Open the pgweb to browse through received rows in TimescaleDB.