Serverless URL Engine

Serverless URL Engine

Β·

2 min read

Play this article

Free, Serverless URL Engine Storage

Your unlimited, serverless URL table - batteries included πŸ”‹
Ready anywhere, anytime - all you need is ClickHouse client

Decentralized URL Engine for ClickHouse

URLENG is a public decentralized service running on Cloudflare Workers and utilizing Deta Cloud for unlimited storage - like a pastie for ClickHouse tables

The goal is to enable separate ClickHouse servers to access external distributed tables hosted on the cloud to share any type of data and information between nodes and other APIs in real-time through the native URL Engine and Functions.

image.png


Usage

The following examples illustrate basic usage for distributed INSERT and SELECT statements using serverless URL Engine tables

Public Access Point

  • https://urleng.com/{yoursupersecretkeygoeshere}

You're about to create your very own serverless, storage persistent URL Engine table - accessible from anywhere. Since there are no logins or signups, all data is hidden in public. Your protection is the secret URL path so choose wisely.

INSERT
:) INSERT INTO FUNCTION url('https://urleng.com/supersecret', JSONEachRow, 'key String, value UInt64') VALUES ('hello', 1), ('world', 2)
SELECT
:) SELECT * FROM url('https://urleng.com/supersecret', JSONEachRow);

β”Œβ”€key───┬─value─┐
β”‚ hello β”‚     1 β”‚
β”‚ world β”‚     2 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”˜

2 rows in set. Elapsed: 0.126 sec.
URL ENGINE
:) CREATE TABLE default.url_engine_distributed
       (
           `key` String,
           `value` UInt64
       )
       ENGINE = URL('https://urleng.com/supersecret', 'JSONEachRow')
:) INSERT INTO url_engine_distributed VALUES ('hello', 1), ('world', 2)
:) SELECT * FROM url_engine_distributed

β”Œβ”€key───┬─value─┐
β”‚ hello β”‚     1 β”‚
β”‚ world β”‚     2 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”˜

2 rows in set. Elapsed: 0.185 sec.

That's all it takes! Enjoy your serverless table for any purpose.

Bonus Points

Play with URLENG using ClickHouse Mate

URLENG works like magic with our Serverless ClickHouse experiments, too!

image.png

Try it out

Let's use ClickHouse Fiddle and URLENG to share data between sessions

Notes

  • INSERTS are updates. Existing data will be replaced.
  • SELECT like S3 a query pulls the full table, pending X-Header extensions
  • Payload size is limited to < 5MB in the public version

UPDATE

URLENG is now available as an App on Deta Space where you can have your own instance with personal storage!


Having fun?

Find more examples and advanced usage browse to https://urleng.com/

Did you find this article valuable?

Support qryn by becoming a sponsor. Any amount is appreciated!

Β