Skip to content

feat(duckdb): Add DuckDB Backend#598

Open
alifiroozi80 wants to merge 4 commits intosilverton-io:mainfrom
alifiroozi80:add-duckdb-backend
Open

feat(duckdb): Add DuckDB Backend#598
alifiroozi80 wants to merge 4 commits intosilverton-io:mainfrom
alifiroozi80:add-duckdb-backend

Conversation

@alifiroozi80
Copy link

@alifiroozi80 alifiroozi80 commented Nov 3, 2024

Hello there,
Thanks for this fantastic project.
I needed the DuckDB feature but it wasn't available, so I added it.

In writing, I realized there is no DuckDB driver for Gorm, so I first created that driver (you can see it here, and here is the merge request on Gorm to add this driver to their main website), and then I used it here for this feature.


After the merge, I will create another merge request on buz-docs and add this supported backend there as well.


Here are the steps:

make bootstrap

Then send a dummy data:

curl -X POST "localhost:8080/webhook" -H 'Content-Type:application/json' -d '{"arbitrary": "thing"}'

Here is the result:

Screenshot 2024-11-18 at 12 20 38 PM

@jakthom
Copy link
Contributor

jakthom commented Nov 17, 2024

@alifiroozi80 love this!! It's totally where my head is as well (see https://github.com/jakthom/hercules for what I've been playing with along this line of thinking).

I've been trying to work through all the CGO=1 implications (ci builds, running in a lambda, etc) before adding a DuckDB backend. Do you have thoughts on all the CGO things? This might (finally) be incentive to make builds dependent on what sinks are configured, etc...

@alifiroozi80
Copy link
Author

alifiroozi80 commented Nov 18, 2024

Hello @jakthom
Thanks, mate🙏🍻
About CGO, I didn't get your point. Did you mean to use C and write a custom driver instead of using something like GORM?

@alifiroozi80
Copy link
Author

Hello @jakthom
Just a reinder on this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants