Show HN: Open-source infra for building embedded data pipelines https://ift.tt/C1lw7s0

Show HN: Open-source infra for building embedded data pipelines Hey HN! We are building *open source infrastructure for deploying customer-facing data pipelines.* Here’s our repo https://ift.tt/CIGe2L0 and website https://pipebird.com/ . Pipebird is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products. Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of truth without having to maintain custom built pipelines or introduce security risks by contracting a third-party ETL/ELT provider. After seeing Stripe https://ift.tt/R82czo5 and customer.io https://ift.tt/mVkbsRj recently invest in building out their own native data sharing products, we realized that many SaaS companies could better support their customers and even generate additional revenue by offering native data pipelines. Our goal with Pipebird is to make creating a reliable data pipeline as simple as pressing a button from a vendor's dashboard. With the current iteration of the product, data can be selected from a number of sources (ex: Postgres, MySQL, CockroachDB, etc.), customers can configure pipelines and optionally apply transformations (like type casting), and data can be periodically synced directly to customers’ warehouses (ex: Snowflake). We’re actively adding sources/destinations and would appreciate any feature requests. Here's a 2 min demo of the product https://ift.tt/60h3LGu Pipebird is open source (MIT license) so that any developer can use it. Our aim is to not charge individual developers - we make money selling paid plans that include features like multiple projects, user permissions, additional security features, managed infra, support, etc. Give us a whirl: https://ift.tt/CIGe2L0 . We’d love your feedback and will be here to answer any questions! https://ift.tt/CIGe2L0 September 1, 2022 at 06:57AM