frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

PSFirebirdToMSSQL – 6x faster than Linked Servers (21 min → 3:24 min)

https://github.com/gitnol/PSFirebirdToMSSQL
1•hngitnol•1mo ago

Comments

hngitnol•1mo ago
Our Linked Server sync took 21 minutes and broke on schema changes. Built this as a replacement.

Numbers (74 tables, 21M+ rows): - Full sync: 3:24 min (was 21 min) - Incremental: 20 sec - With orphan cleanup: 43 sec - Largest table (9.5M rows): 53 sec

How: 1. SqlBulkCopy streaming (no temp files) 2. ForEach-Object -Parallel for tables 3. Staging + MERGE pattern 4. High Watermark for delta detection

Zero-config start: Auto-creates DB, installs stored procedure, creates staging tables, detects schema.

v2.10: Now supports configurable ID/timestamp columns. Not hardcoded to ID/GESPEICHERT anymore - works with any Firebird database.

Happy to discuss the implementation.