Large-scale Data Engineering - Experience 8-12 Years

Company Description Antern Technologies is a product and engineering services company with over a decade of experience building scalable digital platforms and enterprise solutions. The organization specializes in AI-driven products and custom technology solutions that help clients modernize systems, improve efficiency, and achieve measurable business outcomes.

Role Description This is a part-time, remote role for a Large-scale Data Engineer with 8–12 years of experience who are staying in bengaluru.

Who can deliver the conflicts data foundation as a dedicated workstream - the ten-year bulk load, normalise/resolve, graph+vector build and incremental sync - so conflicts is accepted on a live index.

Key responsibilities.

• Bulk historical load from the systems of record (Aderant matters and parties via the published field maps): 300k-400k matters, 1-3M party rows.
• Corpus-scale normalise-and-resolve to the same rules the live matcher uses; the graph and vector build; the search-service performance work.
• Incremental sync for same-business-day freshness (including the platform's own write-back and the ledger reconciliation).

Must-have. Large-scale data / ETL engineering; SQL Server; entity resolution; performance tuning, Graph / vector stores, record linkage; graph and vector databases; SQL Server (incl. vector); large-scale data engineering

Nice-to-have. Experience in Legal or party data at scale.

Experience: 8+ Years of Data migration experience, Min 2 years of experience in Knowledge graph and Vector Data migration.