Data Lineage
Understand how Foundational's lineage extraction from code works
16 articles
- Spark LineageHow Foundational extracts lineage from PySpark, Scala Spark, and Spark SQL by simulating the code in a sandbox, and how this differs from OpenLineage.
- Extracting Lineage from JavaSee how Foundational extracts column-level lineage directly from Java code, including Hibernate, Spring Data JPA, MyBatis, JDBC, jOOQ, and QueryDSL.
- Extracting Lineage from ScalaFoundational extracts column-level lineage from Scala code, including Spark DataFrames, spark.sql strings and case classes, with no cluster or code changes.
- Extracting Lineage from KafkaHow Foundational builds field-level lineage from Kafka producer, consumer, Kafka Streams, and Schema Registry code; setup is connecting repositories.
- Extracting Lineage from .NETSee how Foundational extracts column-level lineage from .NET code, including Entity Framework Core, LINQ, Dapper, and ADO.NET, and how to set it up.
- Mainframe COBOL Lineage on AWS CardDemoField-level lineage on AWS CardDemo: how CBTRN02C posts DALYTRAN to ACCTDATA, traced through copybooks, JCL DD statements and DB2 by static code analysis.
- SQL LineageLearn how Foundational's SQL lineage engine parses queries with SQLGlot, ignores CTEs, resolves ambiguous columns, and builds the full lineage graph.
- Extracting Lineage from SQLAlchemyFoundational reads SQLAlchemy models in your repository, not the deployed database, to extract schema and lineage and flag downstream impact in pull requests.
- Extracting Lineage from Doctrine (ORM for PHP)How Foundational extracts schema and lineage from Doctrine PHP ORM definition files so you can preview downstream impact in pull requests before deploying.
- Extracting Lineage from Ruby Active RecordSee how Foundational extracts schema and lineage from Ruby on Rails Active Record models in code, so you can assess downstream impact before deploying.
- Extracting Lineage from Liquibase MigrationsFoundational parses Liquibase changesets in XML, YAML, JSON or SQL from your repository to extract schema and lineage and show impact before deployment.
- Extracting Lineage from TypeORM (TypeScript ORM)How Foundational extracts schema and lineage from TypeORM entity files, detects schema changes in pull requests, and flags downstream impact early.
- Extracting Lineage from Entity Framework Core (Native C# ORM)See how Foundational reads Entity Framework Core model classes to extract tables, columns, and relationships, and flags schema changes in pull requests.
- OpenLineage Support in FoundationalHow Foundational supports OpenLineage: ingest runtime events from pipelines and export code-time lineage, and how static and runtime lineage differ.
- Extracting Lineage from Python
- How to upload manual lineage (xlsx)
